2024-06-27T22:31:07.654849261Z .... 2024-06-27T22:31:08.418825163Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-06-27T22:31:10.442823531Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-06-27T22:31:15.654792563Z [2024-06-27T22:31:15.649+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-06-27T22:31:34.233999219Z 2024-06-27T22:31:35.065624524Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-06-27T22:31:36.134974448Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-06-27T22:31:42.466767594Z ____________ _____________ 2024-06-27T22:31:42.466797621Z ____ |__( )_________ __/__ /________ __ 2024-06-27T22:31:42.466812856Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-06-27T22:31:42.466815856Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-06-27T22:31:42.466818631Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-06-27T22:31:42.466822398Z [2024-06-27T22:31:42.466+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-06-27T22:31:42.470823930Z [2024-06-27T22:31:42.467+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-06-27T22:31:43.282660187Z [2024-06-27T22:31:43.281+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-06-27T22:31:43.343602117Z [2024-06-27T22:31:43.303+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 15 2024-06-27T22:31:43.347206148Z [2024-06-27T22:31:43.346+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T22:31:43.357357063Z [2024-06-27T22:31:43.338+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-06-27T22:31:43.370884296Z [2024-06-27T22:31:43.370+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-06-27T22:32:45.803685978Z [2024-06-27T22:32:45.803+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:32:45.906177467Z [2024-06-27T22:32:45.905+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:32:45.906194216Z 2024-06-27T22:32:45.906368029Z [2024-06-27T22:32:45.906+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T22:32:45.907785368Z [2024-06-27T22:32:45.907+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:32:45.907797128Z 2024-06-27T22:32:45.913792953Z [2024-06-27T22:32:45.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:32:45.915178308Z [2024-06-27T22:32:45.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T22:32:46.242131317Z [2024-06-27T22:32:46.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status queued for try_number 1 2024-06-27T22:32:46.270610136Z [2024-06-27T22:32:46.270+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c68820b-231d-4710-ab9c-32776a2b44d0 2024-06-27T22:33:18.675880499Z [2024-06-27T22:33:18.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status success for try_number 1 2024-06-27T22:33:18.680782939Z [2024-06-27T22:33:18.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T22:30:00+00:00, map_index=-1, run_start_date=2024-06-27 22:32:47.114553+00:00, run_end_date=2024-06-27 22:33:17.734802+00:00, run_duration=30.620249, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:32:45.908681+00:00, queued_by_job_id=2, pid=50 2024-06-27T22:33:28.699801214Z [2024-06-27T22:33:28.699+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:33:28.699851278Z 2024-06-27T22:33:28.699858683Z [2024-06-27T22:33:28.699+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T22:33:28.700327978Z [2024-06-27T22:33:28.700+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:33:28.700340724Z 2024-06-27T22:33:28.702147060Z [2024-06-27T22:33:28.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T22:30:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:33:28.702274222Z [2024-06-27T22:33:28.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T22:33:28.777719734Z [2024-06-27T22:33:28.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status queued for try_number 2 2024-06-27T22:33:28.790235030Z [2024-06-27T22:33:28.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3597a46b-fb77-45ef-a4da-77429096f1ae 2024-06-27T22:33:39.040574325Z [2024-06-27T22:33:39.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:33:39.040990378Z [2024-06-27T22:33:39.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 22:30:00+00:00, run_id=scheduled__2024-06-27T22:30:00+00:00, run_start_date=2024-06-27 22:32:45.814929+00:00, run_end_date=2024-06-27 22:33:39.040445+00:00, run_duration=53.225516, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:30:00+00:00, data_interval_end=2024-06-27 22:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T22:33:39.055593320Z [2024-06-27T22:33:39.055+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T22:32:00+00:00, run_after=2024-06-27T22:34:00+00:00 2024-06-27T22:33:39.145763775Z [2024-06-27T22:33:39.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status success for try_number 2 2024-06-27T22:33:39.152479667Z [2024-06-27T22:33:39.150+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T22:30:00+00:00, map_index=-1, run_start_date=2024-06-27 22:33:29.382245+00:00, run_end_date=2024-06-27 22:33:38.030171+00:00, run_duration=8.647926, state=success, executor_state=success, try_number=2, max_tries=1, job_id=4, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:33:28.700597+00:00, queued_by_job_id=2, pid=69 2024-06-27T22:34:00.491834652Z [2024-06-27T22:34:00.491+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:34:00.537421193Z [2024-06-27T22:34:00.536+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:34:00.537454261Z 2024-06-27T22:34:00.537593194Z [2024-06-27T22:34:00.537+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T22:34:00.539126202Z [2024-06-27T22:34:00.538+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:34:00.539132550Z 2024-06-27T22:34:00.543033582Z [2024-06-27T22:34:00.542+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:34:00.543174320Z [2024-06-27T22:34:00.542+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T22:34:00.611575919Z [2024-06-27T22:34:00.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:32:00+00:00 exited with status queued for try_number 1 2024-06-27T22:34:00.617383556Z [2024-06-27T22:34:00.617+0000] {scheduler_job.py:635} INFO - Setting external_id for to d45bfc29-ac8f-4e0b-89c3-0cc9d6696d55 2024-06-27T22:34:02.092152874Z [2024-06-27T22:34:02.091+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:34:02.092840856Z [2024-06-27T22:34:02.092+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 22:32:00+00:00, run_id=scheduled__2024-06-27T22:32:00+00:00, run_start_date=2024-06-27 22:34:00.503857+00:00, run_end_date=2024-06-27 22:34:02.092439+00:00, run_duration=1.588582, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:32:00+00:00, data_interval_end=2024-06-27 22:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T22:34:02.101637422Z [2024-06-27T22:34:02.101+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T22:34:00+00:00, run_after=2024-06-27T22:36:00+00:00 2024-06-27T22:34:02.137135367Z [2024-06-27T22:34:02.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:32:00+00:00 exited with status success for try_number 1 2024-06-27T22:34:02.142433370Z [2024-06-27T22:34:02.142+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T22:32:00+00:00, map_index=-1, run_start_date=2024-06-27 22:34:01.332517+00:00, run_end_date=2024-06-27 22:34:01.662219+00:00, run_duration=0.329702, state=success, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:34:00.539722+00:00, queued_by_job_id=2, pid=76 2024-06-27T22:36:00.953397083Z [2024-06-27T22:36:00.952+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:36:00.989904623Z [2024-06-27T22:36:00.989+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:36:00.989921693Z 2024-06-27T22:36:00.989993605Z [2024-06-27T22:36:00.989+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T22:36:00.990621598Z [2024-06-27T22:36:00.990+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:36:00.990632902Z 2024-06-27T22:36:00.993192703Z [2024-06-27T22:36:00.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T22:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:36:00.993209470Z [2024-06-27T22:36:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T22:36:01.056668530Z [2024-06-27T22:36:01.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:34:00+00:00 exited with status queued for try_number 1 2024-06-27T22:36:01.072034149Z [2024-06-27T22:36:01.071+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81afe554-e37e-4cbd-b35b-63aaec427892 2024-06-27T22:36:02.898543417Z [2024-06-27T22:36:02.898+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:36:02.898890172Z [2024-06-27T22:36:02.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 22:34:00+00:00, run_id=scheduled__2024-06-27T22:34:00+00:00, run_start_date=2024-06-27 22:36:00.962524+00:00, run_end_date=2024-06-27 22:36:02.898460+00:00, run_duration=1.935936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:34:00+00:00, data_interval_end=2024-06-27 22:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T22:36:02.909566987Z [2024-06-27T22:36:02.909+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T22:36:00+00:00, run_after=2024-06-27T22:38:00+00:00 2024-06-27T22:36:02.948071540Z [2024-06-27T22:36:02.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:34:00+00:00 exited with status success for try_number 1 2024-06-27T22:36:02.953980049Z [2024-06-27T22:36:02.953+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T22:34:00+00:00, map_index=-1, run_start_date=2024-06-27 22:36:01.775538+00:00, run_end_date=2024-06-27 22:36:02.134151+00:00, run_duration=0.358613, state=success, executor_state=success, try_number=1, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:36:00.990912+00:00, queued_by_job_id=2, pid=109 2024-06-27T22:36:43.870454130Z [2024-06-27T22:36:43.869+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T22:38:00.344760473Z [2024-06-27T22:38:00.344+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:38:00.391241225Z [2024-06-27T22:38:00.390+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:38:00.391273404Z 2024-06-27T22:38:00.391287263Z [2024-06-27T22:38:00.391+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T22:38:00.391873924Z [2024-06-27T22:38:00.391+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:38:00.391885369Z 2024-06-27T22:38:00.395339986Z [2024-06-27T22:38:00.395+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:38:00.396046211Z [2024-06-27T22:38:00.395+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T22:38:00.452443868Z [2024-06-27T22:38:00.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:36:00+00:00 exited with status queued for try_number 1 2024-06-27T22:38:00.460693751Z [2024-06-27T22:38:00.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to e84401db-20ef-4501-8304-59450e901596 2024-06-27T22:38:01.590431225Z [2024-06-27T22:38:01.590+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:38:01.590854355Z [2024-06-27T22:38:01.590+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 22:36:00+00:00, run_id=scheduled__2024-06-27T22:36:00+00:00, run_start_date=2024-06-27 22:38:00.358866+00:00, run_end_date=2024-06-27 22:38:01.590378+00:00, run_duration=1.231512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:36:00+00:00, data_interval_end=2024-06-27 22:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T22:38:01.598410337Z [2024-06-27T22:38:01.598+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T22:38:00+00:00, run_after=2024-06-27T22:40:00+00:00 2024-06-27T22:38:01.624678610Z [2024-06-27T22:38:01.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:36:00+00:00 exited with status success for try_number 1 2024-06-27T22:38:01.631550868Z [2024-06-27T22:38:01.631+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T22:36:00+00:00, map_index=-1, run_start_date=2024-06-27 22:38:01.115585+00:00, run_end_date=2024-06-27 22:38:01.440805+00:00, run_duration=0.32522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:38:00.392315+00:00, queued_by_job_id=2, pid=141 2024-06-27T22:38:27.540344390Z [2024-06-27T22:38:27.539+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:35:00+00:00, run_after=2024-06-27T22:40:00+00:00 2024-06-27T22:38:27.594932820Z [2024-06-27T22:38:27.594+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:38:27.594975238Z 2024-06-27T22:38:27.595185044Z [2024-06-27T22:38:27.594+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:38:27.595895718Z [2024-06-27T22:38:27.595+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:38:27.595905849Z 2024-06-27T22:38:27.598256400Z [2024-06-27T22:38:27.597+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T22:38:27.598436721Z [2024-06-27T22:38:27.598+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:38:27.650279218Z [2024-06-27T22:38:27.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status queued for try_number 1 2024-06-27T22:38:27.657464155Z [2024-06-27T22:38:27.657+0000] {scheduler_job.py:635} INFO - Setting external_id for to 098fc6ea-9ba2-44fd-9ac3-b3828551582b 2024-06-27T22:38:30.089173854Z [2024-06-27T22:38:30.088+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:38:30.089202343Z 2024-06-27T22:38:30.089242175Z [2024-06-27T22:38:30.089+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:38:30.089959681Z [2024-06-27T22:38:30.089+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:38:30.089978332Z 2024-06-27T22:38:30.093987268Z [2024-06-27T22:38:30.093+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-27T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T22:38:30.094022210Z [2024-06-27T22:38:30.093+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-27T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:38:30.168914578Z [2024-06-27T22:38:30.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status queued for try_number 1 2024-06-27T22:38:30.169041935Z [2024-06-27T22:38:30.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status success for try_number 1 2024-06-27T22:38:30.173704022Z [2024-06-27T22:38:30.173+0000] {scheduler_job.py:635} INFO - Setting external_id for to b97487b9-aee9-4d69-96ab-5aa03f710466 2024-06-27T22:38:30.173798801Z [2024-06-27T22:38:30.173+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T22:30:00+00:00, map_index=-1, run_start_date=2024-06-27 22:38:29.588214+00:00, run_end_date=2024-06-27 22:38:29.991947+00:00, run_duration=0.403733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=8, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:38:27.596272+00:00, queued_by_job_id=2, pid=167 2024-06-27T22:38:32.785467265Z [2024-06-27T22:38:32.785+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:38:32.785490550Z 2024-06-27T22:38:32.785564745Z [2024-06-27T22:38:32.785+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:38:32.786243102Z [2024-06-27T22:38:32.785+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:38:32.786261720Z 2024-06-27T22:38:32.788447592Z [2024-06-27T22:38:32.788+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-27T22:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T22:38:32.788584611Z [2024-06-27T22:38:32.788+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-27T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T22:38:32.843378754Z [2024-06-27T22:38:32.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status queued for try_number 1 2024-06-27T22:38:32.851419933Z [2024-06-27T22:38:32.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status success for try_number 1 2024-06-27T22:38:32.871470197Z [2024-06-27T22:38:32.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to a873f376-68f1-4fdf-b6fa-4cfb85362c17 2024-06-27T22:38:32.871715126Z [2024-06-27T22:38:32.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-27T22:30:00+00:00, map_index=-1, run_start_date=2024-06-27 22:38:32.003960+00:00, run_end_date=2024-06-27 22:38:32.326264+00:00, run_duration=0.322304, state=success, executor_state=success, try_number=1, max_tries=1, job_id=9, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:38:30.090361+00:00, queued_by_job_id=2, pid=180 2024-06-27T22:38:35.088397938Z [2024-06-27T22:38:35.088+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:38:35.088422050Z 2024-06-27T22:38:35.088553487Z [2024-06-27T22:38:35.088+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:38:35.089129603Z [2024-06-27T22:38:35.088+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:38:35.089143598Z 2024-06-27T22:38:35.091076790Z [2024-06-27T22:38:35.090+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-27T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:38:35.091190028Z [2024-06-27T22:38:35.090+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-27T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:38:35.140198257Z [2024-06-27T22:38:35.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status queued for try_number 1 2024-06-27T22:38:35.140460078Z [2024-06-27T22:38:35.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status success for try_number 1 2024-06-27T22:38:35.146348134Z [2024-06-27T22:38:35.146+0000] {scheduler_job.py:635} INFO - Setting external_id for to c83c9b18-3b3f-4b92-8184-ff0ffe3c12ad 2024-06-27T22:38:35.147543015Z [2024-06-27T22:38:35.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-27T22:30:00+00:00, map_index=0, run_start_date=2024-06-27 22:38:34.414775+00:00, run_end_date=2024-06-27 22:38:34.748493+00:00, run_duration=0.333718, state=success, executor_state=success, try_number=1, max_tries=1, job_id=10, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:38:32.786554+00:00, queued_by_job_id=2, pid=188 2024-06-27T22:38:36.512713509Z [2024-06-27T22:38:36.512+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:38:00+00:00, run_after=2024-06-27T22:39:00+00:00 2024-06-27T22:38:36.573698728Z [2024-06-27T22:38:36.573+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:38:36.573713237Z 2024-06-27T22:38:36.573847177Z [2024-06-27T22:38:36.573+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:38:36.574525783Z [2024-06-27T22:38:36.574+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:38:36.574537797Z 2024-06-27T22:38:36.576457869Z [2024-06-27T22:38:36.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:38:36.576696699Z [2024-06-27T22:38:36.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:38:36.664689346Z [2024-06-27T22:38:36.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:37:00+00:00 exited with status queued for try_number 1 2024-06-27T22:38:36.675119733Z [2024-06-27T22:38:36.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to b33a95b3-b550-46d4-baf3-83e81e23ebe9 2024-06-27T22:38:37.862774584Z [2024-06-27T22:38:37.862+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:38:37.904774781Z [2024-06-27T22:38:37.904+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:38:37.904927410Z [2024-06-27T22:38:37.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:30:00+00:00, run_id=scheduled__2024-06-27T22:30:00+00:00, run_start_date=2024-06-27 22:38:27.549398+00:00, run_end_date=2024-06-27 22:38:37.904700+00:00, run_duration=10.355302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:30:00+00:00, data_interval_end=2024-06-27 22:35:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-27T22:38:37.913848221Z [2024-06-27T22:38:37.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:35:00+00:00, run_after=2024-06-27T22:40:00+00:00 2024-06-27T22:38:37.926946160Z [2024-06-27T22:38:37.926+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:38:37.926960373Z 2024-06-27T22:38:37.927095493Z [2024-06-27T22:38:37.926+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:38:37.928073357Z [2024-06-27T22:38:37.927+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:38:37.928089192Z 2024-06-27T22:38:37.929812251Z [2024-06-27T22:38:37.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:38:37.929921050Z [2024-06-27T22:38:37.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:38:37.997957841Z [2024-06-27T22:38:37.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:37:00+00:00 exited with status queued for try_number 1 2024-06-27T22:38:37.998561489Z [2024-06-27T22:38:37.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status success for try_number 1 2024-06-27T22:38:38.011573746Z [2024-06-27T22:38:38.011+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-27T22:30:00+00:00, map_index=-1, run_start_date=2024-06-27 22:38:37.089391+00:00, run_end_date=2024-06-27 22:38:37.483828+00:00, run_duration=0.394437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=11, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:38:35.089421+00:00, queued_by_job_id=2, pid=197 2024-06-27T22:38:38.012425339Z [2024-06-27T22:38:38.012+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ccc3a34-740a-4292-9a7f-f2593b1adaf8 2024-06-27T22:38:40.240261575Z [2024-06-27T22:38:40.239+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:38:40.240691815Z [2024-06-27T22:38:40.240+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:37:00+00:00, run_id=scheduled__2024-06-27T22:37:00+00:00, run_start_date=2024-06-27 22:38:36.526149+00:00, run_end_date=2024-06-27 22:38:40.240142+00:00, run_duration=3.713993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:37:00+00:00, data_interval_end=2024-06-27 22:38:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:38:40.248956899Z [2024-06-27T22:38:40.248+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:38:00+00:00, run_after=2024-06-27T22:39:00+00:00 2024-06-27T22:38:40.288249989Z [2024-06-27T22:38:40.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:37:00+00:00 exited with status success for try_number 1 2024-06-27T22:38:40.293576134Z [2024-06-27T22:38:40.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:37:00+00:00, map_index=-1, run_start_date=2024-06-27 22:38:38.493645+00:00, run_end_date=2024-06-27 22:38:39.770046+00:00, run_duration=1.276401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=12, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:38:36.574951+00:00, queued_by_job_id=2, pid=205 2024-06-27T22:38:42.422126659Z [2024-06-27T22:38:42.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:38:42.422193413Z [2024-06-27T22:38:42.422+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:37:00+00:00, run_id=scheduled__2024-06-27T22:37:00+00:00, run_start_date=2024-06-27 22:38:37.872554+00:00, run_end_date=2024-06-27 22:38:42.421923+00:00, run_duration=4.549369, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:37:00+00:00, data_interval_end=2024-06-27 22:38:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:38:42.431362024Z [2024-06-27T22:38:42.430+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:38:00+00:00, run_after=2024-06-27T22:39:00+00:00 2024-06-27T22:38:42.459757120Z [2024-06-27T22:38:42.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:37:00+00:00 exited with status success for try_number 1 2024-06-27T22:38:42.466810183Z [2024-06-27T22:38:42.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:37:00+00:00, map_index=-1, run_start_date=2024-06-27 22:38:39.682550+00:00, run_end_date=2024-06-27 22:38:41.291658+00:00, run_duration=1.609108, state=success, executor_state=success, try_number=1, max_tries=1, job_id=13, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:38:37.928096+00:00, queued_by_job_id=2, pid=217 2024-06-27T22:38:48.871025476Z [2024-06-27T22:38:48.870+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:38:00+00:00, run_after=2024-06-27T22:39:00+00:00 2024-06-27T22:38:48.914367054Z [2024-06-27T22:38:48.914+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:38:48.914393314Z 2024-06-27T22:38:48.914567842Z [2024-06-27T22:38:48.914+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:38:48.915313104Z [2024-06-27T22:38:48.915+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:38:48.915328937Z 2024-06-27T22:38:48.918013224Z [2024-06-27T22:38:48.917+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:38:48.918265846Z [2024-06-27T22:38:48.918+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:38:48.961373298Z [2024-06-27T22:38:48.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:37:00+00:00 exited with status queued for try_number 1 2024-06-27T22:38:48.975668750Z [2024-06-27T22:38:48.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3663fbbc-e54c-4917-a585-76240763a2bf 2024-06-27T22:38:50.127827114Z [2024-06-27T22:38:50.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:38:50.128247822Z [2024-06-27T22:38:50.128+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:37:00+00:00, run_id=scheduled__2024-06-27T22:37:00+00:00, run_start_date=2024-06-27 22:38:48.882214+00:00, run_end_date=2024-06-27 22:38:50.127731+00:00, run_duration=1.245517, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:37:00+00:00, data_interval_end=2024-06-27 22:38:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:38:50.137071138Z [2024-06-27T22:38:50.136+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:38:00+00:00, run_after=2024-06-27T22:39:00+00:00 2024-06-27T22:38:50.164839362Z [2024-06-27T22:38:50.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:37:00+00:00 exited with status success for try_number 1 2024-06-27T22:38:50.169661288Z [2024-06-27T22:38:50.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:37:00+00:00, map_index=-1, run_start_date=2024-06-27 22:38:49.648849+00:00, run_end_date=2024-06-27 22:38:50.024554+00:00, run_duration=0.375705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=14, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:38:48.915721+00:00, queued_by_job_id=2, pid=229 2024-06-27T22:39:00.527717914Z [2024-06-27T22:39:00.527+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:39:00+00:00, run_after=2024-06-27T22:40:00+00:00 2024-06-27T22:39:00.534750210Z [2024-06-27T22:39:00.534+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:39:00.548760568Z [2024-06-27T22:39:00.548+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:39:00+00:00, run_after=2024-06-27T22:40:00+00:00 2024-06-27T22:39:00.625429932Z [2024-06-27T22:39:00.624+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T22:39:00.625517095Z 2024-06-27T22:39:00.625528463Z 2024-06-27T22:39:00.625537452Z 2024-06-27T22:39:00.625562693Z [2024-06-27T22:39:00.625+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:39:00.625616630Z [2024-06-27T22:39:00.625+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:39:00.625903743Z [2024-06-27T22:39:00.625+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:39:00.626473197Z [2024-06-27T22:39:00.626+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:39:00.626501074Z 2024-06-27T22:39:00.626551106Z 2024-06-27T22:39:00.626565114Z 2024-06-27T22:39:00.630390155Z [2024-06-27T22:39:00.630+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:39:00.630658502Z [2024-06-27T22:39:00.630+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:39:00.630992445Z [2024-06-27T22:39:00.630+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:39:00.631201775Z [2024-06-27T22:39:00.631+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:39:00.631485701Z [2024-06-27T22:39:00.631+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:39:00.631683553Z [2024-06-27T22:39:00.631+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:39:00.905938899Z [2024-06-27T22:39:00.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:38:00+00:00 exited with status queued for try_number 1 2024-06-27T22:39:00.906182862Z [2024-06-27T22:39:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:38:00+00:00 exited with status queued for try_number 1 2024-06-27T22:39:00.906335623Z [2024-06-27T22:39:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:38:00+00:00 exited with status queued for try_number 1 2024-06-27T22:39:00.917504374Z [2024-06-27T22:39:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84d60062-8a4b-4cb1-9e62-9b4ae234035f 2024-06-27T22:39:00.918127043Z [2024-06-27T22:39:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to bce12a76-0a9e-48e2-9d0a-af82c2cdbc63 2024-06-27T22:39:00.918330330Z [2024-06-27T22:39:00.918+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54a6070d-fe2a-44dd-8c7c-46225d40a06b 2024-06-27T22:39:02.208519810Z [2024-06-27T22:39:02.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:39:02.208814010Z [2024-06-27T22:39:02.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:38:00+00:00, run_id=scheduled__2024-06-27T22:38:00+00:00, run_start_date=2024-06-27 22:39:00.568285+00:00, run_end_date=2024-06-27 22:39:02.208442+00:00, run_duration=1.640157, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:38:00+00:00, data_interval_end=2024-06-27 22:39:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:39:02.219890827Z [2024-06-27T22:39:02.219+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:39:00+00:00, run_after=2024-06-27T22:40:00+00:00 2024-06-27T22:39:02.247779414Z [2024-06-27T22:39:02.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:38:00+00:00 exited with status success for try_number 1 2024-06-27T22:39:02.253349923Z [2024-06-27T22:39:02.252+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:38:00+00:00, map_index=-1, run_start_date=2024-06-27 22:39:01.425140+00:00, run_end_date=2024-06-27 22:39:01.770186+00:00, run_duration=0.345046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=15, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:39:00.627102+00:00, queued_by_job_id=2, pid=243 2024-06-27T22:39:04.410891694Z [2024-06-27T22:39:04.410+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:39:04.411054753Z [2024-06-27T22:39:04.410+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:38:00+00:00, run_id=scheduled__2024-06-27T22:38:00+00:00, run_start_date=2024-06-27 22:39:00.563347+00:00, run_end_date=2024-06-27 22:39:04.410810+00:00, run_duration=3.847463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:38:00+00:00, data_interval_end=2024-06-27 22:39:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:39:04.420892143Z [2024-06-27T22:39:04.420+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:39:00+00:00, run_after=2024-06-27T22:40:00+00:00 2024-06-27T22:39:04.477463874Z [2024-06-27T22:39:04.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:38:00+00:00 exited with status success for try_number 1 2024-06-27T22:39:04.493233547Z [2024-06-27T22:39:04.492+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:38:00+00:00, map_index=-1, run_start_date=2024-06-27 22:39:02.393531+00:00, run_end_date=2024-06-27 22:39:03.566826+00:00, run_duration=1.173295, state=success, executor_state=success, try_number=1, max_tries=1, job_id=16, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:39:00.627102+00:00, queued_by_job_id=2, pid=256 2024-06-27T22:39:05.586626004Z [2024-06-27T22:39:05.586+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:39:05.587341120Z [2024-06-27T22:39:05.587+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:38:00+00:00, run_id=scheduled__2024-06-27T22:38:00+00:00, run_start_date=2024-06-27 22:39:00.566073+00:00, run_end_date=2024-06-27 22:39:05.586968+00:00, run_duration=5.020895, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:38:00+00:00, data_interval_end=2024-06-27 22:39:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:39:05.596864187Z [2024-06-27T22:39:05.596+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:39:00+00:00, run_after=2024-06-27T22:40:00+00:00 2024-06-27T22:39:05.631740010Z [2024-06-27T22:39:05.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:38:00+00:00 exited with status success for try_number 1 2024-06-27T22:39:05.636558440Z [2024-06-27T22:39:05.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:38:00+00:00, map_index=-1, run_start_date=2024-06-27 22:39:02.789827+00:00, run_end_date=2024-06-27 22:39:04.782493+00:00, run_duration=1.992666, state=success, executor_state=success, try_number=1, max_tries=1, job_id=17, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:39:00.627102+00:00, queued_by_job_id=2, pid=267 2024-06-27T22:39:31.423996473Z [2024-06-27T22:39:31.423+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 to 2024-06-27T22:35:00+00:00, run_after=2024-06-27T22:40:00+00:00 2024-06-27T22:39:31.473852991Z [2024-06-27T22:39:31.473+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:39:31.473864384Z 2024-06-27T22:39:31.473913212Z [2024-06-27T22:39:31.473+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 has 0/16 running and queued tasks 2024-06-27T22:39:31.474464526Z [2024-06-27T22:39:31.474+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:39:31.474486651Z 2024-06-27T22:39:31.476924142Z [2024-06-27T22:39:31.476+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T22:39:31.477031994Z [2024-06-27T22:39:31.476+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:39:31.525602224Z [2024-06-27T22:39:31.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status queued for try_number 1 2024-06-27T22:39:31.530014335Z [2024-06-27T22:39:31.529+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b97cc6e-be10-4edd-963a-e960f7ac069e 2024-06-27T22:39:33.767766483Z [2024-06-27T22:39:33.767+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:39:33.767790250Z 2024-06-27T22:39:33.767794709Z [2024-06-27T22:39:33.767+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 has 0/16 running and queued tasks 2024-06-27T22:39:33.768414784Z [2024-06-27T22:39:33.768+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:39:33.768427981Z 2024-06-27T22:39:33.770222367Z [2024-06-27T22:39:33.770+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', task_id='split_metrics', run_id='scheduled__2024-06-27T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T22:39:33.770494070Z [2024-06-27T22:39:33.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', 'split_metrics', 'scheduled__2024-06-27T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:39:33.836469377Z [2024-06-27T22:39:33.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.split_metrics run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status queued for try_number 1 2024-06-27T22:39:33.836698818Z [2024-06-27T22:39:33.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status success for try_number 1 2024-06-27T22:39:33.846561138Z [2024-06-27T22:39:33.846+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T22:30:00+00:00, map_index=-1, run_start_date=2024-06-27 22:39:33.149418+00:00, run_end_date=2024-06-27 22:39:33.526348+00:00, run_duration=0.37693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=18, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:39:31.474837+00:00, queued_by_job_id=2, pid=293 2024-06-27T22:39:33.850974231Z [2024-06-27T22:39:33.849+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03be3749-1c50-40a2-b4c6-bd9f5f980ee5 2024-06-27T22:39:36.630488899Z [2024-06-27T22:39:36.630+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:39:36.630526360Z 2024-06-27T22:39:36.630634357Z [2024-06-27T22:39:36.630+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 has 0/16 running and queued tasks 2024-06-27T22:39:36.631238676Z [2024-06-27T22:39:36.631+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:39:36.631250054Z 2024-06-27T22:39:36.634404351Z [2024-06-27T22:39:36.634+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', task_id='collect_metrics', run_id='scheduled__2024-06-27T22:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T22:39:36.634556298Z [2024-06-27T22:39:36.634+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', 'collect_metrics', 'scheduled__2024-06-27T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T22:39:36.693389185Z [2024-06-27T22:39:36.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.collect_metrics run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status queued for try_number 1 2024-06-27T22:39:36.695338180Z [2024-06-27T22:39:36.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.split_metrics run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status success for try_number 1 2024-06-27T22:39:36.706387586Z [2024-06-27T22:39:36.705+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=split_metrics, run_id=scheduled__2024-06-27T22:30:00+00:00, map_index=-1, run_start_date=2024-06-27 22:39:35.819330+00:00, run_end_date=2024-06-27 22:39:36.172344+00:00, run_duration=0.353014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=19, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:39:33.768730+00:00, queued_by_job_id=2, pid=306 2024-06-27T22:39:36.706822435Z [2024-06-27T22:39:36.706+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30733967-a2bb-4c7d-91d0-73b91d2d1cb1 2024-06-27T22:39:39.230121094Z [2024-06-27T22:39:39.229+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:39:39.230135930Z 2024-06-27T22:39:39.230260552Z [2024-06-27T22:39:39.230+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 has 0/16 running and queued tasks 2024-06-27T22:39:39.230874334Z [2024-06-27T22:39:39.230+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:39:39.230885869Z 2024-06-27T22:39:39.232994263Z [2024-06-27T22:39:39.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', task_id='send_prometheus', run_id='scheduled__2024-06-27T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:39:39.233152976Z [2024-06-27T22:39:39.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', 'send_prometheus', 'scheduled__2024-06-27T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:39:39.280414501Z [2024-06-27T22:39:39.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.send_prometheus run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status queued for try_number 1 2024-06-27T22:39:39.280856729Z [2024-06-27T22:39:39.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.collect_metrics run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status success for try_number 1 2024-06-27T22:39:39.287518470Z [2024-06-27T22:39:39.287+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=collect_metrics, run_id=scheduled__2024-06-27T22:30:00+00:00, map_index=0, run_start_date=2024-06-27 22:39:38.257383+00:00, run_end_date=2024-06-27 22:39:38.621919+00:00, run_duration=0.364536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=20, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:39:36.631531+00:00, queued_by_job_id=2, pid=314 2024-06-27T22:39:39.287928417Z [2024-06-27T22:39:39.287+0000] {scheduler_job.py:635} INFO - Setting external_id for to a78bdd1c-d550-459d-b2f7-1d2cde4610c6 2024-06-27T22:39:41.800476170Z [2024-06-27T22:39:41.800+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:39:41.800850266Z [2024-06-27T22:39:41.800+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, execution_date=2024-06-27 22:30:00+00:00, run_id=scheduled__2024-06-27T22:30:00+00:00, run_start_date=2024-06-27 22:39:31.434172+00:00, run_end_date=2024-06-27 22:39:41.800428+00:00, run_duration=10.366256, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:30:00+00:00, data_interval_end=2024-06-27 22:35:00+00:00, dag_hash=ba2b06ba6387d485fc9c514c8433d0b6 2024-06-27T22:39:41.809724589Z [2024-06-27T22:39:41.809+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 to 2024-06-27T22:35:00+00:00, run_after=2024-06-27T22:40:00+00:00 2024-06-27T22:39:42.922130791Z [2024-06-27T22:39:42.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330 to 2024-06-27T22:39:00+00:00, run_after=2024-06-27T22:40:00+00:00 2024-06-27T22:39:42.932842008Z [2024-06-27T22:39:42.932+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:39:42.990578082Z [2024-06-27T22:39:42.990+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-06-27T22:39:42.990595615Z 2024-06-27T22:39:42.990599243Z 2024-06-27T22:39:42.990637936Z [2024-06-27T22:39:42.990+0000] {scheduler_job.py:425} INFO - DAG vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330 has 0/16 running and queued tasks 2024-06-27T22:39:42.990678256Z [2024-06-27T22:39:42.990+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 has 0/16 running and queued tasks 2024-06-27T22:39:42.991213962Z [2024-06-27T22:39:42.990+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:39:42.991240984Z 2024-06-27T22:39:42.991244332Z 2024-06-27T22:39:42.994005237Z [2024-06-27T22:39:42.993+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:39:42.994029975Z [2024-06-27T22:39:42.993+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:39:42.994514865Z [2024-06-27T22:39:42.994+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:39:42.994632924Z [2024-06-27T22:39:42.994+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:39:43.171667943Z [2024-06-27T22:39:43.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:38:00+00:00 exited with status queued for try_number 1 2024-06-27T22:39:43.171801374Z [2024-06-27T22:39:43.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:38:00+00:00 exited with status queued for try_number 1 2024-06-27T22:39:43.171946406Z [2024-06-27T22:39:43.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.send_prometheus run_id=scheduled__2024-06-27T22:30:00+00:00 exited with status success for try_number 1 2024-06-27T22:39:43.178271567Z [2024-06-27T22:39:43.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=send_prometheus, run_id=scheduled__2024-06-27T22:30:00+00:00, map_index=-1, run_start_date=2024-06-27 22:39:41.208785+00:00, run_end_date=2024-06-27 22:39:41.702506+00:00, run_duration=0.493721, state=success, executor_state=success, try_number=1, max_tries=1, job_id=21, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:39:39.231137+00:00, queued_by_job_id=2, pid=322 2024-06-27T22:39:43.178546399Z [2024-06-27T22:39:43.178+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05903c2e-18f7-464d-a488-bf964ff2b789 2024-06-27T22:39:43.178758234Z [2024-06-27T22:39:43.178+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5afd3f82-67da-4a69-988d-04215c098adb 2024-06-27T22:39:46.151344806Z [2024-06-27T22:39:46.150+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:39:46.151862576Z [2024-06-27T22:39:46.151+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330, execution_date=2024-06-27 22:38:00+00:00, run_id=scheduled__2024-06-27T22:38:00+00:00, run_start_date=2024-06-27 22:39:42.941351+00:00, run_end_date=2024-06-27 22:39:46.151508+00:00, run_duration=3.210157, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:38:00+00:00, data_interval_end=2024-06-27 22:39:00+00:00, dag_hash=400cf984b99fd630c9e9a30d6f009174 2024-06-27T22:39:46.160272881Z [2024-06-27T22:39:46.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330 to 2024-06-27T22:39:00+00:00, run_after=2024-06-27T22:40:00+00:00 2024-06-27T22:39:46.199900469Z [2024-06-27T22:39:46.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:38:00+00:00 exited with status success for try_number 1 2024-06-27T22:39:46.209765970Z [2024-06-27T22:39:46.209+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:38:00+00:00, map_index=-1, run_start_date=2024-06-27 22:39:44.719559+00:00, run_end_date=2024-06-27 22:39:45.943997+00:00, run_duration=1.224438, state=success, executor_state=success, try_number=1, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:39:42.991620+00:00, queued_by_job_id=2, pid=337 2024-06-27T22:39:46.928265728Z [2024-06-27T22:39:46.927+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:39:46.928584256Z [2024-06-27T22:39:46.928+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, execution_date=2024-06-27 22:38:00+00:00, run_id=scheduled__2024-06-27T22:38:00+00:00, run_start_date=2024-06-27 22:39:42.941951+00:00, run_end_date=2024-06-27 22:39:46.928053+00:00, run_duration=3.986102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:38:00+00:00, data_interval_end=2024-06-27 22:39:00+00:00, dag_hash=81b0889a17bbaf37ac4d1e8ad4de8e82 2024-06-27T22:39:46.938372726Z [2024-06-27T22:39:46.937+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 to 2024-06-27T22:39:00+00:00, run_after=2024-06-27T22:40:00+00:00 2024-06-27T22:39:46.966517577Z [2024-06-27T22:39:46.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:38:00+00:00 exited with status success for try_number 1 2024-06-27T22:39:46.970795521Z [2024-06-27T22:39:46.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:38:00+00:00, map_index=-1, run_start_date=2024-06-27 22:39:44.869898+00:00, run_end_date=2024-06-27 22:39:46.436451+00:00, run_duration=1.566553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=23, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:39:42.991620+00:00, queued_by_job_id=2, pid=338 2024-06-27T22:40:00.385226350Z [2024-06-27T22:40:00.384+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:40:00+00:00, run_after=2024-06-27T22:41:00+00:00 2024-06-27T22:40:00.393587143Z [2024-06-27T22:40:00.393+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:40:00.402340677Z [2024-06-27T22:40:00.401+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:40:00.410840458Z [2024-06-27T22:40:00.410+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:40:00.427804056Z [2024-06-27T22:40:00.427+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:40:00+00:00, run_after=2024-06-27T22:41:00+00:00 2024-06-27T22:40:00.444238402Z [2024-06-27T22:40:00.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330 to 2024-06-27T22:40:00+00:00, run_after=2024-06-27T22:41:00+00:00 2024-06-27T22:40:00.457741702Z [2024-06-27T22:40:00.457+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 to 2024-06-27T22:40:00+00:00, run_after=2024-06-27T22:45:00+00:00 2024-06-27T22:40:00.470662781Z [2024-06-27T22:40:00.470+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:40:00+00:00, run_after=2024-06-27T22:45:00+00:00 2024-06-27T22:40:00.596539379Z [2024-06-27T22:40:00.596+0000] {scheduler_job.py:360} INFO - 8 tasks up for execution: 2024-06-27T22:40:00.596561982Z 2024-06-27T22:40:00.596569058Z 2024-06-27T22:40:00.596572514Z 2024-06-27T22:40:00.596576536Z 2024-06-27T22:40:00.596580813Z 2024-06-27T22:40:00.596585683Z 2024-06-27T22:40:00.596591797Z 2024-06-27T22:40:00.596597844Z 2024-06-27T22:40:00.596610726Z [2024-06-27T22:40:00.596+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 has 0/16 running and queued tasks 2024-06-27T22:40:00.596644648Z [2024-06-27T22:40:00.596+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:40:00.596730846Z [2024-06-27T22:40:00.596+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T22:40:00.596833550Z [2024-06-27T22:40:00.596+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:40:00.596870949Z [2024-06-27T22:40:00.596+0000] {scheduler_job.py:425} INFO - DAG vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330 has 0/16 running and queued tasks 2024-06-27T22:40:00.596979464Z [2024-06-27T22:40:00.596+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:40:00.597022450Z [2024-06-27T22:40:00.596+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:40:00.597104672Z [2024-06-27T22:40:00.597+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 has 0/16 running and queued tasks 2024-06-27T22:40:00.597648829Z [2024-06-27T22:40:00.597+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:40:00.597657315Z 2024-06-27T22:40:00.597662422Z 2024-06-27T22:40:00.597668981Z 2024-06-27T22:40:00.597676141Z 2024-06-27T22:40:00.597682583Z 2024-06-27T22:40:00.597688949Z 2024-06-27T22:40:00.597694412Z 2024-06-27T22:40:00.597700579Z 2024-06-27T22:40:00.604096516Z [2024-06-27T22:40:00.603+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T22:40:00.604195769Z [2024-06-27T22:40:00.604+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:40:00.604384969Z [2024-06-27T22:40:00.604+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T22:40:00.604465980Z [2024-06-27T22:40:00.604+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:40:00.604626620Z [2024-06-27T22:40:00.604+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:40:00.604696946Z [2024-06-27T22:40:00.604+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T22:40:00.604872443Z [2024-06-27T22:40:00.604+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:40:00.604930662Z [2024-06-27T22:40:00.604+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:40:00.605113744Z [2024-06-27T22:40:00.604+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:40:00.605130715Z [2024-06-27T22:40:00.605+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:40:00.605304359Z [2024-06-27T22:40:00.605+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:40:00.605366197Z [2024-06-27T22:40:00.605+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:40:00.605509962Z [2024-06-27T22:40:00.605+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:40:00.605569703Z [2024-06-27T22:40:00.605+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:40:00.605718092Z [2024-06-27T22:40:00.605+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:40:00.605776456Z [2024-06-27T22:40:00.605+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:40:01.302055645Z [2024-06-27T22:40:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:01.302218831Z [2024-06-27T22:40:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:01.302392641Z [2024-06-27T22:40:01.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:38:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:01.302543715Z [2024-06-27T22:40:01.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:39:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:01.302676190Z [2024-06-27T22:40:01.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:39:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:01.303016839Z [2024-06-27T22:40:01.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:39:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:01.303520459Z [2024-06-27T22:40:01.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:39:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:01.303685273Z [2024-06-27T22:40:01.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:39:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:01.327257066Z [2024-06-27T22:40:01.326+0000] {scheduler_job.py:635} INFO - Setting external_id for to 468e205d-f5da-4266-ae15-0f5045f31763 2024-06-27T22:40:01.327531939Z [2024-06-27T22:40:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8f1d08a-a13c-473a-945f-469b0a3aa822 2024-06-27T22:40:01.327826371Z [2024-06-27T22:40:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to c213d771-7a3d-46d7-8c9d-a01d316b77fb 2024-06-27T22:40:01.328210663Z [2024-06-27T22:40:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9ba7fa9-e7cc-450c-9c9b-b8498943a455 2024-06-27T22:40:01.329315346Z [2024-06-27T22:40:01.329+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4dd3dd95-2832-409b-add9-96c5fe471d12 2024-06-27T22:40:01.329541273Z [2024-06-27T22:40:01.329+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d1a91d2-2a2a-4696-b2ff-c025b821e0bf 2024-06-27T22:40:01.329724994Z [2024-06-27T22:40:01.329+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a03c4e3-2a8b-4f73-bf52-d7f7e5735ccd 2024-06-27T22:40:01.329928250Z [2024-06-27T22:40:01.329+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1975dd07-35fa-400b-b490-088bb413dc6c 2024-06-27T22:40:03.646570047Z [2024-06-27T22:40:03.646+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:40:03.648830413Z [2024-06-27T22:40:03.648+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:39:00+00:00, run_id=scheduled__2024-06-27T22:39:00+00:00, run_start_date=2024-06-27 22:40:00.498321+00:00, run_end_date=2024-06-27 22:40:03.646493+00:00, run_duration=3.148172, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:39:00+00:00, data_interval_end=2024-06-27 22:40:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:40:03.666835656Z [2024-06-27T22:40:03.666+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:40:00+00:00, run_after=2024-06-27T22:41:00+00:00 2024-06-27T22:40:05.187674736Z [2024-06-27T22:40:05.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:38:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:05.188403534Z [2024-06-27T22:40:05.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:39:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:05.212472792Z [2024-06-27T22:40:05.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:39:00+00:00, map_index=-1, run_start_date=2024-06-27 22:40:02.494593+00:00, run_end_date=2024-06-27 22:40:03.315104+00:00, run_duration=0.820511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=24, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:00.599049+00:00, queued_by_job_id=2, pid=362 2024-06-27T22:40:05.212806003Z [2024-06-27T22:40:05.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T22:38:00+00:00, map_index=-1, run_start_date=2024-06-27 22:40:03.766135+00:00, run_end_date=2024-06-27 22:40:04.966596+00:00, run_duration=1.200461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=25, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:00.599049+00:00, queued_by_job_id=2, pid=372 2024-06-27T22:40:06.360677411Z [2024-06-27T22:40:06.359+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:40:06.361117050Z [2024-06-27T22:40:06.360+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 22:38:00+00:00, run_id=scheduled__2024-06-27T22:38:00+00:00, run_start_date=2024-06-27 22:40:00.491033+00:00, run_end_date=2024-06-27 22:40:06.360771+00:00, run_duration=5.869738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:38:00+00:00, data_interval_end=2024-06-27 22:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T22:40:06.392648919Z [2024-06-27T22:40:06.392+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T22:40:00+00:00, run_after=2024-06-27T22:42:00+00:00 2024-06-27T22:40:07.450126768Z [2024-06-27T22:40:07.449+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:40:07.450137800Z 2024-06-27T22:40:07.450276697Z [2024-06-27T22:40:07.450+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:40:07.451239104Z [2024-06-27T22:40:07.451+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:40:07.451249865Z 2024-06-27T22:40:07.453576807Z [2024-06-27T22:40:07.453+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-27T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T22:40:07.453680208Z [2024-06-27T22:40:07.453+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-27T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:40:07.552585414Z [2024-06-27T22:40:07.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:07.552760922Z [2024-06-27T22:40:07.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:07.557497729Z [2024-06-27T22:40:07.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00677fb6-caaa-40b8-bd9d-6560441d0eb6 2024-06-27T22:40:07.557741332Z [2024-06-27T22:40:07.557+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T22:35:00+00:00, map_index=-1, run_start_date=2024-06-27 22:40:05.971320+00:00, run_end_date=2024-06-27 22:40:06.899283+00:00, run_duration=0.927963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=27, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:00.599049+00:00, queued_by_job_id=2, pid=401 2024-06-27T22:40:09.111258586Z [2024-06-27T22:40:09.110+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:40:09.111566275Z [2024-06-27T22:40:09.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:39:00+00:00, run_id=scheduled__2024-06-27T22:39:00+00:00, run_start_date=2024-06-27 22:40:00.499731+00:00, run_end_date=2024-06-27 22:40:09.111161+00:00, run_duration=8.61143, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:39:00+00:00, data_interval_end=2024-06-27 22:40:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:40:09.120736147Z [2024-06-27T22:40:09.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:40:00+00:00, run_after=2024-06-27T22:41:00+00:00 2024-06-27T22:40:09.148800088Z [2024-06-27T22:40:09.148+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:40:09.149480478Z [2024-06-27T22:40:09.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, execution_date=2024-06-27 22:39:00+00:00, run_id=scheduled__2024-06-27T22:39:00+00:00, run_start_date=2024-06-27 22:40:00.501113+00:00, run_end_date=2024-06-27 22:40:09.149026+00:00, run_duration=8.647913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:39:00+00:00, data_interval_end=2024-06-27 22:40:00+00:00, dag_hash=81b0889a17bbaf37ac4d1e8ad4de8e82 2024-06-27T22:40:09.176985466Z [2024-06-27T22:40:09.176+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 to 2024-06-27T22:40:00+00:00, run_after=2024-06-27T22:41:00+00:00 2024-06-27T22:40:09.195039369Z [2024-06-27T22:40:09.191+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:40:09.195635135Z [2024-06-27T22:40:09.195+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:39:00+00:00, run_id=scheduled__2024-06-27T22:39:00+00:00, run_start_date=2024-06-27 22:40:00.495431+00:00, run_end_date=2024-06-27 22:40:09.195074+00:00, run_duration=8.699643, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:39:00+00:00, data_interval_end=2024-06-27 22:40:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:40:09.212855403Z [2024-06-27T22:40:09.212+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:40:00+00:00, run_after=2024-06-27T22:41:00+00:00 2024-06-27T22:40:09.273402052Z [2024-06-27T22:40:09.272+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:40:09.273422450Z 2024-06-27T22:40:09.273502918Z [2024-06-27T22:40:09.273+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 has 0/16 running and queued tasks 2024-06-27T22:40:09.274095118Z [2024-06-27T22:40:09.273+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:40:09.274142587Z 2024-06-27T22:40:09.277171589Z [2024-06-27T22:40:09.276+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', task_id='split_metrics', run_id='scheduled__2024-06-27T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T22:40:09.277255297Z [2024-06-27T22:40:09.277+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', 'split_metrics', 'scheduled__2024-06-27T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:40:09.339571841Z [2024-06-27T22:40:09.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.split_metrics run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:09.339607188Z [2024-06-27T22:40:09.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:09.339611035Z [2024-06-27T22:40:09.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:39:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:09.339614014Z [2024-06-27T22:40:09.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:39:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:09.339616885Z [2024-06-27T22:40:09.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:39:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:09.351479900Z [2024-06-27T22:40:09.350+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:39:00+00:00, map_index=-1, run_start_date=2024-06-27 22:40:05.108404+00:00, run_end_date=2024-06-27 22:40:07.790832+00:00, run_duration=2.682428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=26, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:00.599049+00:00, queued_by_job_id=2, pid=389 2024-06-27T22:40:09.351516796Z [2024-06-27T22:40:09.350+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:39:00+00:00, map_index=-1, run_start_date=2024-06-27 22:40:06.215350+00:00, run_end_date=2024-06-27 22:40:08.565254+00:00, run_duration=2.349904, state=success, executor_state=success, try_number=1, max_tries=1, job_id=28, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:00.599049+00:00, queued_by_job_id=2, pid=404 2024-06-27T22:40:09.351524316Z [2024-06-27T22:40:09.350+0000] {scheduler_job.py:635} INFO - Setting external_id for to abd4de03-bc5e-449c-ae30-117c8ea770d5 2024-06-27T22:40:09.351527705Z [2024-06-27T22:40:09.351+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T22:35:00+00:00, map_index=-1, run_start_date=2024-06-27 22:40:06.858733+00:00, run_end_date=2024-06-27 22:40:07.713292+00:00, run_duration=0.854559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=30, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:00.599049+00:00, queued_by_job_id=2, pid=419 2024-06-27T22:40:09.353409456Z [2024-06-27T22:40:09.351+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:39:00+00:00, map_index=-1, run_start_date=2024-06-27 22:40:06.625367+00:00, run_end_date=2024-06-27 22:40:08.176357+00:00, run_duration=1.55099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=29, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:00.599049+00:00, queued_by_job_id=2, pid=413 2024-06-27T22:40:10.574599200Z [2024-06-27T22:40:10.574+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:40:10.575089862Z [2024-06-27T22:40:10.574+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330, execution_date=2024-06-27 22:39:00+00:00, run_id=scheduled__2024-06-27T22:39:00+00:00, run_start_date=2024-06-27 22:40:00.496943+00:00, run_end_date=2024-06-27 22:40:10.574708+00:00, run_duration=10.077765, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:39:00+00:00, data_interval_end=2024-06-27 22:40:00+00:00, dag_hash=400cf984b99fd630c9e9a30d6f009174 2024-06-27T22:40:10.586215458Z [2024-06-27T22:40:10.585+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330 to 2024-06-27T22:40:00+00:00, run_after=2024-06-27T22:41:00+00:00 2024-06-27T22:40:10.631074890Z [2024-06-27T22:40:10.630+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:40:10.631126367Z 2024-06-27T22:40:10.631261055Z [2024-06-27T22:40:10.631+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:40:10.632250867Z [2024-06-27T22:40:10.631+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:40:10.632300061Z 2024-06-27T22:40:10.635975479Z [2024-06-27T22:40:10.635+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-27T22:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T22:40:10.636352576Z [2024-06-27T22:40:10.635+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-27T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T22:40:10.681751092Z [2024-06-27T22:40:10.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:10.681847781Z [2024-06-27T22:40:10.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:39:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:10.682151774Z [2024-06-27T22:40:10.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:10.688536467Z [2024-06-27T22:40:10.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:39:00+00:00, map_index=-1, run_start_date=2024-06-27 22:40:07.749977+00:00, run_end_date=2024-06-27 22:40:09.463314+00:00, run_duration=1.713337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=31, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:00.599049+00:00, queued_by_job_id=2, pid=441 2024-06-27T22:40:10.688766025Z [2024-06-27T22:40:10.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44d47c46-423b-473c-89f4-f0f02ae4ec11 2024-06-27T22:40:10.688963783Z [2024-06-27T22:40:10.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-27T22:35:00+00:00, map_index=-1, run_start_date=2024-06-27 22:40:09.768652+00:00, run_end_date=2024-06-27 22:40:10.127902+00:00, run_duration=0.35925, state=success, executor_state=success, try_number=1, max_tries=1, job_id=32, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:07.451556+00:00, queued_by_job_id=2, pid=454 2024-06-27T22:40:11.878833222Z [2024-06-27T22:40:11.878+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:40:11.878851232Z 2024-06-27T22:40:11.878897242Z [2024-06-27T22:40:11.878+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 has 0/16 running and queued tasks 2024-06-27T22:40:11.879483178Z [2024-06-27T22:40:11.879+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:40:11.879494239Z 2024-06-27T22:40:11.881712588Z [2024-06-27T22:40:11.881+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', task_id='collect_metrics', run_id='scheduled__2024-06-27T22:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T22:40:11.881801898Z [2024-06-27T22:40:11.881+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', 'collect_metrics', 'scheduled__2024-06-27T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T22:40:11.948348419Z [2024-06-27T22:40:11.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.collect_metrics run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:11.951637862Z [2024-06-27T22:40:11.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.split_metrics run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:11.978043788Z [2024-06-27T22:40:11.977+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=split_metrics, run_id=scheduled__2024-06-27T22:35:00+00:00, map_index=-1, run_start_date=2024-06-27 22:40:11.321432+00:00, run_end_date=2024-06-27 22:40:11.670632+00:00, run_duration=0.3492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=33, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:09.274430+00:00, queued_by_job_id=2, pid=462 2024-06-27T22:40:11.978192301Z [2024-06-27T22:40:11.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1569a3e3-3ad7-49d6-9207-718be1c2a8ff 2024-06-27T22:40:14.208131407Z [2024-06-27T22:40:14.207+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:40:14.208166652Z 2024-06-27T22:40:14.208188895Z [2024-06-27T22:40:14.208+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:40:14.208640634Z [2024-06-27T22:40:14.208+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:40:14.208654744Z 2024-06-27T22:40:14.210654847Z [2024-06-27T22:40:14.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-27T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:40:14.210765781Z [2024-06-27T22:40:14.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-27T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:40:14.298499848Z [2024-06-27T22:40:14.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:14.298519444Z [2024-06-27T22:40:14.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:14.309991160Z [2024-06-27T22:40:14.309+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99cca94d-1b58-4d61-9010-92b41dccba95 2024-06-27T22:40:14.310118409Z [2024-06-27T22:40:14.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-27T22:35:00+00:00, map_index=0, run_start_date=2024-06-27 22:40:12.482865+00:00, run_end_date=2024-06-27 22:40:13.180229+00:00, run_duration=0.697364, state=success, executor_state=success, try_number=1, max_tries=1, job_id=34, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:10.633188+00:00, queued_by_job_id=2, pid=470 2024-06-27T22:40:15.559109195Z [2024-06-27T22:40:15.555+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:40:15.559126676Z 2024-06-27T22:40:15.559130673Z [2024-06-27T22:40:15.556+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 has 0/16 running and queued tasks 2024-06-27T22:40:15.559134495Z [2024-06-27T22:40:15.556+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:40:15.559137578Z 2024-06-27T22:40:15.559141255Z [2024-06-27T22:40:15.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', task_id='send_prometheus', run_id='scheduled__2024-06-27T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:40:15.559157601Z [2024-06-27T22:40:15.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', 'send_prometheus', 'scheduled__2024-06-27T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:40:15.618974634Z [2024-06-27T22:40:15.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.send_prometheus run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:15.619059013Z [2024-06-27T22:40:15.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.collect_metrics run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:15.634204722Z [2024-06-27T22:40:15.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fdff874-35be-4950-84f2-1736768507f0 2024-06-27T22:40:15.634372720Z [2024-06-27T22:40:15.634+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=collect_metrics, run_id=scheduled__2024-06-27T22:35:00+00:00, map_index=0, run_start_date=2024-06-27 22:40:14.126407+00:00, run_end_date=2024-06-27 22:40:14.547542+00:00, run_duration=0.421135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=35, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:11.879765+00:00, queued_by_job_id=2, pid=477 2024-06-27T22:40:17.515939514Z [2024-06-27T22:40:17.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:40:17.516396734Z [2024-06-27T22:40:17.516+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:35:00+00:00, run_id=scheduled__2024-06-27T22:35:00+00:00, run_start_date=2024-06-27 22:40:00.489042+00:00, run_end_date=2024-06-27 22:40:17.515919+00:00, run_duration=17.026877, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:35:00+00:00, data_interval_end=2024-06-27 22:40:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-27T22:40:17.521973919Z [2024-06-27T22:40:17.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:40:00+00:00, run_after=2024-06-27T22:45:00+00:00 2024-06-27T22:40:17.565483030Z [2024-06-27T22:40:17.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:17.565505112Z [2024-06-27T22:40:17.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.send_prometheus run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status failed for try_number 1 2024-06-27T22:40:17.570765563Z [2024-06-27T22:40:17.570+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=send_prometheus, run_id=scheduled__2024-06-27T22:35:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:15.556921+00:00, queued_by_job_id=2, pid=None 2024-06-27T22:40:17.571097834Z [2024-06-27T22:40:17.570+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:40:17.573115954Z [2024-06-27T22:40:17.572+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:40:17.597799061Z [2024-06-27T22:40:17.597+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=send_prometheus, execution_date=20240627T223500, start_date=, end_date=20240627T224017 2024-06-27T22:40:17.617160131Z [2024-06-27T22:40:17.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-27T22:35:00+00:00, map_index=-1, run_start_date=2024-06-27 22:40:16.238514+00:00, run_end_date=2024-06-27 22:40:16.663114+00:00, run_duration=0.4246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=36, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:14.208857+00:00, queued_by_job_id=2, pid=486 2024-06-27T22:40:27.818414206Z [2024-06-27T22:40:27.818+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:40:27.818440784Z 2024-06-27T22:40:27.818554290Z [2024-06-27T22:40:27.818+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 has 0/16 running and queued tasks 2024-06-27T22:40:27.819145349Z [2024-06-27T22:40:27.818+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:40:27.819158792Z 2024-06-27T22:40:27.821230221Z [2024-06-27T22:40:27.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', task_id='send_prometheus', run_id='scheduled__2024-06-27T22:35:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:40:27.821384866Z [2024-06-27T22:40:27.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', 'send_prometheus', 'scheduled__2024-06-27T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:40:27.886017387Z [2024-06-27T22:40:27.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.send_prometheus run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status queued for try_number 2 2024-06-27T22:40:27.907383777Z [2024-06-27T22:40:27.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to afeba842-dd5b-46e6-9ca3-35f88e4c7ffe 2024-06-27T22:40:29.447325868Z [2024-06-27T22:40:29.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.send_prometheus run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status failed for try_number 2 2024-06-27T22:40:29.452423667Z [2024-06-27T22:40:29.452+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=send_prometheus, run_id=scheduled__2024-06-27T22:35:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-06-27 22:40:17.577294+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:27.819451+00:00, queued_by_job_id=2, pid=None 2024-06-27T22:40:29.453511446Z [2024-06-27T22:40:29.453+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:40:29.455835263Z [2024-06-27T22:40:29.455+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:40:29.465805524Z [2024-06-27T22:40:29.465+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=send_prometheus, execution_date=20240627T223500, start_date=, end_date=20240627T224029 2024-06-27T22:40:30.517380545Z [2024-06-27T22:40:30.516+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-27T22:40:30.517567303Z [2024-06-27T22:40:30.517+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, execution_date=2024-06-27 22:35:00+00:00, run_id=scheduled__2024-06-27T22:35:00+00:00, run_start_date=2024-06-27 22:40:00.486815+00:00, run_end_date=2024-06-27 22:40:30.517244+00:00, run_duration=30.030429, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:35:00+00:00, data_interval_end=2024-06-27 22:40:00+00:00, dag_hash=ba2b06ba6387d485fc9c514c8433d0b6 2024-06-27T22:40:30.526649837Z [2024-06-27T22:40:30.526+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 to 2024-06-27T22:40:00+00:00, run_after=2024-06-27T22:45:00+00:00 2024-06-27T22:40:36.625706963Z [2024-06-27T22:40:36.625+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a to 2024-06-27T22:40:00+00:00, run_after=2024-06-27T22:45:00+00:00 2024-06-27T22:40:36.674864735Z [2024-06-27T22:40:36.674+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:40:36.674890407Z 2024-06-27T22:40:36.674939830Z [2024-06-27T22:40:36.674+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a has 0/16 running and queued tasks 2024-06-27T22:40:36.675512339Z [2024-06-27T22:40:36.675+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:40:36.675518977Z 2024-06-27T22:40:36.677394622Z [2024-06-27T22:40:36.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T22:40:36.677585185Z [2024-06-27T22:40:36.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:40:36.737001381Z [2024-06-27T22:40:36.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:36.741969135Z [2024-06-27T22:40:36.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 454eee48-9bdb-47ff-8249-699751b20aa7 2024-06-27T22:40:39.576877999Z [2024-06-27T22:40:39.576+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:40:39.576894552Z 2024-06-27T22:40:39.577091178Z [2024-06-27T22:40:39.576+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a has 0/16 running and queued tasks 2024-06-27T22:40:39.577639651Z [2024-06-27T22:40:39.577+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:40:39.577648282Z 2024-06-27T22:40:39.579626268Z [2024-06-27T22:40:39.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a', task_id='split_metrics', run_id='scheduled__2024-06-27T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T22:40:39.579759135Z [2024-06-27T22:40:39.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a', 'split_metrics', 'scheduled__2024-06-27T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:40:39.642759070Z [2024-06-27T22:40:39.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a.split_metrics run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:39.642873808Z [2024-06-27T22:40:39.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:39.650953578Z [2024-06-27T22:40:39.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T22:35:00+00:00, map_index=-1, run_start_date=2024-06-27 22:40:38.319923+00:00, run_end_date=2024-06-27 22:40:38.732193+00:00, run_duration=0.41227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=37, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:36.675819+00:00, queued_by_job_id=2, pid=529 2024-06-27T22:40:39.651143705Z [2024-06-27T22:40:39.650+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3cbd83d-76a1-4a8e-930d-12c31426b3e7 2024-06-27T22:40:41.888233132Z [2024-06-27T22:40:41.887+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:40:41.888253896Z 2024-06-27T22:40:41.888292421Z [2024-06-27T22:40:41.888+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a has 0/16 running and queued tasks 2024-06-27T22:40:41.888745230Z [2024-06-27T22:40:41.888+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:40:41.888757210Z 2024-06-27T22:40:41.890717710Z [2024-06-27T22:40:41.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a', task_id='collect_metrics', run_id='scheduled__2024-06-27T22:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T22:40:41.890851355Z [2024-06-27T22:40:41.890+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a', 'collect_metrics', 'scheduled__2024-06-27T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T22:40:41.947755962Z [2024-06-27T22:40:41.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a.collect_metrics run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:41.947948755Z [2024-06-27T22:40:41.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a.split_metrics run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:41.955930691Z [2024-06-27T22:40:41.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a, task_id=split_metrics, run_id=scheduled__2024-06-27T22:35:00+00:00, map_index=-1, run_start_date=2024-06-27 22:40:41.295692+00:00, run_end_date=2024-06-27 22:40:41.652192+00:00, run_duration=0.3565, state=success, executor_state=success, try_number=1, max_tries=1, job_id=38, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:39.577961+00:00, queued_by_job_id=2, pid=542 2024-06-27T22:40:41.956076389Z [2024-06-27T22:40:41.955+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6bf5c55e-831a-4c6f-bb88-438e6a9a6892 2024-06-27T22:40:44.452095958Z [2024-06-27T22:40:44.451+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:40:44.452175081Z 2024-06-27T22:40:44.452386549Z [2024-06-27T22:40:44.452+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a has 0/16 running and queued tasks 2024-06-27T22:40:44.453535685Z [2024-06-27T22:40:44.453+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:40:44.453575964Z 2024-06-27T22:40:44.456955100Z [2024-06-27T22:40:44.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a', task_id='send_prometheus', run_id='scheduled__2024-06-27T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:40:44.457186426Z [2024-06-27T22:40:44.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a', 'send_prometheus', 'scheduled__2024-06-27T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:40:44.522095310Z [2024-06-27T22:40:44.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a.send_prometheus run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:44.522538589Z [2024-06-27T22:40:44.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a.collect_metrics run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:44.529450595Z [2024-06-27T22:40:44.529+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a, task_id=collect_metrics, run_id=scheduled__2024-06-27T22:35:00+00:00, map_index=0, run_start_date=2024-06-27 22:40:43.629460+00:00, run_end_date=2024-06-27 22:40:44.005721+00:00, run_duration=0.376261, state=success, executor_state=success, try_number=1, max_tries=1, job_id=39, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:41.888974+00:00, queued_by_job_id=2, pid=550 2024-06-27T22:40:44.529775318Z [2024-06-27T22:40:44.529+0000] {scheduler_job.py:635} INFO - Setting external_id for to b60b4aab-baf8-4e43-936e-7c2e952fb793 2024-06-27T22:40:47.651072806Z [2024-06-27T22:40:47.650+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a to 2024-06-27T22:40:00+00:00, run_after=2024-06-27T22:41:00+00:00 2024-06-27T22:40:47.661968209Z [2024-06-27T22:40:47.661+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:40:47.701682169Z [2024-06-27T22:40:47.701+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:40:47.716099219Z [2024-06-27T22:40:47.712+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a, execution_date=2024-06-27 22:35:00+00:00, run_id=scheduled__2024-06-27T22:35:00+00:00, run_start_date=2024-06-27 22:40:36.641938+00:00, run_end_date=2024-06-27 22:40:47.701443+00:00, run_duration=11.059505, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:35:00+00:00, data_interval_end=2024-06-27 22:40:00+00:00, dag_hash=efdbe2c383b723593bb8b9f4046aa514 2024-06-27T22:40:47.730031890Z [2024-06-27T22:40:47.729+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a to 2024-06-27T22:40:00+00:00, run_after=2024-06-27T22:45:00+00:00 2024-06-27T22:40:47.743273245Z [2024-06-27T22:40:47.743+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-06-27T22:40:47.743296768Z 2024-06-27T22:40:47.743331778Z 2024-06-27T22:40:47.743393208Z [2024-06-27T22:40:47.743+0000] {scheduler_job.py:425} INFO - DAG vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a has 0/16 running and queued tasks 2024-06-27T22:40:47.743519383Z [2024-06-27T22:40:47.743+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a has 0/16 running and queued tasks 2024-06-27T22:40:47.744031974Z [2024-06-27T22:40:47.743+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:40:47.744045340Z 2024-06-27T22:40:47.744051808Z 2024-06-27T22:40:47.746161310Z [2024-06-27T22:40:47.745+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:40:47.746304916Z [2024-06-27T22:40:47.746+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:40:47.746511407Z [2024-06-27T22:40:47.746+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:40:47.746663043Z [2024-06-27T22:40:47.746+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:40:48.020401003Z [2024-06-27T22:40:48.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:39:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:48.020565271Z [2024-06-27T22:40:48.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:39:00+00:00 exited with status queued for try_number 1 2024-06-27T22:40:48.020702326Z [2024-06-27T22:40:48.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a.send_prometheus run_id=scheduled__2024-06-27T22:35:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:48.032206498Z [2024-06-27T22:40:48.031+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a, task_id=send_prometheus, run_id=scheduled__2024-06-27T22:35:00+00:00, map_index=-1, run_start_date=2024-06-27 22:40:46.280335+00:00, run_end_date=2024-06-27 22:40:46.709597+00:00, run_duration=0.429262, state=success, executor_state=success, try_number=1, max_tries=1, job_id=40, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:44.454105+00:00, queued_by_job_id=2, pid=558 2024-06-27T22:40:48.032439755Z [2024-06-27T22:40:48.032+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc24c7d3-6ec3-4b87-b7f3-5560adbbb2e5 2024-06-27T22:40:48.032593819Z [2024-06-27T22:40:48.032+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d6ff67e-9088-422a-9508-081cf73b4a28 2024-06-27T22:40:50.886221730Z [2024-06-27T22:40:50.884+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:40:50.886636065Z [2024-06-27T22:40:50.886+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a, execution_date=2024-06-27 22:39:00+00:00, run_id=scheduled__2024-06-27T22:39:00+00:00, run_start_date=2024-06-27 22:40:47.673939+00:00, run_end_date=2024-06-27 22:40:50.886128+00:00, run_duration=3.212189, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:39:00+00:00, data_interval_end=2024-06-27 22:40:00+00:00, dag_hash=80be94bcaceb4a5c86da449fcb32487d 2024-06-27T22:40:50.906924808Z [2024-06-27T22:40:50.906+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a to 2024-06-27T22:40:00+00:00, run_after=2024-06-27T22:41:00+00:00 2024-06-27T22:40:52.020746424Z [2024-06-27T22:40:52.020+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:40:52.021162066Z [2024-06-27T22:40:52.020+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a, execution_date=2024-06-27 22:39:00+00:00, run_id=scheduled__2024-06-27T22:39:00+00:00, run_start_date=2024-06-27 22:40:47.674588+00:00, run_end_date=2024-06-27 22:40:52.020838+00:00, run_duration=4.34625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:39:00+00:00, data_interval_end=2024-06-27 22:40:00+00:00, dag_hash=c85c93c7a1b669007bc16f6fdfd01da0 2024-06-27T22:40:52.030709865Z [2024-06-27T22:40:52.030+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a to 2024-06-27T22:40:00+00:00, run_after=2024-06-27T22:41:00+00:00 2024-06-27T22:40:52.056787714Z [2024-06-27T22:40:52.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:39:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:52.057020527Z [2024-06-27T22:40:52.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:39:00+00:00 exited with status success for try_number 1 2024-06-27T22:40:52.062235981Z [2024-06-27T22:40:52.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:39:00+00:00, map_index=-1, run_start_date=2024-06-27 22:40:49.613699+00:00, run_end_date=2024-06-27 22:40:50.863577+00:00, run_duration=1.249878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=42, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:47.744532+00:00, queued_by_job_id=2, pid=574 2024-06-27T22:40:52.062611822Z [2024-06-27T22:40:52.062+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:39:00+00:00, map_index=-1, run_start_date=2024-06-27 22:40:49.525358+00:00, run_end_date=2024-06-27 22:40:51.077030+00:00, run_duration=1.551672, state=success, executor_state=success, try_number=1, max_tries=1, job_id=41, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:40:47.744532+00:00, queued_by_job_id=2, pid=573 2024-06-27T22:41:00.979310578Z [2024-06-27T22:41:00.978+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330 to 2024-06-27T22:41:00+00:00, run_after=2024-06-27T22:42:00+00:00 2024-06-27T22:41:00.986561295Z [2024-06-27T22:41:00.986+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:41:00.993818125Z [2024-06-27T22:41:00.993+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:41:01.018866334Z [2024-06-27T22:41:01.018+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a to 2024-06-27T22:41:00+00:00, run_after=2024-06-27T22:42:00+00:00 2024-06-27T22:41:01.027646092Z [2024-06-27T22:41:01.027+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:41:01.045932766Z [2024-06-27T22:41:01.045+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:41:00+00:00, run_after=2024-06-27T22:42:00+00:00 2024-06-27T22:41:01.059316821Z [2024-06-27T22:41:01.058+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:41:00+00:00, run_after=2024-06-27T22:42:00+00:00 2024-06-27T22:41:01.171882656Z [2024-06-27T22:41:01.171+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-06-27T22:41:01.171902855Z 2024-06-27T22:41:01.171906670Z 2024-06-27T22:41:01.171909920Z 2024-06-27T22:41:01.171912998Z 2024-06-27T22:41:01.171916048Z 2024-06-27T22:41:01.171919072Z 2024-06-27T22:41:01.171922083Z 2024-06-27T22:41:01.172083271Z [2024-06-27T22:41:01.171+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:41:01.172294782Z [2024-06-27T22:41:01.172+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a has 0/16 running and queued tasks 2024-06-27T22:41:01.172429992Z [2024-06-27T22:41:01.172+0000] {scheduler_job.py:425} INFO - DAG vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a has 0/16 running and queued tasks 2024-06-27T22:41:01.172577549Z [2024-06-27T22:41:01.172+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 has 0/16 running and queued tasks 2024-06-27T22:41:01.172716452Z [2024-06-27T22:41:01.172+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:41:01.172920989Z [2024-06-27T22:41:01.172+0000] {scheduler_job.py:425} INFO - DAG vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330 has 0/16 running and queued tasks 2024-06-27T22:41:01.173016743Z [2024-06-27T22:41:01.172+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:41:01.173686655Z [2024-06-27T22:41:01.173+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:41:01.173700291Z 2024-06-27T22:41:01.173704378Z 2024-06-27T22:41:01.173707862Z 2024-06-27T22:41:01.173711391Z 2024-06-27T22:41:01.173714897Z 2024-06-27T22:41:01.173718289Z 2024-06-27T22:41:01.173721654Z 2024-06-27T22:41:01.180308595Z [2024-06-27T22:41:01.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:41:01.180509510Z [2024-06-27T22:41:01.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:41:01.180814495Z [2024-06-27T22:41:01.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:41:01.181004624Z [2024-06-27T22:41:01.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:41:01.181309044Z [2024-06-27T22:41:01.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:41:01.181468264Z [2024-06-27T22:41:01.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:41:01.181756056Z [2024-06-27T22:41:01.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:41:01.181939677Z [2024-06-27T22:41:01.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:41:01.182230878Z [2024-06-27T22:41:01.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:41:01.182422738Z [2024-06-27T22:41:01.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:41:01.182749454Z [2024-06-27T22:41:01.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:41:01.182839204Z [2024-06-27T22:41:01.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:41:01.183072617Z [2024-06-27T22:41:01.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:41:01.183197834Z [2024-06-27T22:41:01.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:41:01.882090214Z [2024-06-27T22:41:01.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status queued for try_number 1 2024-06-27T22:41:01.882252625Z [2024-06-27T22:41:01.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status queued for try_number 1 2024-06-27T22:41:01.882358522Z [2024-06-27T22:41:01.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status queued for try_number 1 2024-06-27T22:41:01.882472375Z [2024-06-27T22:41:01.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status queued for try_number 1 2024-06-27T22:41:01.882565487Z [2024-06-27T22:41:01.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status queued for try_number 1 2024-06-27T22:41:01.882611740Z [2024-06-27T22:41:01.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status queued for try_number 1 2024-06-27T22:41:01.882734288Z [2024-06-27T22:41:01.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status queued for try_number 1 2024-06-27T22:41:01.899511824Z [2024-06-27T22:41:01.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe2ab147-abbf-4e5e-b1ef-7b63e54d6ec9 2024-06-27T22:41:01.899576787Z [2024-06-27T22:41:01.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to 093db3e6-6902-41b9-86d5-56de7f915532 2024-06-27T22:41:01.899689329Z [2024-06-27T22:41:01.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47959de1-8dbb-4559-b2dd-2252adea6d98 2024-06-27T22:41:01.900866957Z [2024-06-27T22:41:01.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98c2a9c9-1347-4cd6-b175-bf58d1e4f2f3 2024-06-27T22:41:01.900989423Z [2024-06-27T22:41:01.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to 286bc32a-4a47-4761-85e6-b7c922ef5847 2024-06-27T22:41:01.901140422Z [2024-06-27T22:41:01.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to 755d4692-2235-4e35-90c4-aaa6e910564b 2024-06-27T22:41:01.901333382Z [2024-06-27T22:41:01.901+0000] {scheduler_job.py:635} INFO - Setting external_id for to da124f48-e8a0-439b-bb9b-5c7f22e38da3 2024-06-27T22:41:03.970110201Z [2024-06-27T22:41:03.969+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:41:03.971042105Z [2024-06-27T22:41:03.970+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:40:00+00:00, run_id=scheduled__2024-06-27T22:40:00+00:00, run_start_date=2024-06-27 22:41:01.075999+00:00, run_end_date=2024-06-27 22:41:03.970027+00:00, run_duration=2.894028, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:40:00+00:00, data_interval_end=2024-06-27 22:41:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:41:03.985000981Z [2024-06-27T22:41:03.984+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:41:00+00:00, run_after=2024-06-27T22:42:00+00:00 2024-06-27T22:41:04.255523495Z [2024-06-27T22:41:04.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status success for try_number 1 2024-06-27T22:41:04.282265714Z [2024-06-27T22:41:04.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:40:00+00:00, map_index=-1, run_start_date=2024-06-27 22:41:02.704692+00:00, run_end_date=2024-06-27 22:41:03.385387+00:00, run_duration=0.680695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=43, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:41:01.175473+00:00, queued_by_job_id=2, pid=597 2024-06-27T22:41:05.689780118Z [2024-06-27T22:41:05.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status failed for try_number 1 2024-06-27T22:41:05.690409388Z [2024-06-27T22:41:05.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status failed for try_number 1 2024-06-27T22:41:05.732566607Z [2024-06-27T22:41:05.732+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:41:01.175473+00:00, queued_by_job_id=2, pid=None 2024-06-27T22:41:05.732904657Z [2024-06-27T22:41:05.732+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:41:05.739949241Z [2024-06-27T22:41:05.739+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:41:05.780750883Z [2024-06-27T22:41:05.780+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240627T224000, start_date=, end_date=20240627T224105 2024-06-27T22:41:05.801234593Z [2024-06-27T22:41:05.800+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:41:01.175473+00:00, queued_by_job_id=2, pid=None 2024-06-27T22:41:05.801589736Z [2024-06-27T22:41:05.801+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:41:05.804840933Z [2024-06-27T22:41:05.804+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:41:05.836019264Z [2024-06-27T22:41:05.835+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240627T224000, start_date=, end_date=20240627T224105 2024-06-27T22:41:08.052619535Z [2024-06-27T22:41:08.052+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:41:08.052800319Z [2024-06-27T22:41:08.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:40:00+00:00, run_id=scheduled__2024-06-27T22:40:00+00:00, run_start_date=2024-06-27 22:41:01.071651+00:00, run_end_date=2024-06-27 22:41:08.052557+00:00, run_duration=6.980906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:40:00+00:00, data_interval_end=2024-06-27 22:41:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:41:08.062268240Z [2024-06-27T22:41:08.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:41:00+00:00, run_after=2024-06-27T22:42:00+00:00 2024-06-27T22:41:08.069569872Z [2024-06-27T22:41:08.069+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:41:08.070502023Z [2024-06-27T22:41:08.070+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a, execution_date=2024-06-27 22:40:00+00:00, run_id=scheduled__2024-06-27T22:40:00+00:00, run_start_date=2024-06-27 22:41:01.072873+00:00, run_end_date=2024-06-27 22:41:08.069491+00:00, run_duration=6.996618, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:40:00+00:00, data_interval_end=2024-06-27 22:41:00+00:00, dag_hash=c85c93c7a1b669007bc16f6fdfd01da0 2024-06-27T22:41:08.085218625Z [2024-06-27T22:41:08.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a to 2024-06-27T22:41:00+00:00, run_after=2024-06-27T22:42:00+00:00 2024-06-27T22:41:08.093013498Z [2024-06-27T22:41:08.092+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:41:08.094149218Z [2024-06-27T22:41:08.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a, execution_date=2024-06-27 22:40:00+00:00, run_id=scheduled__2024-06-27T22:40:00+00:00, run_start_date=2024-06-27 22:41:01.073904+00:00, run_end_date=2024-06-27 22:41:08.092938+00:00, run_duration=7.019034, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:40:00+00:00, data_interval_end=2024-06-27 22:41:00+00:00, dag_hash=80be94bcaceb4a5c86da449fcb32487d 2024-06-27T22:41:08.129848660Z [2024-06-27T22:41:08.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a to 2024-06-27T22:41:00+00:00, run_after=2024-06-27T22:42:00+00:00 2024-06-27T22:41:08.142802608Z [2024-06-27T22:41:08.142+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:41:08.143568019Z [2024-06-27T22:41:08.143+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:40:00+00:00, run_id=scheduled__2024-06-27T22:40:00+00:00, run_start_date=2024-06-27 22:41:01.077958+00:00, run_end_date=2024-06-27 22:41:08.142715+00:00, run_duration=7.064757, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:40:00+00:00, data_interval_end=2024-06-27 22:41:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:41:08.155391544Z [2024-06-27T22:41:08.154+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:41:00+00:00, run_after=2024-06-27T22:42:00+00:00 2024-06-27T22:41:08.314311827Z [2024-06-27T22:41:08.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status success for try_number 1 2024-06-27T22:41:08.314387465Z [2024-06-27T22:41:08.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status success for try_number 1 2024-06-27T22:41:08.314515592Z [2024-06-27T22:41:08.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status success for try_number 1 2024-06-27T22:41:08.314603129Z [2024-06-27T22:41:08.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status success for try_number 1 2024-06-27T22:41:08.327291495Z [2024-06-27T22:41:08.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:40:00+00:00, map_index=-1, run_start_date=2024-06-27 22:41:05.272353+00:00, run_end_date=2024-06-27 22:41:07.225450+00:00, run_duration=1.953097, state=success, executor_state=success, try_number=1, max_tries=1, job_id=44, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:41:01.175473+00:00, queued_by_job_id=2, pid=643 2024-06-27T22:41:08.328407862Z [2024-06-27T22:41:08.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:40:00+00:00, map_index=-1, run_start_date=2024-06-27 22:41:05.417321+00:00, run_end_date=2024-06-27 22:41:07.326028+00:00, run_duration=1.908707, state=success, executor_state=success, try_number=1, max_tries=1, job_id=45, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:41:01.175473+00:00, queued_by_job_id=2, pid=650 2024-06-27T22:41:08.328649148Z [2024-06-27T22:41:08.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:40:00+00:00, map_index=-1, run_start_date=2024-06-27 22:41:05.763108+00:00, run_end_date=2024-06-27 22:41:07.613769+00:00, run_duration=1.850661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=46, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:41:01.175473+00:00, queued_by_job_id=2, pid=651 2024-06-27T22:41:08.328852090Z [2024-06-27T22:41:08.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:40:00+00:00, map_index=-1, run_start_date=2024-06-27 22:41:05.816595+00:00, run_end_date=2024-06-27 22:41:07.638497+00:00, run_duration=1.821902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=47, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:41:01.175473+00:00, queued_by_job_id=2, pid=657 2024-06-27T22:41:16.704475827Z [2024-06-27T22:41:16.704+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-06-27T22:41:16.704500465Z 2024-06-27T22:41:16.704504963Z 2024-06-27T22:41:16.704787157Z [2024-06-27T22:41:16.704+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 has 0/16 running and queued tasks 2024-06-27T22:41:16.705012348Z [2024-06-27T22:41:16.704+0000] {scheduler_job.py:425} INFO - DAG vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330 has 0/16 running and queued tasks 2024-06-27T22:41:16.705857595Z [2024-06-27T22:41:16.705+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:41:16.705868655Z 2024-06-27T22:41:16.705872064Z 2024-06-27T22:41:16.710530792Z [2024-06-27T22:41:16.710+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:40:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:41:16.710830327Z [2024-06-27T22:41:16.710+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:41:16.711256575Z [2024-06-27T22:41:16.711+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:40:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:41:16.711458664Z [2024-06-27T22:41:16.711+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:41:16.897968023Z [2024-06-27T22:41:16.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status queued for try_number 2 2024-06-27T22:41:16.898276671Z [2024-06-27T22:41:16.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status queued for try_number 2 2024-06-27T22:41:16.920924011Z [2024-06-27T22:41:16.920+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68b59306-381e-4842-9b8b-899f71497239 2024-06-27T22:41:16.921602841Z [2024-06-27T22:41:16.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae960073-ec69-4e64-afe8-d3b368d41537 2024-06-27T22:41:19.595357538Z [2024-06-27T22:41:19.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status failed for try_number 2 2024-06-27T22:41:19.596679575Z [2024-06-27T22:41:19.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status failed for try_number 2 2024-06-27T22:41:19.605175129Z [2024-06-27T22:41:19.604+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-06-27 22:41:05.751607+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:41:16.706400+00:00, queued_by_job_id=2, pid=None 2024-06-27T22:41:19.605689701Z [2024-06-27T22:41:19.605+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:41:19.609618044Z [2024-06-27T22:41:19.609+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:41:19.659055944Z [2024-06-27T22:41:19.658+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240627T224000, start_date=, end_date=20240627T224119 2024-06-27T22:41:19.671128880Z [2024-06-27T22:41:19.670+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-06-27 22:41:05.812148+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:41:16.706400+00:00, queued_by_job_id=2, pid=None 2024-06-27T22:41:19.671463576Z [2024-06-27T22:41:19.671+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:41:19.683776255Z [2024-06-27T22:41:19.683+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:41:19.748929051Z [2024-06-27T22:41:19.748+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240627T224000, start_date=, end_date=20240627T224119 2024-06-27T22:41:20.835181724Z [2024-06-27T22:41:20.834+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-27T22:41:20.835587245Z [2024-06-27T22:41:20.835+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330, execution_date=2024-06-27 22:40:00+00:00, run_id=scheduled__2024-06-27T22:40:00+00:00, run_start_date=2024-06-27 22:41:01.074957+00:00, run_end_date=2024-06-27 22:41:20.835259+00:00, run_duration=19.760302, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:40:00+00:00, data_interval_end=2024-06-27 22:41:00+00:00, dag_hash=81b0889a17bbaf37ac4d1e8ad4de8e82 2024-06-27T22:41:20.847604419Z [2024-06-27T22:41:20.847+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_b8e971b0-ca59-4579-bcb4-7c1997d32330 to 2024-06-27T22:41:00+00:00, run_after=2024-06-27T22:42:00+00:00 2024-06-27T22:41:20.854062170Z [2024-06-27T22:41:20.853+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-27T22:41:20.854522117Z [2024-06-27T22:41:20.854+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330, execution_date=2024-06-27 22:40:00+00:00, run_id=scheduled__2024-06-27T22:40:00+00:00, run_start_date=2024-06-27 22:41:01.076964+00:00, run_end_date=2024-06-27 22:41:20.854155+00:00, run_duration=19.777191, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:40:00+00:00, data_interval_end=2024-06-27 22:41:00+00:00, dag_hash=400cf984b99fd630c9e9a30d6f009174 2024-06-27T22:41:20.863535022Z [2024-06-27T22:41:20.863+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_b8e971b0-ca59-4579-bcb4-7c1997d32330 to 2024-06-27T22:41:00+00:00, run_after=2024-06-27T22:42:00+00:00 2024-06-27T22:41:43.947200436Z [2024-06-27T22:41:43.946+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T22:42:00.324020623Z [2024-06-27T22:42:00.323+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:42:00+00:00, run_after=2024-06-27T22:43:00+00:00 2024-06-27T22:42:00.330831780Z [2024-06-27T22:42:00.330+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:42:00.342953500Z [2024-06-27T22:42:00.342+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:42:00+00:00, run_after=2024-06-27T22:43:00+00:00 2024-06-27T22:42:00.349543912Z [2024-06-27T22:42:00.349+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:42:00.362559618Z [2024-06-27T22:42:00.362+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a to 2024-06-27T22:42:00+00:00, run_after=2024-06-27T22:43:00+00:00 2024-06-27T22:42:00.369307579Z [2024-06-27T22:42:00.368+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:42:00.452664202Z [2024-06-27T22:42:00.451+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-06-27T22:42:00.452733947Z 2024-06-27T22:42:00.452747613Z 2024-06-27T22:42:00.452755736Z 2024-06-27T22:42:00.452763583Z 2024-06-27T22:42:00.452771354Z 2024-06-27T22:42:00.452779140Z 2024-06-27T22:42:00.452787751Z [2024-06-27T22:42:00.452+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T22:42:00.452795774Z [2024-06-27T22:42:00.452+0000] {scheduler_job.py:425} INFO - DAG vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a has 0/16 running and queued tasks 2024-06-27T22:42:00.452803578Z [2024-06-27T22:42:00.452+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:42:00.452873226Z [2024-06-27T22:42:00.452+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a has 0/16 running and queued tasks 2024-06-27T22:42:00.452895876Z [2024-06-27T22:42:00.452+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:42:00.453054685Z [2024-06-27T22:42:00.452+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:42:00.453871142Z [2024-06-27T22:42:00.453+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:42:00.453955347Z 2024-06-27T22:42:00.453967921Z 2024-06-27T22:42:00.453975749Z 2024-06-27T22:42:00.453983434Z 2024-06-27T22:42:00.453991241Z 2024-06-27T22:42:00.453998952Z 2024-06-27T22:42:00.459434753Z [2024-06-27T22:42:00.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:42:00.459533743Z [2024-06-27T22:42:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T22:42:00.459785219Z [2024-06-27T22:42:00.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:42:00.459901143Z [2024-06-27T22:42:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:42:00.460153020Z [2024-06-27T22:42:00.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:42:00.460311991Z [2024-06-27T22:42:00.460+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:42:00.460546081Z [2024-06-27T22:42:00.460+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:42:00.460682785Z [2024-06-27T22:42:00.460+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:42:00.460919719Z [2024-06-27T22:42:00.460+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:42:00.461000844Z [2024-06-27T22:42:00.460+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:42:00.461219536Z [2024-06-27T22:42:00.461+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:42:00.461298402Z [2024-06-27T22:42:00.461+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:42:01.016541352Z [2024-06-27T22:42:01.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status queued for try_number 1 2024-06-27T22:42:01.017595533Z [2024-06-27T22:42:01.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:41:00+00:00 exited with status queued for try_number 1 2024-06-27T22:42:01.018108731Z [2024-06-27T22:42:01.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:41:00+00:00 exited with status queued for try_number 1 2024-06-27T22:42:01.018561967Z [2024-06-27T22:42:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:41:00+00:00 exited with status queued for try_number 1 2024-06-27T22:42:01.018957733Z [2024-06-27T22:42:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:41:00+00:00 exited with status queued for try_number 1 2024-06-27T22:42:01.019215574Z [2024-06-27T22:42:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:41:00+00:00 exited with status queued for try_number 1 2024-06-27T22:42:01.048281719Z [2024-06-27T22:42:01.047+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc5c13c9-e1a5-42af-b26c-71f7384aa5c6 2024-06-27T22:42:01.051177720Z [2024-06-27T22:42:01.048+0000] {scheduler_job.py:635} INFO - Setting external_id for to 543a178e-2efb-47b4-b5ba-a85c0598ddcf 2024-06-27T22:42:01.051413974Z [2024-06-27T22:42:01.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to d050c85b-d023-4db6-b75c-ca54353aed9f 2024-06-27T22:42:01.051576445Z [2024-06-27T22:42:01.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e155c18-a6c2-439d-8861-4d8353028af5 2024-06-27T22:42:01.051798127Z [2024-06-27T22:42:01.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd4bbb0e-d3cf-4553-839d-5897b41a4024 2024-06-27T22:42:01.052092957Z [2024-06-27T22:42:01.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca04d5a9-0dec-40a2-b4fc-81b55bd91d94 2024-06-27T22:42:02.161578697Z [2024-06-27T22:42:02.161+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:42:02.161838015Z [2024-06-27T22:42:02.161+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 22:40:00+00:00, run_id=scheduled__2024-06-27T22:40:00+00:00, run_start_date=2024-06-27 22:42:00.378976+00:00, run_end_date=2024-06-27 22:42:02.161517+00:00, run_duration=1.782541, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:40:00+00:00, data_interval_end=2024-06-27 22:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T22:42:02.186437740Z [2024-06-27T22:42:02.186+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T22:42:00+00:00, run_after=2024-06-27T22:44:00+00:00 2024-06-27T22:42:02.315573809Z [2024-06-27T22:42:02.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status success for try_number 1 2024-06-27T22:42:02.323188121Z [2024-06-27T22:42:02.322+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T22:40:00+00:00, map_index=-1, run_start_date=2024-06-27 22:42:01.407752+00:00, run_end_date=2024-06-27 22:42:01.747451+00:00, run_duration=0.339699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=48, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:42:00.454815+00:00, queued_by_job_id=2, pid=716 2024-06-27T22:42:03.385153199Z [2024-06-27T22:42:03.384+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:42:03.385338795Z [2024-06-27T22:42:03.385+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:41:00+00:00, run_id=scheduled__2024-06-27T22:41:00+00:00, run_start_date=2024-06-27 22:42:00.381213+00:00, run_end_date=2024-06-27 22:42:03.385090+00:00, run_duration=3.003877, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:41:00+00:00, data_interval_end=2024-06-27 22:42:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:42:03.393976554Z [2024-06-27T22:42:03.393+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:42:00+00:00, run_after=2024-06-27T22:43:00+00:00 2024-06-27T22:42:03.452458931Z [2024-06-27T22:42:03.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:41:00+00:00 exited with status success for try_number 1 2024-06-27T22:42:03.456991659Z [2024-06-27T22:42:03.456+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:41:00+00:00, map_index=-1, run_start_date=2024-06-27 22:42:02.386826+00:00, run_end_date=2024-06-27 22:42:02.927313+00:00, run_duration=0.540487, state=success, executor_state=success, try_number=1, max_tries=1, job_id=49, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:42:00.454815+00:00, queued_by_job_id=2, pid=728 2024-06-27T22:42:04.558016857Z [2024-06-27T22:42:04.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:41:00+00:00 exited with status failed for try_number 1 2024-06-27T22:42:04.558294542Z [2024-06-27T22:42:04.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:41:00+00:00 exited with status failed for try_number 1 2024-06-27T22:42:04.573150773Z [2024-06-27T22:42:04.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:41:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:42:00.454815+00:00, queued_by_job_id=2, pid=None 2024-06-27T22:42:04.573746767Z [2024-06-27T22:42:04.573+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:42:04.576181719Z [2024-06-27T22:42:04.575+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:42:04.605146248Z [2024-06-27T22:42:04.604+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240627T224100, start_date=, end_date=20240627T224204 2024-06-27T22:42:04.615682395Z [2024-06-27T22:42:04.615+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:41:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:42:00.454815+00:00, queued_by_job_id=2, pid=None 2024-06-27T22:42:04.618366499Z [2024-06-27T22:42:04.618+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:42:04.624486679Z [2024-06-27T22:42:04.624+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:42:04.640920224Z [2024-06-27T22:42:04.640+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240627T224100, start_date=, end_date=20240627T224204 2024-06-27T22:42:05.824036468Z [2024-06-27T22:42:05.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:41:00+00:00 exited with status success for try_number 1 2024-06-27T22:42:05.847366868Z [2024-06-27T22:42:05.846+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:41:00+00:00, map_index=-1, run_start_date=2024-06-27 22:42:03.684493+00:00, run_end_date=2024-06-27 22:42:05.565747+00:00, run_duration=1.881254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=51, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:42:00.454815+00:00, queued_by_job_id=2, pid=768 2024-06-27T22:42:06.174424379Z [2024-06-27T22:42:06.173+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:42:06.174974251Z [2024-06-27T22:42:06.174+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:41:00+00:00, run_id=scheduled__2024-06-27T22:41:00+00:00, run_start_date=2024-06-27 22:42:00.383138+00:00, run_end_date=2024-06-27 22:42:06.174351+00:00, run_duration=5.791213, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:41:00+00:00, data_interval_end=2024-06-27 22:42:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:42:06.188879204Z [2024-06-27T22:42:06.188+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:42:00+00:00, run_after=2024-06-27T22:43:00+00:00 2024-06-27T22:42:07.333851312Z [2024-06-27T22:42:07.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:42:07.334668074Z [2024-06-27T22:42:07.334+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:41:00+00:00, run_id=scheduled__2024-06-27T22:41:00+00:00, run_start_date=2024-06-27 22:42:00.384036+00:00, run_end_date=2024-06-27 22:42:07.334264+00:00, run_duration=6.950228, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:41:00+00:00, data_interval_end=2024-06-27 22:42:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:42:07.345421570Z [2024-06-27T22:42:07.345+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:42:00+00:00, run_after=2024-06-27T22:43:00+00:00 2024-06-27T22:42:07.394465130Z [2024-06-27T22:42:07.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:41:00+00:00 exited with status success for try_number 1 2024-06-27T22:42:07.398782696Z [2024-06-27T22:42:07.398+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:41:00+00:00, map_index=-1, run_start_date=2024-06-27 22:42:03.497564+00:00, run_end_date=2024-06-27 22:42:06.378529+00:00, run_duration=2.880965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=50, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:42:00.454815+00:00, queued_by_job_id=2, pid=757 2024-06-27T22:42:14.654932919Z [2024-06-27T22:42:14.654+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-06-27T22:42:14.654957119Z 2024-06-27T22:42:14.654960630Z 2024-06-27T22:42:14.654963792Z [2024-06-27T22:42:14.654+0000] {scheduler_job.py:425} INFO - DAG vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a has 0/16 running and queued tasks 2024-06-27T22:42:14.655155582Z [2024-06-27T22:42:14.654+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a has 0/16 running and queued tasks 2024-06-27T22:42:14.655729507Z [2024-06-27T22:42:14.655+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:42:14.655740326Z 2024-06-27T22:42:14.655743571Z 2024-06-27T22:42:14.658009936Z [2024-06-27T22:42:14.657+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:41:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:42:14.658193799Z [2024-06-27T22:42:14.657+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:42:14.658526528Z [2024-06-27T22:42:14.658+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:41:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:42:14.658652559Z [2024-06-27T22:42:14.658+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:42:14.849902250Z [2024-06-27T22:42:14.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:41:00+00:00 exited with status queued for try_number 2 2024-06-27T22:42:14.850147998Z [2024-06-27T22:42:14.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:41:00+00:00 exited with status queued for try_number 2 2024-06-27T22:42:14.858961763Z [2024-06-27T22:42:14.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to a261d3a0-8dcb-4a16-b5bc-fa9e4463a95a 2024-06-27T22:42:14.859181450Z [2024-06-27T22:42:14.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to f09786e1-29ee-403c-b654-139402fd07a0 2024-06-27T22:42:16.489395906Z [2024-06-27T22:42:16.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:41:00+00:00 exited with status failed for try_number 2 2024-06-27T22:42:16.496544796Z [2024-06-27T22:42:16.496+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:41:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-06-27 22:42:04.626952+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:42:14.656232+00:00, queued_by_job_id=2, pid=None 2024-06-27T22:42:16.497099465Z [2024-06-27T22:42:16.496+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:42:16.499352692Z [2024-06-27T22:42:16.499+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:42:16.511689910Z [2024-06-27T22:42:16.511+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240627T224100, start_date=, end_date=20240627T224216 2024-06-27T22:42:17.382448245Z [2024-06-27T22:42:17.382+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-27T22:42:17.383210206Z [2024-06-27T22:42:17.382+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a, execution_date=2024-06-27 22:41:00+00:00, run_id=scheduled__2024-06-27T22:41:00+00:00, run_start_date=2024-06-27 22:42:00.382165+00:00, run_end_date=2024-06-27 22:42:17.382374+00:00, run_duration=17.000209, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:41:00+00:00, data_interval_end=2024-06-27 22:42:00+00:00, dag_hash=c85c93c7a1b669007bc16f6fdfd01da0 2024-06-27T22:42:17.392765220Z [2024-06-27T22:42:17.392+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_4a6e55bc-4743-4df1-be75-02140eb7f47a to 2024-06-27T22:42:00+00:00, run_after=2024-06-27T22:43:00+00:00 2024-06-27T22:42:17.429602030Z [2024-06-27T22:42:17.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:41:00+00:00 exited with status failed for try_number 2 2024-06-27T22:42:17.435309838Z [2024-06-27T22:42:17.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:41:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-06-27 22:42:04.584140+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:42:14.656232+00:00, queued_by_job_id=2, pid=None 2024-06-27T22:42:17.435845859Z [2024-06-27T22:42:17.435+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:42:17.438168584Z [2024-06-27T22:42:17.437+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T22:42:17.454079238Z [2024-06-27T22:42:17.453+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240627T224100, start_date=, end_date=20240627T224217 2024-06-27T22:42:18.511474518Z [2024-06-27T22:42:18.510+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-27T22:42:18.511567105Z [2024-06-27T22:42:18.511+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a, execution_date=2024-06-27 22:41:00+00:00, run_id=scheduled__2024-06-27T22:41:00+00:00, run_start_date=2024-06-27 22:42:00.380192+00:00, run_end_date=2024-06-27 22:42:18.511221+00:00, run_duration=18.131029, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:41:00+00:00, data_interval_end=2024-06-27 22:42:00+00:00, dag_hash=80be94bcaceb4a5c86da449fcb32487d 2024-06-27T22:42:18.519304165Z [2024-06-27T22:42:18.518+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4a6e55bc-4743-4df1-be75-02140eb7f47a to 2024-06-27T22:42:00+00:00, run_after=2024-06-27T22:43:00+00:00 2024-06-27T22:43:00.118239770Z [2024-06-27T22:43:00.117+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:43:00.132860769Z [2024-06-27T22:43:00.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:43:00+00:00, run_after=2024-06-27T22:44:00+00:00 2024-06-27T22:43:00.153035913Z [2024-06-27T22:43:00.152+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:43:00+00:00, run_after=2024-06-27T22:44:00+00:00 2024-06-27T22:43:00.225139794Z [2024-06-27T22:43:00.224+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T22:43:00.225171887Z 2024-06-27T22:43:00.225175847Z 2024-06-27T22:43:00.225179253Z 2024-06-27T22:43:00.225456716Z [2024-06-27T22:43:00.225+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:43:00.225675224Z [2024-06-27T22:43:00.225+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:43:00.226133019Z [2024-06-27T22:43:00.225+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:43:00.227086812Z [2024-06-27T22:43:00.226+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:43:00.227098405Z 2024-06-27T22:43:00.227102074Z 2024-06-27T22:43:00.227105202Z 2024-06-27T22:43:00.231023689Z [2024-06-27T22:43:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:43:00.231349656Z [2024-06-27T22:43:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:43:00.231723251Z [2024-06-27T22:43:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:43:00.231956189Z [2024-06-27T22:43:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:43:00.232381312Z [2024-06-27T22:43:00.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:43:00.232614725Z [2024-06-27T22:43:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:43:00.516163239Z [2024-06-27T22:43:00.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:42:00+00:00 exited with status queued for try_number 1 2024-06-27T22:43:00.516291162Z [2024-06-27T22:43:00.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:42:00+00:00 exited with status queued for try_number 1 2024-06-27T22:43:00.516404924Z [2024-06-27T22:43:00.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:42:00+00:00 exited with status queued for try_number 1 2024-06-27T22:43:00.523465746Z [2024-06-27T22:43:00.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9425dd8d-801d-4ae3-94ac-5583d0aca7b8 2024-06-27T22:43:00.523671375Z [2024-06-27T22:43:00.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce04aa2b-f547-4127-a495-cb14020a517b 2024-06-27T22:43:00.523980092Z [2024-06-27T22:43:00.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d92b746-0287-4c33-81d6-97c3233702a4 2024-06-27T22:43:01.716875125Z [2024-06-27T22:43:01.716+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:43:01.718102712Z [2024-06-27T22:43:01.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:42:00+00:00, run_id=scheduled__2024-06-27T22:42:00+00:00, run_start_date=2024-06-27 22:43:00.169200+00:00, run_end_date=2024-06-27 22:43:01.717577+00:00, run_duration=1.548377, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:42:00+00:00, data_interval_end=2024-06-27 22:43:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:43:01.763516278Z [2024-06-27T22:43:01.762+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:43:00+00:00, run_after=2024-06-27T22:44:00+00:00 2024-06-27T22:43:01.835126162Z [2024-06-27T22:43:01.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:42:00+00:00 exited with status success for try_number 1 2024-06-27T22:43:01.842268763Z [2024-06-27T22:43:01.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:42:00+00:00, map_index=-1, run_start_date=2024-06-27 22:43:01.047582+00:00, run_end_date=2024-06-27 22:43:01.537760+00:00, run_duration=0.490178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=52, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:43:00.228477+00:00, queued_by_job_id=2, pid=824 2024-06-27T22:43:03.749789917Z [2024-06-27T22:43:03.749+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:43:03.750214813Z [2024-06-27T22:43:03.749+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:42:00+00:00, run_id=scheduled__2024-06-27T22:42:00+00:00, run_start_date=2024-06-27 22:43:00.168106+00:00, run_end_date=2024-06-27 22:43:03.749668+00:00, run_duration=3.581562, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:42:00+00:00, data_interval_end=2024-06-27 22:43:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:43:03.759493091Z [2024-06-27T22:43:03.759+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:43:00+00:00, run_after=2024-06-27T22:44:00+00:00 2024-06-27T22:43:04.841000160Z [2024-06-27T22:43:04.840+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:43:04.841266096Z [2024-06-27T22:43:04.841+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:42:00+00:00, run_id=scheduled__2024-06-27T22:42:00+00:00, run_start_date=2024-06-27 22:43:00.166014+00:00, run_end_date=2024-06-27 22:43:04.840925+00:00, run_duration=4.674911, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:42:00+00:00, data_interval_end=2024-06-27 22:43:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:43:04.857773156Z [2024-06-27T22:43:04.857+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:43:00+00:00, run_after=2024-06-27T22:44:00+00:00 2024-06-27T22:43:04.885445829Z [2024-06-27T22:43:04.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:42:00+00:00 exited with status success for try_number 1 2024-06-27T22:43:04.885477607Z [2024-06-27T22:43:04.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:42:00+00:00 exited with status success for try_number 1 2024-06-27T22:43:04.890604249Z [2024-06-27T22:43:04.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:42:00+00:00, map_index=-1, run_start_date=2024-06-27 22:43:02.325154+00:00, run_end_date=2024-06-27 22:43:04.029004+00:00, run_duration=1.70385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=53, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:43:00.228477+00:00, queued_by_job_id=2, pid=842 2024-06-27T22:43:04.890823094Z [2024-06-27T22:43:04.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:42:00+00:00, map_index=-1, run_start_date=2024-06-27 22:43:02.362653+00:00, run_end_date=2024-06-27 22:43:03.679203+00:00, run_duration=1.31655, state=success, executor_state=success, try_number=1, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:43:00.228477+00:00, queued_by_job_id=2, pid=843 2024-06-27T22:44:00.653285722Z [2024-06-27T22:44:00.652+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:44:00+00:00, run_after=2024-06-27T22:45:00+00:00 2024-06-27T22:44:00.664949290Z [2024-06-27T22:44:00.664+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:44:00.687011003Z [2024-06-27T22:44:00.686+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:44:00.728047024Z [2024-06-27T22:44:00.727+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:44:00+00:00, run_after=2024-06-27T22:45:00+00:00 2024-06-27T22:44:00.911844438Z [2024-06-27T22:44:00.911+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T22:44:00.911857966Z 2024-06-27T22:44:00.911862053Z 2024-06-27T22:44:00.911865551Z 2024-06-27T22:44:00.911868897Z 2024-06-27T22:44:00.914592633Z [2024-06-27T22:44:00.914+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T22:44:00.914882362Z [2024-06-27T22:44:00.914+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:44:00.915354814Z [2024-06-27T22:44:00.915+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:44:00.915500824Z [2024-06-27T22:44:00.915+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:44:00.916318084Z [2024-06-27T22:44:00.916+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:44:00.916334669Z 2024-06-27T22:44:00.916342440Z 2024-06-27T22:44:00.916347358Z 2024-06-27T22:44:00.916352346Z 2024-06-27T22:44:00.927870511Z [2024-06-27T22:44:00.927+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:44:00.928373841Z [2024-06-27T22:44:00.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T22:44:00.928724257Z [2024-06-27T22:44:00.928+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:44:00.928968763Z [2024-06-27T22:44:00.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:44:00.929194380Z [2024-06-27T22:44:00.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:44:00.929323942Z [2024-06-27T22:44:00.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:44:00.929684059Z [2024-06-27T22:44:00.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:44:00.929823014Z [2024-06-27T22:44:00.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:44:01.539796241Z [2024-06-27T22:44:01.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:42:00+00:00 exited with status queued for try_number 1 2024-06-27T22:44:01.540406597Z [2024-06-27T22:44:01.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:43:00+00:00 exited with status queued for try_number 1 2024-06-27T22:44:01.540587522Z [2024-06-27T22:44:01.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:43:00+00:00 exited with status queued for try_number 1 2024-06-27T22:44:01.540737510Z [2024-06-27T22:44:01.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:43:00+00:00 exited with status queued for try_number 1 2024-06-27T22:44:01.590320331Z [2024-06-27T22:44:01.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56fb3059-c85a-489e-b836-682c1bfb0449 2024-06-27T22:44:01.590673333Z [2024-06-27T22:44:01.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7817733-fe2d-446a-a12c-29fb44ac872f 2024-06-27T22:44:01.604017327Z [2024-06-27T22:44:01.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64ab5dfd-245b-45ca-b702-4dc94196702d 2024-06-27T22:44:01.604418852Z [2024-06-27T22:44:01.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2a64f0d-34c1-4beb-b267-fba37f3fe97b 2024-06-27T22:44:04.326109955Z [2024-06-27T22:44:04.325+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:44:04.337635475Z [2024-06-27T22:44:04.337+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 22:42:00+00:00, run_id=scheduled__2024-06-27T22:42:00+00:00, run_start_date=2024-06-27 22:44:00.750128+00:00, run_end_date=2024-06-27 22:44:04.333878+00:00, run_duration=3.58375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:42:00+00:00, data_interval_end=2024-06-27 22:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T22:44:04.381562122Z [2024-06-27T22:44:04.381+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T22:44:00+00:00, run_after=2024-06-27T22:46:00+00:00 2024-06-27T22:44:04.426734644Z [2024-06-27T22:44:04.423+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:44:04.427353904Z [2024-06-27T22:44:04.427+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:43:00+00:00, run_id=scheduled__2024-06-27T22:43:00+00:00, run_start_date=2024-06-27 22:44:00.761650+00:00, run_end_date=2024-06-27 22:44:04.426742+00:00, run_duration=3.665092, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:43:00+00:00, data_interval_end=2024-06-27 22:44:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:44:04.502253044Z [2024-06-27T22:44:04.501+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:44:00+00:00, run_after=2024-06-27T22:45:00+00:00 2024-06-27T22:44:04.701054345Z [2024-06-27T22:44:04.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:42:00+00:00 exited with status success for try_number 1 2024-06-27T22:44:04.704631476Z [2024-06-27T22:44:04.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:43:00+00:00 exited with status success for try_number 1 2024-06-27T22:44:04.739574707Z [2024-06-27T22:44:04.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T22:42:00+00:00, map_index=-1, run_start_date=2024-06-27 22:44:02.634883+00:00, run_end_date=2024-06-27 22:44:03.340285+00:00, run_duration=0.705402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=56, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:44:00.917551+00:00, queued_by_job_id=2, pid=878 2024-06-27T22:44:04.741110439Z [2024-06-27T22:44:04.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:43:00+00:00, map_index=-1, run_start_date=2024-06-27 22:44:02.301202+00:00, run_end_date=2024-06-27 22:44:02.953812+00:00, run_duration=0.65261, state=success, executor_state=success, try_number=1, max_tries=1, job_id=55, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:44:00.917551+00:00, queued_by_job_id=2, pid=877 2024-06-27T22:44:06.905113385Z [2024-06-27T22:44:06.904+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:44:06.905325173Z [2024-06-27T22:44:06.905+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:43:00+00:00, run_id=scheduled__2024-06-27T22:43:00+00:00, run_start_date=2024-06-27 22:44:00.756259+00:00, run_end_date=2024-06-27 22:44:06.904981+00:00, run_duration=6.148722, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:43:00+00:00, data_interval_end=2024-06-27 22:44:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:44:06.913949845Z [2024-06-27T22:44:06.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:44:00+00:00, run_after=2024-06-27T22:45:00+00:00 2024-06-27T22:44:06.923611850Z [2024-06-27T22:44:06.923+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:44:06.923930113Z [2024-06-27T22:44:06.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:43:00+00:00, run_id=scheduled__2024-06-27T22:43:00+00:00, run_start_date=2024-06-27 22:44:00.754044+00:00, run_end_date=2024-06-27 22:44:06.923557+00:00, run_duration=6.169513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:43:00+00:00, data_interval_end=2024-06-27 22:44:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:44:06.939037707Z [2024-06-27T22:44:06.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:44:00+00:00, run_after=2024-06-27T22:45:00+00:00 2024-06-27T22:44:06.995096610Z [2024-06-27T22:44:06.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:43:00+00:00 exited with status success for try_number 1 2024-06-27T22:44:06.995948051Z [2024-06-27T22:44:06.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:43:00+00:00 exited with status success for try_number 1 2024-06-27T22:44:07.005010524Z [2024-06-27T22:44:07.004+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:43:00+00:00, map_index=-1, run_start_date=2024-06-27 22:44:04.154654+00:00, run_end_date=2024-06-27 22:44:05.884873+00:00, run_duration=1.730219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=57, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:44:00.917551+00:00, queued_by_job_id=2, pid=901 2024-06-27T22:44:07.005278868Z [2024-06-27T22:44:07.004+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:43:00+00:00, map_index=-1, run_start_date=2024-06-27 22:44:04.407693+00:00, run_end_date=2024-06-27 22:44:06.378088+00:00, run_duration=1.970395, state=success, executor_state=success, try_number=1, max_tries=1, job_id=58, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:44:00.917551+00:00, queued_by_job_id=2, pid=902 2024-06-27T22:45:01.014755679Z [2024-06-27T22:45:01.014+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:45:01.030769824Z [2024-06-27T22:45:01.030+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:45:00+00:00, run_after=2024-06-27T22:46:00+00:00 2024-06-27T22:45:01.043328572Z [2024-06-27T22:45:01.042+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:45:00+00:00, run_after=2024-06-27T22:46:00+00:00 2024-06-27T22:45:01.059853010Z [2024-06-27T22:45:01.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:45:00+00:00, run_after=2024-06-27T22:50:00+00:00 2024-06-27T22:45:01.157159248Z [2024-06-27T22:45:01.156+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T22:45:01.157214790Z 2024-06-27T22:45:01.157223599Z 2024-06-27T22:45:01.157228826Z 2024-06-27T22:45:01.157233740Z 2024-06-27T22:45:01.157248309Z [2024-06-27T22:45:01.157+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:45:01.157344278Z [2024-06-27T22:45:01.157+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:45:01.157432601Z [2024-06-27T22:45:01.157+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:45:01.157592039Z [2024-06-27T22:45:01.157+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:45:01.158574430Z [2024-06-27T22:45:01.158+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:45:01.158591178Z 2024-06-27T22:45:01.158596795Z 2024-06-27T22:45:01.158601610Z 2024-06-27T22:45:01.158606864Z 2024-06-27T22:45:01.164658794Z [2024-06-27T22:45:01.164+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T22:45:01.165185895Z [2024-06-27T22:45:01.164+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:45:01.165413196Z [2024-06-27T22:45:01.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:45:01.165474315Z [2024-06-27T22:45:01.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:45:01.165697999Z [2024-06-27T22:45:01.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:45:01.165708169Z [2024-06-27T22:45:01.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:45:01.166067543Z [2024-06-27T22:45:01.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:45:01.166091851Z [2024-06-27T22:45:01.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:45:01.556821591Z [2024-06-27T22:45:01.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status queued for try_number 1 2024-06-27T22:45:01.562332621Z [2024-06-27T22:45:01.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:44:00+00:00 exited with status queued for try_number 1 2024-06-27T22:45:01.562394252Z [2024-06-27T22:45:01.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:44:00+00:00 exited with status queued for try_number 1 2024-06-27T22:45:01.562553004Z [2024-06-27T22:45:01.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:44:00+00:00 exited with status queued for try_number 1 2024-06-27T22:45:01.592741139Z [2024-06-27T22:45:01.592+0000] {scheduler_job.py:635} INFO - Setting external_id for to aff0016e-10e4-4212-ba0f-1395c172bd46 2024-06-27T22:45:01.593279658Z [2024-06-27T22:45:01.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa9db150-49ec-4236-b556-95eb67c770ab 2024-06-27T22:45:01.593528233Z [2024-06-27T22:45:01.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to 982d7df6-4f08-4a68-947f-52cda55ecbb2 2024-06-27T22:45:01.593760585Z [2024-06-27T22:45:01.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b3aa895-4363-4832-82c1-034d8a1b32a1 2024-06-27T22:45:03.432202715Z [2024-06-27T22:45:03.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:45:03.432667157Z [2024-06-27T22:45:03.432+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:44:00+00:00, run_id=scheduled__2024-06-27T22:44:00+00:00, run_start_date=2024-06-27 22:45:01.079096+00:00, run_end_date=2024-06-27 22:45:03.432283+00:00, run_duration=2.353187, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:44:00+00:00, data_interval_end=2024-06-27 22:45:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:45:03.442593590Z [2024-06-27T22:45:03.442+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:45:00+00:00, run_after=2024-06-27T22:46:00+00:00 2024-06-27T22:45:04.146285106Z [2024-06-27T22:45:04.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:44:00+00:00 exited with status success for try_number 1 2024-06-27T22:45:04.159225612Z [2024-06-27T22:45:04.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:44:00+00:00, map_index=-1, run_start_date=2024-06-27 22:45:02.468368+00:00, run_end_date=2024-06-27 22:45:03.312794+00:00, run_duration=0.844426, state=success, executor_state=success, try_number=1, max_tries=1, job_id=59, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:45:01.159606+00:00, queued_by_job_id=2, pid=934 2024-06-27T22:45:07.709609646Z [2024-06-27T22:45:07.709+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:45:07.709826237Z [2024-06-27T22:45:07.709+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:44:00+00:00, run_id=scheduled__2024-06-27T22:44:00+00:00, run_start_date=2024-06-27 22:45:01.076527+00:00, run_end_date=2024-06-27 22:45:07.709442+00:00, run_duration=6.632915, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:44:00+00:00, data_interval_end=2024-06-27 22:45:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:45:07.718817737Z [2024-06-27T22:45:07.718+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:45:00+00:00, run_after=2024-06-27T22:46:00+00:00 2024-06-27T22:45:07.733574654Z [2024-06-27T22:45:07.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:45:07.733731369Z [2024-06-27T22:45:07.733+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:44:00+00:00, run_id=scheduled__2024-06-27T22:44:00+00:00, run_start_date=2024-06-27 22:45:01.077765+00:00, run_end_date=2024-06-27 22:45:07.733507+00:00, run_duration=6.655742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:44:00+00:00, data_interval_end=2024-06-27 22:45:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:45:07.749491636Z [2024-06-27T22:45:07.749+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:45:00+00:00, run_after=2024-06-27T22:46:00+00:00 2024-06-27T22:45:07.817040193Z [2024-06-27T22:45:07.816+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:45:07.817067665Z 2024-06-27T22:45:07.817224619Z [2024-06-27T22:45:07.816+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:45:07.817815412Z [2024-06-27T22:45:07.817+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:45:07.817828856Z 2024-06-27T22:45:07.820886221Z [2024-06-27T22:45:07.820+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-27T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T22:45:07.822480200Z [2024-06-27T22:45:07.820+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-27T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:45:07.906512853Z [2024-06-27T22:45:07.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status queued for try_number 1 2024-06-27T22:45:07.906666423Z [2024-06-27T22:45:07.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status success for try_number 1 2024-06-27T22:45:07.906885399Z [2024-06-27T22:45:07.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:44:00+00:00 exited with status success for try_number 1 2024-06-27T22:45:07.908088272Z [2024-06-27T22:45:07.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:44:00+00:00 exited with status success for try_number 1 2024-06-27T22:45:07.920063993Z [2024-06-27T22:45:07.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:44:00+00:00, map_index=-1, run_start_date=2024-06-27 22:45:04.569626+00:00, run_end_date=2024-06-27 22:45:06.848076+00:00, run_duration=2.27845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=60, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:45:01.159606+00:00, queued_by_job_id=2, pid=948 2024-06-27T22:45:07.920329970Z [2024-06-27T22:45:07.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:44:00+00:00, map_index=-1, run_start_date=2024-06-27 22:45:05.775432+00:00, run_end_date=2024-06-27 22:45:07.408047+00:00, run_duration=1.632615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=61, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:45:01.159606+00:00, queued_by_job_id=2, pid=964 2024-06-27T22:45:07.920550028Z [2024-06-27T22:45:07.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T22:40:00+00:00, map_index=-1, run_start_date=2024-06-27 22:45:05.869809+00:00, run_end_date=2024-06-27 22:45:06.597620+00:00, run_duration=0.727811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=62, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:45:01.159606+00:00, queued_by_job_id=2, pid=965 2024-06-27T22:45:07.920735590Z [2024-06-27T22:45:07.920+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2804a332-fb69-4014-b829-94c26d8231a1 2024-06-27T22:45:11.110486713Z [2024-06-27T22:45:11.110+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:45:11.110512925Z 2024-06-27T22:45:11.110517253Z [2024-06-27T22:45:11.110+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:45:11.111301961Z [2024-06-27T22:45:11.111+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:45:11.111334102Z 2024-06-27T22:45:11.113461057Z [2024-06-27T22:45:11.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-27T22:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T22:45:11.113694198Z [2024-06-27T22:45:11.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-27T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T22:45:11.180263957Z [2024-06-27T22:45:11.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status queued for try_number 1 2024-06-27T22:45:11.180533379Z [2024-06-27T22:45:11.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status success for try_number 1 2024-06-27T22:45:11.193013920Z [2024-06-27T22:45:11.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-27T22:40:00+00:00, map_index=-1, run_start_date=2024-06-27 22:45:09.701539+00:00, run_end_date=2024-06-27 22:45:10.077766+00:00, run_duration=0.376227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=63, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:45:07.818184+00:00, queued_by_job_id=2, pid=983 2024-06-27T22:45:11.193615506Z [2024-06-27T22:45:11.193+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1ec1ec0-6216-4a98-97dc-c8cce275c297 2024-06-27T22:45:13.451446165Z [2024-06-27T22:45:13.451+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:45:13.451479835Z 2024-06-27T22:45:13.451486836Z [2024-06-27T22:45:13.451+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:45:13.451936443Z [2024-06-27T22:45:13.451+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:45:13.451956375Z 2024-06-27T22:45:13.454432546Z [2024-06-27T22:45:13.454+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-27T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:45:13.454533540Z [2024-06-27T22:45:13.454+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-27T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:45:13.504267050Z [2024-06-27T22:45:13.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status queued for try_number 1 2024-06-27T22:45:13.509118028Z [2024-06-27T22:45:13.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d3e7934-1553-4c2d-af1a-11c78e4bc6bf 2024-06-27T22:45:13.621071492Z [2024-06-27T22:45:13.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status success for try_number 1 2024-06-27T22:45:13.625743292Z [2024-06-27T22:45:13.625+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-27T22:40:00+00:00, map_index=0, run_start_date=2024-06-27 22:45:12.995587+00:00, run_end_date=2024-06-27 22:45:13.371432+00:00, run_duration=0.375845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=64, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:45:11.111614+00:00, queued_by_job_id=2, pid=991 2024-06-27T22:45:16.498192707Z [2024-06-27T22:45:16.497+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:45:16.498452004Z [2024-06-27T22:45:16.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:40:00+00:00, run_id=scheduled__2024-06-27T22:40:00+00:00, run_start_date=2024-06-27 22:45:01.074776+00:00, run_end_date=2024-06-27 22:45:16.498066+00:00, run_duration=15.42329, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:40:00+00:00, data_interval_end=2024-06-27 22:45:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-27T22:45:16.504236001Z [2024-06-27T22:45:16.503+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:45:00+00:00, run_after=2024-06-27T22:50:00+00:00 2024-06-27T22:45:16.557511061Z [2024-06-27T22:45:16.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T22:40:00+00:00 exited with status success for try_number 1 2024-06-27T22:45:16.561356480Z [2024-06-27T22:45:16.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-27T22:40:00+00:00, map_index=-1, run_start_date=2024-06-27 22:45:15.174989+00:00, run_end_date=2024-06-27 22:45:15.609346+00:00, run_duration=0.434357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=65, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:45:13.452352+00:00, queued_by_job_id=2, pid=999 2024-06-27T22:46:00.341826461Z [2024-06-27T22:46:00.341+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:46:00.354950246Z [2024-06-27T22:46:00.354+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:46:00+00:00, run_after=2024-06-27T22:47:00+00:00 2024-06-27T22:46:00.361343245Z [2024-06-27T22:46:00.361+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:46:00.372542823Z [2024-06-27T22:46:00.371+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:46:00+00:00, run_after=2024-06-27T22:47:00+00:00 2024-06-27T22:46:00.439771828Z [2024-06-27T22:46:00.439+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T22:46:00.439827907Z 2024-06-27T22:46:00.439862931Z 2024-06-27T22:46:00.439878310Z 2024-06-27T22:46:00.439892818Z 2024-06-27T22:46:00.439964891Z [2024-06-27T22:46:00.439+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T22:46:00.440006279Z [2024-06-27T22:46:00.439+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:46:00.440192763Z [2024-06-27T22:46:00.440+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:46:00.440316408Z [2024-06-27T22:46:00.440+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:46:00.440914866Z [2024-06-27T22:46:00.440+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:46:00.440928085Z 2024-06-27T22:46:00.440932998Z 2024-06-27T22:46:00.440937730Z 2024-06-27T22:46:00.440942785Z 2024-06-27T22:46:00.443863377Z [2024-06-27T22:46:00.443+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:46:00.444002334Z [2024-06-27T22:46:00.443+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T22:46:00.444285576Z [2024-06-27T22:46:00.444+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:46:00.444421679Z [2024-06-27T22:46:00.444+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:46:00.444641688Z [2024-06-27T22:46:00.444+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:46:00.444754528Z [2024-06-27T22:46:00.444+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:46:00.444987225Z [2024-06-27T22:46:00.444+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:46:00.445106838Z [2024-06-27T22:46:00.444+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:46:00.825874167Z [2024-06-27T22:46:00.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:44:00+00:00 exited with status queued for try_number 1 2024-06-27T22:46:00.826146545Z [2024-06-27T22:46:00.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:45:00+00:00 exited with status queued for try_number 1 2024-06-27T22:46:00.826208635Z [2024-06-27T22:46:00.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:45:00+00:00 exited with status queued for try_number 1 2024-06-27T22:46:00.826353075Z [2024-06-27T22:46:00.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:45:00+00:00 exited with status queued for try_number 1 2024-06-27T22:46:00.837038354Z [2024-06-27T22:46:00.836+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca36db1f-f8cc-4dd2-9f45-635969c7c036 2024-06-27T22:46:00.837362634Z [2024-06-27T22:46:00.837+0000] {scheduler_job.py:635} INFO - Setting external_id for to 810d6713-d6d0-4a92-bb00-3dd3b5a9af5e 2024-06-27T22:46:00.837899127Z [2024-06-27T22:46:00.837+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5be49901-5d52-4802-8cfc-f545b67cce6a 2024-06-27T22:46:00.838183725Z [2024-06-27T22:46:00.838+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69e4fa5f-dad0-4da2-bc9a-e81becacceb1 2024-06-27T22:46:02.036408794Z [2024-06-27T22:46:02.036+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:46:02.036803831Z [2024-06-27T22:46:02.036+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 22:44:00+00:00, run_id=scheduled__2024-06-27T22:44:00+00:00, run_start_date=2024-06-27 22:46:00.381903+00:00, run_end_date=2024-06-27 22:46:02.036328+00:00, run_duration=1.654425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:44:00+00:00, data_interval_end=2024-06-27 22:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T22:46:02.046342797Z [2024-06-27T22:46:02.046+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T22:46:00+00:00, run_after=2024-06-27T22:48:00+00:00 2024-06-27T22:46:02.195517355Z [2024-06-27T22:46:02.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:44:00+00:00 exited with status success for try_number 1 2024-06-27T22:46:02.205806388Z [2024-06-27T22:46:02.205+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T22:44:00+00:00, map_index=-1, run_start_date=2024-06-27 22:46:01.323216+00:00, run_end_date=2024-06-27 22:46:01.992309+00:00, run_duration=0.669093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=66, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:46:00.441681+00:00, queued_by_job_id=2, pid=1022 2024-06-27T22:46:03.246484230Z [2024-06-27T22:46:03.246+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:46:03.247064737Z [2024-06-27T22:46:03.246+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:45:00+00:00, run_id=scheduled__2024-06-27T22:45:00+00:00, run_start_date=2024-06-27 22:46:00.385318+00:00, run_end_date=2024-06-27 22:46:03.246361+00:00, run_duration=2.861043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:45:00+00:00, data_interval_end=2024-06-27 22:46:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:46:03.256227688Z [2024-06-27T22:46:03.255+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:46:00+00:00, run_after=2024-06-27T22:47:00+00:00 2024-06-27T22:46:03.299418466Z [2024-06-27T22:46:03.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:45:00+00:00 exited with status success for try_number 1 2024-06-27T22:46:03.309859986Z [2024-06-27T22:46:03.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:45:00+00:00, map_index=-1, run_start_date=2024-06-27 22:46:01.662666+00:00, run_end_date=2024-06-27 22:46:02.264534+00:00, run_duration=0.601868, state=success, executor_state=success, try_number=1, max_tries=1, job_id=67, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:46:00.441681+00:00, queued_by_job_id=2, pid=1023 2024-06-27T22:46:04.875061294Z [2024-06-27T22:46:04.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:46:04.875448647Z [2024-06-27T22:46:04.875+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:45:00+00:00, run_id=scheduled__2024-06-27T22:45:00+00:00, run_start_date=2024-06-27 22:46:00.383276+00:00, run_end_date=2024-06-27 22:46:04.875142+00:00, run_duration=4.491866, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:45:00+00:00, data_interval_end=2024-06-27 22:46:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:46:04.888838947Z [2024-06-27T22:46:04.888+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:46:00+00:00, run_after=2024-06-27T22:47:00+00:00 2024-06-27T22:46:04.933761291Z [2024-06-27T22:46:04.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:45:00+00:00 exited with status success for try_number 1 2024-06-27T22:46:04.943646165Z [2024-06-27T22:46:04.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:45:00+00:00, map_index=-1, run_start_date=2024-06-27 22:46:02.815235+00:00, run_end_date=2024-06-27 22:46:04.077018+00:00, run_duration=1.261783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=68, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:46:00.441681+00:00, queued_by_job_id=2, pid=1041 2024-06-27T22:46:06.201082302Z [2024-06-27T22:46:06.200+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:46:06.201438331Z [2024-06-27T22:46:06.201+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:45:00+00:00, run_id=scheduled__2024-06-27T22:45:00+00:00, run_start_date=2024-06-27 22:46:00.384355+00:00, run_end_date=2024-06-27 22:46:06.201061+00:00, run_duration=5.816706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:45:00+00:00, data_interval_end=2024-06-27 22:46:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:46:06.241929936Z [2024-06-27T22:46:06.241+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:46:00+00:00, run_after=2024-06-27T22:47:00+00:00 2024-06-27T22:46:06.295071677Z [2024-06-27T22:46:06.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:45:00+00:00 exited with status success for try_number 1 2024-06-27T22:46:06.304835150Z [2024-06-27T22:46:06.304+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:45:00+00:00, map_index=-1, run_start_date=2024-06-27 22:46:03.176464+00:00, run_end_date=2024-06-27 22:46:05.529250+00:00, run_duration=2.352786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=69, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:46:00.441681+00:00, queued_by_job_id=2, pid=1052 2024-06-27T22:46:43.998059900Z [2024-06-27T22:46:43.997+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T22:47:00.823452215Z [2024-06-27T22:47:00.822+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:47:00+00:00, run_after=2024-06-27T22:48:00+00:00 2024-06-27T22:47:00.832224200Z [2024-06-27T22:47:00.831+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:47:00.853886478Z [2024-06-27T22:47:00.853+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:47:00+00:00, run_after=2024-06-27T22:48:00+00:00 2024-06-27T22:47:00.935187938Z [2024-06-27T22:47:00.934+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T22:47:00.935207775Z 2024-06-27T22:47:00.935212379Z 2024-06-27T22:47:00.935216171Z 2024-06-27T22:47:00.935314474Z [2024-06-27T22:47:00.935+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:47:00.935487907Z [2024-06-27T22:47:00.935+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:47:00.935613440Z [2024-06-27T22:47:00.935+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:47:00.936190138Z [2024-06-27T22:47:00.935+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:47:00.936210559Z 2024-06-27T22:47:00.936217393Z 2024-06-27T22:47:00.936223547Z 2024-06-27T22:47:00.939456354Z [2024-06-27T22:47:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:47:00.939631669Z [2024-06-27T22:47:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:47:00.939936849Z [2024-06-27T22:47:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:47:00.940100321Z [2024-06-27T22:47:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:47:00.940367083Z [2024-06-27T22:47:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:47:00.940611868Z [2024-06-27T22:47:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:47:01.255710402Z [2024-06-27T22:47:01.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:46:00+00:00 exited with status queued for try_number 1 2024-06-27T22:47:01.257278083Z [2024-06-27T22:47:01.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:46:00+00:00 exited with status queued for try_number 1 2024-06-27T22:47:01.257423358Z [2024-06-27T22:47:01.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:46:00+00:00 exited with status queued for try_number 1 2024-06-27T22:47:01.268309244Z [2024-06-27T22:47:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbd2006b-8c56-4e1f-8b6f-bbc59ee6c1b2 2024-06-27T22:47:01.268638337Z [2024-06-27T22:47:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18b5a513-adc8-4603-9e4c-8a5597ac1363 2024-06-27T22:47:01.268885183Z [2024-06-27T22:47:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3962a162-0d3f-4aa9-a421-4364fb78e964 2024-06-27T22:47:02.474606389Z [2024-06-27T22:47:02.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:47:02.475127938Z [2024-06-27T22:47:02.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:46:00+00:00, run_id=scheduled__2024-06-27T22:46:00+00:00, run_start_date=2024-06-27 22:47:00.868767+00:00, run_end_date=2024-06-27 22:47:02.474517+00:00, run_duration=1.60575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:46:00+00:00, data_interval_end=2024-06-27 22:47:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:47:02.490249047Z [2024-06-27T22:47:02.489+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:47:00+00:00, run_after=2024-06-27T22:48:00+00:00 2024-06-27T22:47:02.528334558Z [2024-06-27T22:47:02.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:46:00+00:00 exited with status success for try_number 1 2024-06-27T22:47:02.533555533Z [2024-06-27T22:47:02.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:46:00+00:00, map_index=-1, run_start_date=2024-06-27 22:47:01.841745+00:00, run_end_date=2024-06-27 22:47:02.280555+00:00, run_duration=0.43881, state=success, executor_state=success, try_number=1, max_tries=1, job_id=70, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:47:00.936854+00:00, queued_by_job_id=2, pid=1079 2024-06-27T22:47:05.210238054Z [2024-06-27T22:47:05.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:47:05.211596212Z [2024-06-27T22:47:05.211+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:46:00+00:00, run_id=scheduled__2024-06-27T22:46:00+00:00, run_start_date=2024-06-27 22:47:00.866384+00:00, run_end_date=2024-06-27 22:47:05.211152+00:00, run_duration=4.344768, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:46:00+00:00, data_interval_end=2024-06-27 22:47:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:47:05.244713706Z [2024-06-27T22:47:05.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:47:00+00:00, run_after=2024-06-27T22:48:00+00:00 2024-06-27T22:47:05.290983293Z [2024-06-27T22:47:05.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:46:00+00:00 exited with status success for try_number 1 2024-06-27T22:47:05.298469684Z [2024-06-27T22:47:05.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:46:00+00:00, map_index=-1, run_start_date=2024-06-27 22:47:02.946736+00:00, run_end_date=2024-06-27 22:47:04.307018+00:00, run_duration=1.360282, state=success, executor_state=success, try_number=1, max_tries=1, job_id=72, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:47:00.936854+00:00, queued_by_job_id=2, pid=1098 2024-06-27T22:47:06.345817874Z [2024-06-27T22:47:06.345+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:47:06.346187088Z [2024-06-27T22:47:06.345+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:46:00+00:00, run_id=scheduled__2024-06-27T22:46:00+00:00, run_start_date=2024-06-27 22:47:00.867740+00:00, run_end_date=2024-06-27 22:47:06.345854+00:00, run_duration=5.478114, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:46:00+00:00, data_interval_end=2024-06-27 22:47:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:47:06.354389817Z [2024-06-27T22:47:06.354+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:47:00+00:00, run_after=2024-06-27T22:48:00+00:00 2024-06-27T22:47:06.388756286Z [2024-06-27T22:47:06.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:46:00+00:00 exited with status success for try_number 1 2024-06-27T22:47:06.409280111Z [2024-06-27T22:47:06.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:46:00+00:00, map_index=-1, run_start_date=2024-06-27 22:47:02.944627+00:00, run_end_date=2024-06-27 22:47:06.132874+00:00, run_duration=3.188247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=71, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:47:00.936854+00:00, queued_by_job_id=2, pid=1097 2024-06-27T22:48:00.270573927Z [2024-06-27T22:48:00.270+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:48:00.285120976Z [2024-06-27T22:48:00.284+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:48:00+00:00, run_after=2024-06-27T22:49:00+00:00 2024-06-27T22:48:00.302499818Z [2024-06-27T22:48:00.302+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:48:00+00:00, run_after=2024-06-27T22:49:00+00:00 2024-06-27T22:48:00.311180688Z [2024-06-27T22:48:00.310+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:48:00.386432218Z [2024-06-27T22:48:00.386+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T22:48:00.386440995Z 2024-06-27T22:48:00.386448109Z 2024-06-27T22:48:00.386451991Z 2024-06-27T22:48:00.386455566Z 2024-06-27T22:48:00.386580314Z [2024-06-27T22:48:00.386+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T22:48:00.386759819Z [2024-06-27T22:48:00.386+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:48:00.386970955Z [2024-06-27T22:48:00.386+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:48:00.387228284Z [2024-06-27T22:48:00.386+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:48:00.387715184Z [2024-06-27T22:48:00.387+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:48:00.387725019Z 2024-06-27T22:48:00.387728668Z 2024-06-27T22:48:00.387732071Z 2024-06-27T22:48:00.387735450Z 2024-06-27T22:48:00.398299737Z [2024-06-27T22:48:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:48:00.398785124Z [2024-06-27T22:48:00.398+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T22:48:00.399050192Z [2024-06-27T22:48:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:48:00.399195352Z [2024-06-27T22:48:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:48:00.399410366Z [2024-06-27T22:48:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:48:00.399537251Z [2024-06-27T22:48:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:48:00.399750352Z [2024-06-27T22:48:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:48:00.399891805Z [2024-06-27T22:48:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:48:00.685539433Z [2024-06-27T22:48:00.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:46:00+00:00 exited with status queued for try_number 1 2024-06-27T22:48:00.687887052Z [2024-06-27T22:48:00.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:47:00+00:00 exited with status queued for try_number 1 2024-06-27T22:48:00.688039319Z [2024-06-27T22:48:00.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:47:00+00:00 exited with status queued for try_number 1 2024-06-27T22:48:00.688179550Z [2024-06-27T22:48:00.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:47:00+00:00 exited with status queued for try_number 1 2024-06-27T22:48:00.702069295Z [2024-06-27T22:48:00.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb2433c4-c8c2-4eb6-a8dc-2657e8300e5f 2024-06-27T22:48:00.703301073Z [2024-06-27T22:48:00.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6579988f-d101-46d5-96db-edfaed13a06c 2024-06-27T22:48:00.703515814Z [2024-06-27T22:48:00.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f190add-928f-432e-8919-3858191e8f0f 2024-06-27T22:48:00.703701945Z [2024-06-27T22:48:00.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12c5a859-9073-4bb1-8f6d-724eda880254 2024-06-27T22:48:02.204528931Z [2024-06-27T22:48:02.204+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:48:02.205618651Z [2024-06-27T22:48:02.205+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 22:46:00+00:00, run_id=scheduled__2024-06-27T22:46:00+00:00, run_start_date=2024-06-27 22:48:00.321696+00:00, run_end_date=2024-06-27 22:48:02.205028+00:00, run_duration=1.883332, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:46:00+00:00, data_interval_end=2024-06-27 22:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T22:48:02.214289041Z [2024-06-27T22:48:02.214+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T22:48:00+00:00, run_after=2024-06-27T22:50:00+00:00 2024-06-27T22:48:02.314142364Z [2024-06-27T22:48:02.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:46:00+00:00 exited with status success for try_number 1 2024-06-27T22:48:02.319579211Z [2024-06-27T22:48:02.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T22:46:00+00:00, map_index=-1, run_start_date=2024-06-27 22:48:01.321726+00:00, run_end_date=2024-06-27 22:48:01.823597+00:00, run_duration=0.501871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=73, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:48:00.395653+00:00, queued_by_job_id=2, pid=1130 2024-06-27T22:48:03.412550795Z [2024-06-27T22:48:03.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:48:03.412808003Z [2024-06-27T22:48:03.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:47:00+00:00, run_id=scheduled__2024-06-27T22:47:00+00:00, run_start_date=2024-06-27 22:48:00.323972+00:00, run_end_date=2024-06-27 22:48:03.412550+00:00, run_duration=3.088578, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:47:00+00:00, data_interval_end=2024-06-27 22:48:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:48:03.422675983Z [2024-06-27T22:48:03.422+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:48:00+00:00, run_after=2024-06-27T22:49:00+00:00 2024-06-27T22:48:03.481035198Z [2024-06-27T22:48:03.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:47:00+00:00 exited with status success for try_number 1 2024-06-27T22:48:03.488857318Z [2024-06-27T22:48:03.488+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:47:00+00:00, map_index=-1, run_start_date=2024-06-27 22:48:01.615280+00:00, run_end_date=2024-06-27 22:48:02.254636+00:00, run_duration=0.639356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=74, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:48:00.395653+00:00, queued_by_job_id=2, pid=1131 2024-06-27T22:48:04.417447469Z [2024-06-27T22:48:04.417+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:48:04.417839929Z [2024-06-27T22:48:04.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:47:00+00:00, run_id=scheduled__2024-06-27T22:47:00+00:00, run_start_date=2024-06-27 22:48:00.322884+00:00, run_end_date=2024-06-27 22:48:04.417546+00:00, run_duration=4.094662, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:47:00+00:00, data_interval_end=2024-06-27 22:48:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:48:04.439069016Z [2024-06-27T22:48:04.438+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:48:00+00:00, run_after=2024-06-27T22:49:00+00:00 2024-06-27T22:48:04.502144577Z [2024-06-27T22:48:04.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:47:00+00:00 exited with status success for try_number 1 2024-06-27T22:48:04.511809244Z [2024-06-27T22:48:04.511+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:47:00+00:00, map_index=-1, run_start_date=2024-06-27 22:48:02.715786+00:00, run_end_date=2024-06-27 22:48:04.244831+00:00, run_duration=1.529045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=75, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:48:00.395653+00:00, queued_by_job_id=2, pid=1149 2024-06-27T22:48:05.574954502Z [2024-06-27T22:48:05.573+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:48:05.574979294Z [2024-06-27T22:48:05.573+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:47:00+00:00, run_id=scheduled__2024-06-27T22:47:00+00:00, run_start_date=2024-06-27 22:48:00.325066+00:00, run_end_date=2024-06-27 22:48:05.573751+00:00, run_duration=5.248685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:47:00+00:00, data_interval_end=2024-06-27 22:48:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:48:05.589916180Z [2024-06-27T22:48:05.586+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:48:00+00:00, run_after=2024-06-27T22:49:00+00:00 2024-06-27T22:48:05.632836781Z [2024-06-27T22:48:05.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:47:00+00:00 exited with status success for try_number 1 2024-06-27T22:48:05.640350757Z [2024-06-27T22:48:05.639+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:47:00+00:00, map_index=-1, run_start_date=2024-06-27 22:48:03.049515+00:00, run_end_date=2024-06-27 22:48:05.314565+00:00, run_duration=2.26505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=76, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:48:00.395653+00:00, queued_by_job_id=2, pid=1160 2024-06-27T22:49:00.208145940Z [2024-06-27T22:49:00.207+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:49:00.228243235Z [2024-06-27T22:49:00.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:49:00+00:00, run_after=2024-06-27T22:50:00+00:00 2024-06-27T22:49:00.241573498Z [2024-06-27T22:49:00.241+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:49:00+00:00, run_after=2024-06-27T22:50:00+00:00 2024-06-27T22:49:00.295782629Z [2024-06-27T22:49:00.295+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T22:49:00.295810965Z 2024-06-27T22:49:00.295817112Z 2024-06-27T22:49:00.295822297Z 2024-06-27T22:49:00.295983193Z [2024-06-27T22:49:00.295+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:49:00.296153265Z [2024-06-27T22:49:00.296+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:49:00.296294368Z [2024-06-27T22:49:00.296+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:49:00.296883518Z [2024-06-27T22:49:00.296+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:49:00.296894434Z 2024-06-27T22:49:00.296899724Z 2024-06-27T22:49:00.296905164Z 2024-06-27T22:49:00.299554808Z [2024-06-27T22:49:00.299+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:49:00.299813988Z [2024-06-27T22:49:00.299+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:49:00.300127301Z [2024-06-27T22:49:00.299+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:49:00.300350964Z [2024-06-27T22:49:00.300+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:49:00.300631793Z [2024-06-27T22:49:00.300+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:49:00.300800407Z [2024-06-27T22:49:00.300+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:49:00.560507202Z [2024-06-27T22:49:00.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:48:00+00:00 exited with status queued for try_number 1 2024-06-27T22:49:00.560889872Z [2024-06-27T22:49:00.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:48:00+00:00 exited with status queued for try_number 1 2024-06-27T22:49:00.561210598Z [2024-06-27T22:49:00.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:48:00+00:00 exited with status queued for try_number 1 2024-06-27T22:49:00.567804305Z [2024-06-27T22:49:00.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to 039dd132-e889-4396-8300-c15c9e3a7ed0 2024-06-27T22:49:00.568079341Z [2024-06-27T22:49:00.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ffd6e0c-946b-4754-ade5-12ce904bcfc5 2024-06-27T22:49:00.568302441Z [2024-06-27T22:49:00.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1eaeed7d-6f33-45a3-896a-4e9c9f9111e0 2024-06-27T22:49:01.729717305Z [2024-06-27T22:49:01.729+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:49:01.730012982Z [2024-06-27T22:49:01.729+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:48:00+00:00, run_id=scheduled__2024-06-27T22:48:00+00:00, run_start_date=2024-06-27 22:49:00.252762+00:00, run_end_date=2024-06-27 22:49:01.729670+00:00, run_duration=1.476908, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:48:00+00:00, data_interval_end=2024-06-27 22:49:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:49:01.762174622Z [2024-06-27T22:49:01.761+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:49:00+00:00, run_after=2024-06-27T22:50:00+00:00 2024-06-27T22:49:01.799062878Z [2024-06-27T22:49:01.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:48:00+00:00 exited with status success for try_number 1 2024-06-27T22:49:01.804703727Z [2024-06-27T22:49:01.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:48:00+00:00, map_index=-1, run_start_date=2024-06-27 22:49:01.074318+00:00, run_end_date=2024-06-27 22:49:01.470337+00:00, run_duration=0.396019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=77, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:49:00.297535+00:00, queued_by_job_id=2, pid=1187 2024-06-27T22:49:04.278958952Z [2024-06-27T22:49:04.278+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:49:04.279202594Z [2024-06-27T22:49:04.278+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:48:00+00:00, run_id=scheduled__2024-06-27T22:48:00+00:00, run_start_date=2024-06-27 22:49:00.251800+00:00, run_end_date=2024-06-27 22:49:04.278895+00:00, run_duration=4.027095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:48:00+00:00, data_interval_end=2024-06-27 22:49:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:49:04.289557146Z [2024-06-27T22:49:04.288+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:49:00+00:00, run_after=2024-06-27T22:50:00+00:00 2024-06-27T22:49:04.346519949Z [2024-06-27T22:49:04.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:48:00+00:00 exited with status success for try_number 1 2024-06-27T22:49:04.359970237Z [2024-06-27T22:49:04.359+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:48:00+00:00, map_index=-1, run_start_date=2024-06-27 22:49:02.526284+00:00, run_end_date=2024-06-27 22:49:03.808947+00:00, run_duration=1.282663, state=success, executor_state=success, try_number=1, max_tries=1, job_id=78, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:49:00.297535+00:00, queued_by_job_id=2, pid=1205 2024-06-27T22:49:04.763351650Z [2024-06-27T22:49:04.763+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:49:04.763694230Z [2024-06-27T22:49:04.763+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:48:00+00:00, run_id=scheduled__2024-06-27T22:48:00+00:00, run_start_date=2024-06-27 22:49:00.250679+00:00, run_end_date=2024-06-27 22:49:04.763422+00:00, run_duration=4.512743, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:48:00+00:00, data_interval_end=2024-06-27 22:49:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:49:04.771906986Z [2024-06-27T22:49:04.771+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:49:00+00:00, run_after=2024-06-27T22:50:00+00:00 2024-06-27T22:49:04.859280835Z [2024-06-27T22:49:04.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:48:00+00:00 exited with status success for try_number 1 2024-06-27T22:49:04.863846042Z [2024-06-27T22:49:04.863+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:48:00+00:00, map_index=-1, run_start_date=2024-06-27 22:49:02.546423+00:00, run_end_date=2024-06-27 22:49:04.253090+00:00, run_duration=1.706667, state=success, executor_state=success, try_number=1, max_tries=1, job_id=79, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:49:00.297535+00:00, queued_by_job_id=2, pid=1206 2024-06-27T22:50:00.036091913Z [2024-06-27T22:50:00.035+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:50:00.043220886Z [2024-06-27T22:50:00.042+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:50:00.055901923Z [2024-06-27T22:50:00.055+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:50:00+00:00, run_after=2024-06-27T22:51:00+00:00 2024-06-27T22:50:00.070500170Z [2024-06-27T22:50:00.070+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:50:00+00:00, run_after=2024-06-27T22:51:00+00:00 2024-06-27T22:50:00.082934325Z [2024-06-27T22:50:00.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:50:00+00:00, run_after=2024-06-27T22:55:00+00:00 2024-06-27T22:50:00.169720886Z [2024-06-27T22:50:00.169+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T22:50:00.169753782Z 2024-06-27T22:50:00.169757437Z 2024-06-27T22:50:00.169762321Z 2024-06-27T22:50:00.169765667Z 2024-06-27T22:50:00.169768915Z 2024-06-27T22:50:00.169787492Z [2024-06-27T22:50:00.169+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:50:00.169999678Z [2024-06-27T22:50:00.169+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T22:50:00.170178128Z [2024-06-27T22:50:00.170+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:50:00.170296228Z [2024-06-27T22:50:00.170+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:50:00.170417252Z [2024-06-27T22:50:00.170+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:50:00.170998218Z [2024-06-27T22:50:00.170+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:50:00.171010852Z 2024-06-27T22:50:00.171038118Z 2024-06-27T22:50:00.171041745Z 2024-06-27T22:50:00.171044752Z 2024-06-27T22:50:00.171047791Z 2024-06-27T22:50:00.176825049Z [2024-06-27T22:50:00.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T22:50:00.176994999Z [2024-06-27T22:50:00.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:50:00.177243077Z [2024-06-27T22:50:00.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:50:00.177374867Z [2024-06-27T22:50:00.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T22:50:00.177588950Z [2024-06-27T22:50:00.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:50:00.177713283Z [2024-06-27T22:50:00.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:50:00.177939884Z [2024-06-27T22:50:00.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:50:00.178074853Z [2024-06-27T22:50:00.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:50:00.178273930Z [2024-06-27T22:50:00.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:50:00.178393154Z [2024-06-27T22:50:00.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:50:00.786285221Z [2024-06-27T22:50:00.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:45:00+00:00 exited with status queued for try_number 1 2024-06-27T22:50:00.786530779Z [2024-06-27T22:50:00.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:48:00+00:00 exited with status queued for try_number 1 2024-06-27T22:50:00.786784846Z [2024-06-27T22:50:00.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:49:00+00:00 exited with status queued for try_number 1 2024-06-27T22:50:00.787036191Z [2024-06-27T22:50:00.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:49:00+00:00 exited with status queued for try_number 1 2024-06-27T22:50:00.787202965Z [2024-06-27T22:50:00.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:49:00+00:00 exited with status queued for try_number 1 2024-06-27T22:50:00.806638748Z [2024-06-27T22:50:00.806+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ebf13e5-5212-4120-90c9-52076fbaf3be 2024-06-27T22:50:00.807023284Z [2024-06-27T22:50:00.806+0000] {scheduler_job.py:635} INFO - Setting external_id for to de84d169-b0fc-43ee-b3f6-53bb36fed798 2024-06-27T22:50:00.807262536Z [2024-06-27T22:50:00.807+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b44fdf1-f352-4764-b4c7-84ba9f329a53 2024-06-27T22:50:00.807506723Z [2024-06-27T22:50:00.807+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4957e235-ab95-4d33-a617-eb20ad8a9910 2024-06-27T22:50:00.807866673Z [2024-06-27T22:50:00.807+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e5e3a49-3caf-49d4-b2e7-830b7e293a73 2024-06-27T22:50:02.621518002Z [2024-06-27T22:50:02.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:50:02.622159130Z [2024-06-27T22:50:02.621+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 22:48:00+00:00, run_id=scheduled__2024-06-27T22:48:00+00:00, run_start_date=2024-06-27 22:50:00.096461+00:00, run_end_date=2024-06-27 22:50:02.621417+00:00, run_duration=2.524956, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:48:00+00:00, data_interval_end=2024-06-27 22:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T22:50:02.636826258Z [2024-06-27T22:50:02.636+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T22:50:00+00:00, run_after=2024-06-27T22:52:00+00:00 2024-06-27T22:50:02.644687963Z [2024-06-27T22:50:02.644+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:50:02.646022859Z [2024-06-27T22:50:02.645+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:49:00+00:00, run_id=scheduled__2024-06-27T22:49:00+00:00, run_start_date=2024-06-27 22:50:00.098389+00:00, run_end_date=2024-06-27 22:50:02.645653+00:00, run_duration=2.547264, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:49:00+00:00, data_interval_end=2024-06-27 22:50:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:50:02.678759891Z [2024-06-27T22:50:02.678+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:50:00+00:00, run_after=2024-06-27T22:51:00+00:00 2024-06-27T22:50:02.740930223Z [2024-06-27T22:50:02.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:48:00+00:00 exited with status success for try_number 1 2024-06-27T22:50:02.740989770Z [2024-06-27T22:50:02.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:49:00+00:00 exited with status success for try_number 1 2024-06-27T22:50:02.752129192Z [2024-06-27T22:50:02.751+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T22:48:00+00:00, map_index=-1, run_start_date=2024-06-27 22:50:01.499845+00:00, run_end_date=2024-06-27 22:50:02.112400+00:00, run_duration=0.612555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=81, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:50:00.171963+00:00, queued_by_job_id=2, pid=1241 2024-06-27T22:50:02.752566544Z [2024-06-27T22:50:02.752+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:49:00+00:00, map_index=-1, run_start_date=2024-06-27 22:50:01.499536+00:00, run_end_date=2024-06-27 22:50:02.215295+00:00, run_duration=0.715759, state=success, executor_state=success, try_number=1, max_tries=1, job_id=80, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:50:00.171963+00:00, queued_by_job_id=2, pid=1240 2024-06-27T22:50:03.981057608Z [2024-06-27T22:50:03.980+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:50:03.981084901Z 2024-06-27T22:50:03.981183117Z [2024-06-27T22:50:03.981+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:50:03.982226068Z [2024-06-27T22:50:03.981+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:50:03.982238950Z 2024-06-27T22:50:03.986565019Z [2024-06-27T22:50:03.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-27T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T22:50:03.986833629Z [2024-06-27T22:50:03.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-27T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:50:04.057097702Z [2024-06-27T22:50:04.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T22:45:00+00:00 exited with status queued for try_number 1 2024-06-27T22:50:04.057126826Z [2024-06-27T22:50:04.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:45:00+00:00 exited with status success for try_number 1 2024-06-27T22:50:04.066267018Z [2024-06-27T22:50:04.065+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbcaf741-f5be-4559-a126-eeb19b2fbfeb 2024-06-27T22:50:04.066459538Z [2024-06-27T22:50:04.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T22:45:00+00:00, map_index=-1, run_start_date=2024-06-27 22:50:03.129659+00:00, run_end_date=2024-06-27 22:50:03.710594+00:00, run_duration=0.580935, state=success, executor_state=success, try_number=1, max_tries=1, job_id=83, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:50:00.171963+00:00, queued_by_job_id=2, pid=1271 2024-06-27T22:50:05.164108821Z [2024-06-27T22:50:05.163+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:50:05.164307880Z [2024-06-27T22:50:05.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:49:00+00:00, run_id=scheduled__2024-06-27T22:49:00+00:00, run_start_date=2024-06-27 22:50:00.099397+00:00, run_end_date=2024-06-27 22:50:05.164041+00:00, run_duration=5.064644, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:49:00+00:00, data_interval_end=2024-06-27 22:50:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:50:05.200811226Z [2024-06-27T22:50:05.200+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:50:00+00:00, run_after=2024-06-27T22:51:00+00:00 2024-06-27T22:50:05.378261679Z [2024-06-27T22:50:05.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:49:00+00:00 exited with status success for try_number 1 2024-06-27T22:50:05.403812934Z [2024-06-27T22:50:05.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:49:00+00:00, map_index=-1, run_start_date=2024-06-27 22:50:02.995447+00:00, run_end_date=2024-06-27 22:50:04.553202+00:00, run_duration=1.557755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=82, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:50:00.171963+00:00, queued_by_job_id=2, pid=1270 2024-06-27T22:50:06.473962834Z [2024-06-27T22:50:06.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:50:06.475169208Z [2024-06-27T22:50:06.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:49:00+00:00, run_id=scheduled__2024-06-27T22:49:00+00:00, run_start_date=2024-06-27 22:50:00.097448+00:00, run_end_date=2024-06-27 22:50:06.474809+00:00, run_duration=6.377361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:49:00+00:00, data_interval_end=2024-06-27 22:50:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:50:06.484508909Z [2024-06-27T22:50:06.484+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:50:00+00:00, run_after=2024-06-27T22:51:00+00:00 2024-06-27T22:50:06.563225841Z [2024-06-27T22:50:06.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:49:00+00:00 exited with status success for try_number 1 2024-06-27T22:50:06.569843259Z [2024-06-27T22:50:06.569+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:49:00+00:00, map_index=-1, run_start_date=2024-06-27 22:50:03.236472+00:00, run_end_date=2024-06-27 22:50:05.150283+00:00, run_duration=1.913811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=84, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:50:00.171963+00:00, queued_by_job_id=2, pid=1272 2024-06-27T22:50:07.634961088Z [2024-06-27T22:50:07.634+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:50:07.635017508Z 2024-06-27T22:50:07.635029804Z [2024-06-27T22:50:07.634+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:50:07.635561829Z [2024-06-27T22:50:07.635+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:50:07.635568878Z 2024-06-27T22:50:07.639391810Z [2024-06-27T22:50:07.639+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-27T22:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T22:50:07.639479694Z [2024-06-27T22:50:07.639+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-27T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T22:50:07.697195560Z [2024-06-27T22:50:07.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T22:45:00+00:00 exited with status queued for try_number 1 2024-06-27T22:50:07.697292960Z [2024-06-27T22:50:07.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T22:45:00+00:00 exited with status success for try_number 1 2024-06-27T22:50:07.716353758Z [2024-06-27T22:50:07.716+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-27T22:45:00+00:00, map_index=-1, run_start_date=2024-06-27 22:50:06.033921+00:00, run_end_date=2024-06-27 22:50:06.512667+00:00, run_duration=0.478746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=85, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:50:03.983330+00:00, queued_by_job_id=2, pid=1295 2024-06-27T22:50:07.716740131Z [2024-06-27T22:50:07.716+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d816778-ebd1-4c8d-a68f-773b16a5a34d 2024-06-27T22:50:10.256483822Z [2024-06-27T22:50:10.256+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:50:10.256499517Z 2024-06-27T22:50:10.267466704Z [2024-06-27T22:50:10.267+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:50:10.268475296Z [2024-06-27T22:50:10.268+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:50:10.268487257Z 2024-06-27T22:50:10.272575534Z [2024-06-27T22:50:10.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-27T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:50:10.273042945Z [2024-06-27T22:50:10.272+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-27T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:50:10.371385929Z [2024-06-27T22:50:10.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T22:45:00+00:00 exited with status queued for try_number 1 2024-06-27T22:50:10.371409404Z [2024-06-27T22:50:10.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T22:45:00+00:00 exited with status success for try_number 1 2024-06-27T22:50:10.377411252Z [2024-06-27T22:50:10.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-27T22:45:00+00:00, map_index=0, run_start_date=2024-06-27 22:50:09.657519+00:00, run_end_date=2024-06-27 22:50:09.995305+00:00, run_duration=0.337786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=86, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:50:07.635800+00:00, queued_by_job_id=2, pid=1303 2024-06-27T22:50:10.377508467Z [2024-06-27T22:50:10.377+0000] {scheduler_job.py:635} INFO - Setting external_id for to 139f36f0-bde4-449b-9a76-890ccc22be52 2024-06-27T22:50:12.631721126Z [2024-06-27T22:50:12.630+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:50:12.631781288Z [2024-06-27T22:50:12.631+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:45:00+00:00, run_id=scheduled__2024-06-27T22:45:00+00:00, run_start_date=2024-06-27 22:50:00.095179+00:00, run_end_date=2024-06-27 22:50:12.631280+00:00, run_duration=12.536101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:45:00+00:00, data_interval_end=2024-06-27 22:50:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-27T22:50:12.638339272Z [2024-06-27T22:50:12.638+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:50:00+00:00, run_after=2024-06-27T22:55:00+00:00 2024-06-27T22:50:12.703745167Z [2024-06-27T22:50:12.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T22:45:00+00:00 exited with status success for try_number 1 2024-06-27T22:50:12.703762659Z [2024-06-27T22:50:12.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-27T22:45:00+00:00, map_index=-1, run_start_date=2024-06-27 22:50:12.103113+00:00, run_end_date=2024-06-27 22:50:12.432773+00:00, run_duration=0.32966, state=success, executor_state=success, try_number=1, max_tries=1, job_id=87, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:50:10.269210+00:00, queued_by_job_id=2, pid=1311 2024-06-27T22:51:00.988151784Z [2024-06-27T22:51:00.987+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:51:00+00:00, run_after=2024-06-27T22:52:00+00:00 2024-06-27T22:51:01.011301162Z [2024-06-27T22:51:01.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:51:00+00:00, run_after=2024-06-27T22:52:00+00:00 2024-06-27T22:51:01.024206021Z [2024-06-27T22:51:01.023+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:51:01.134167510Z [2024-06-27T22:51:01.133+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T22:51:01.134186829Z 2024-06-27T22:51:01.134190893Z 2024-06-27T22:51:01.134195934Z 2024-06-27T22:51:01.134305493Z [2024-06-27T22:51:01.134+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:51:01.134446181Z [2024-06-27T22:51:01.134+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:51:01.134527099Z [2024-06-27T22:51:01.134+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:51:01.135374325Z [2024-06-27T22:51:01.135+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:51:01.135391165Z 2024-06-27T22:51:01.135398154Z 2024-06-27T22:51:01.135420172Z 2024-06-27T22:51:01.138803451Z [2024-06-27T22:51:01.138+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:51:01.138956109Z [2024-06-27T22:51:01.138+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:51:01.139348329Z [2024-06-27T22:51:01.139+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:51:01.139508704Z [2024-06-27T22:51:01.139+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:51:01.139755298Z [2024-06-27T22:51:01.139+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:51:01.139835138Z [2024-06-27T22:51:01.139+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:51:01.449115845Z [2024-06-27T22:51:01.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:50:00+00:00 exited with status queued for try_number 1 2024-06-27T22:51:01.449446739Z [2024-06-27T22:51:01.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:50:00+00:00 exited with status queued for try_number 1 2024-06-27T22:51:01.449698347Z [2024-06-27T22:51:01.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:50:00+00:00 exited with status queued for try_number 1 2024-06-27T22:51:01.458953702Z [2024-06-27T22:51:01.458+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09161c40-2e26-4cf7-a2be-5ab6e190c826 2024-06-27T22:51:01.459403231Z [2024-06-27T22:51:01.459+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfea5afc-ea1f-4120-918d-b07dfcc2aa28 2024-06-27T22:51:01.459673246Z [2024-06-27T22:51:01.459+0000] {scheduler_job.py:635} INFO - Setting external_id for to 714ae730-1fec-40ed-8f28-81d882ce4c99 2024-06-27T22:51:02.700112004Z [2024-06-27T22:51:02.699+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:51:02.700786352Z [2024-06-27T22:51:02.700+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:50:00+00:00, run_id=scheduled__2024-06-27T22:50:00+00:00, run_start_date=2024-06-27 22:51:01.047534+00:00, run_end_date=2024-06-27 22:51:02.700290+00:00, run_duration=1.652756, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:50:00+00:00, data_interval_end=2024-06-27 22:51:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:51:02.718924902Z [2024-06-27T22:51:02.718+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:51:00+00:00, run_after=2024-06-27T22:52:00+00:00 2024-06-27T22:51:02.825174210Z [2024-06-27T22:51:02.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:50:00+00:00 exited with status success for try_number 1 2024-06-27T22:51:02.830277266Z [2024-06-27T22:51:02.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:50:00+00:00, map_index=-1, run_start_date=2024-06-27 22:51:02.084913+00:00, run_end_date=2024-06-27 22:51:02.520756+00:00, run_duration=0.435843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=88, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:51:01.136112+00:00, queued_by_job_id=2, pid=1333 2024-06-27T22:51:05.024072105Z [2024-06-27T22:51:05.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:51:05.024495117Z [2024-06-27T22:51:05.024+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:50:00+00:00, run_id=scheduled__2024-06-27T22:50:00+00:00, run_start_date=2024-06-27 22:51:01.049850+00:00, run_end_date=2024-06-27 22:51:05.024053+00:00, run_duration=3.974203, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:50:00+00:00, data_interval_end=2024-06-27 22:51:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:51:05.036958128Z [2024-06-27T22:51:05.036+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:51:00+00:00, run_after=2024-06-27T22:52:00+00:00 2024-06-27T22:51:05.085408364Z [2024-06-27T22:51:05.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:50:00+00:00 exited with status success for try_number 1 2024-06-27T22:51:05.093813662Z [2024-06-27T22:51:05.093+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:50:00+00:00, map_index=-1, run_start_date=2024-06-27 22:51:03.345827+00:00, run_end_date=2024-06-27 22:51:04.764812+00:00, run_duration=1.418985, state=success, executor_state=success, try_number=1, max_tries=1, job_id=89, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:51:01.136112+00:00, queued_by_job_id=2, pid=1346 2024-06-27T22:51:05.706281531Z [2024-06-27T22:51:05.705+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:51:05.706707488Z [2024-06-27T22:51:05.706+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:50:00+00:00, run_id=scheduled__2024-06-27T22:50:00+00:00, run_start_date=2024-06-27 22:51:01.051729+00:00, run_end_date=2024-06-27 22:51:05.706387+00:00, run_duration=4.654658, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:50:00+00:00, data_interval_end=2024-06-27 22:51:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:51:05.716610189Z [2024-06-27T22:51:05.716+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:51:00+00:00, run_after=2024-06-27T22:52:00+00:00 2024-06-27T22:51:05.749253601Z [2024-06-27T22:51:05.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:50:00+00:00 exited with status success for try_number 1 2024-06-27T22:51:05.754979031Z [2024-06-27T22:51:05.754+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:50:00+00:00, map_index=-1, run_start_date=2024-06-27 22:51:03.650929+00:00, run_end_date=2024-06-27 22:51:05.215528+00:00, run_duration=1.564599, state=success, executor_state=success, try_number=1, max_tries=1, job_id=90, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:51:01.136112+00:00, queued_by_job_id=2, pid=1352 2024-06-27T22:51:44.072642638Z [2024-06-27T22:51:44.072+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T22:52:00.142901665Z [2024-06-27T22:52:00.142+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:52:00.150816278Z [2024-06-27T22:52:00.150+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:52:00.164424569Z [2024-06-27T22:52:00.164+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:52:00+00:00, run_after=2024-06-27T22:53:00+00:00 2024-06-27T22:52:00.182094443Z [2024-06-27T22:52:00.181+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:52:00+00:00, run_after=2024-06-27T22:53:00+00:00 2024-06-27T22:52:00.256613607Z [2024-06-27T22:52:00.256+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T22:52:00.256633102Z 2024-06-27T22:52:00.256637542Z 2024-06-27T22:52:00.256641037Z 2024-06-27T22:52:00.256644156Z 2024-06-27T22:52:00.257008886Z [2024-06-27T22:52:00.256+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T22:52:00.257245669Z [2024-06-27T22:52:00.257+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:52:00.257458928Z [2024-06-27T22:52:00.257+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:52:00.257663555Z [2024-06-27T22:52:00.257+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:52:00.258288187Z [2024-06-27T22:52:00.258+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:52:00.258299194Z 2024-06-27T22:52:00.258302977Z 2024-06-27T22:52:00.258306059Z 2024-06-27T22:52:00.258308893Z 2024-06-27T22:52:00.261740058Z [2024-06-27T22:52:00.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:52:00.262033812Z [2024-06-27T22:52:00.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T22:52:00.262379221Z [2024-06-27T22:52:00.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:52:00.262592376Z [2024-06-27T22:52:00.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:52:00.262970654Z [2024-06-27T22:52:00.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:52:00.263218789Z [2024-06-27T22:52:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:52:00.263525645Z [2024-06-27T22:52:00.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:52:00.263729981Z [2024-06-27T22:52:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:52:00.701706998Z [2024-06-27T22:52:00.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:50:00+00:00 exited with status queued for try_number 1 2024-06-27T22:52:00.703994377Z [2024-06-27T22:52:00.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:51:00+00:00 exited with status queued for try_number 1 2024-06-27T22:52:00.704266180Z [2024-06-27T22:52:00.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:51:00+00:00 exited with status queued for try_number 1 2024-06-27T22:52:00.705938720Z [2024-06-27T22:52:00.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:51:00+00:00 exited with status queued for try_number 1 2024-06-27T22:52:00.720462387Z [2024-06-27T22:52:00.720+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa6a4d87-4cea-477c-80b5-010e77a58a89 2024-06-27T22:52:00.720857739Z [2024-06-27T22:52:00.720+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30fede04-ea27-4259-b06e-29d6c3616a67 2024-06-27T22:52:00.723813903Z [2024-06-27T22:52:00.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb4dd7fb-2d44-4802-bd1d-65774dcb7d1e 2024-06-27T22:52:00.726017780Z [2024-06-27T22:52:00.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8185553e-4039-46c3-9036-4045167ba6dc 2024-06-27T22:52:03.438091338Z [2024-06-27T22:52:03.437+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:52:03.438190635Z [2024-06-27T22:52:03.437+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 22:50:00+00:00, run_id=scheduled__2024-06-27T22:50:00+00:00, run_start_date=2024-06-27 22:52:00.198247+00:00, run_end_date=2024-06-27 22:52:03.437846+00:00, run_duration=3.239599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:50:00+00:00, data_interval_end=2024-06-27 22:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T22:52:03.449959352Z [2024-06-27T22:52:03.449+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T22:52:00+00:00, run_after=2024-06-27T22:54:00+00:00 2024-06-27T22:52:03.457338488Z [2024-06-27T22:52:03.457+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:52:03.457524566Z [2024-06-27T22:52:03.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:51:00+00:00, run_id=scheduled__2024-06-27T22:51:00+00:00, run_start_date=2024-06-27 22:52:00.204324+00:00, run_end_date=2024-06-27 22:52:03.457270+00:00, run_duration=3.252946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:51:00+00:00, data_interval_end=2024-06-27 22:52:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:52:03.467608938Z [2024-06-27T22:52:03.467+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:52:00+00:00, run_after=2024-06-27T22:53:00+00:00 2024-06-27T22:52:03.577073011Z [2024-06-27T22:52:03.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:50:00+00:00 exited with status success for try_number 1 2024-06-27T22:52:03.577160375Z [2024-06-27T22:52:03.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:51:00+00:00 exited with status success for try_number 1 2024-06-27T22:52:03.590567778Z [2024-06-27T22:52:03.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T22:50:00+00:00, map_index=-1, run_start_date=2024-06-27 22:52:02.012198+00:00, run_end_date=2024-06-27 22:52:02.748419+00:00, run_duration=0.736221, state=success, executor_state=success, try_number=1, max_tries=1, job_id=92, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:52:00.259285+00:00, queued_by_job_id=2, pid=1386 2024-06-27T22:52:03.590853463Z [2024-06-27T22:52:03.590+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:51:00+00:00, map_index=-1, run_start_date=2024-06-27 22:52:01.903425+00:00, run_end_date=2024-06-27 22:52:02.744948+00:00, run_duration=0.841523, state=success, executor_state=success, try_number=1, max_tries=1, job_id=91, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:52:00.259285+00:00, queued_by_job_id=2, pid=1385 2024-06-27T22:52:05.910198734Z [2024-06-27T22:52:05.909+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:52:05.910435541Z [2024-06-27T22:52:05.910+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:51:00+00:00, run_id=scheduled__2024-06-27T22:51:00+00:00, run_start_date=2024-06-27 22:52:00.201995+00:00, run_end_date=2024-06-27 22:52:05.910176+00:00, run_duration=5.708181, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:51:00+00:00, data_interval_end=2024-06-27 22:52:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:52:05.918773075Z [2024-06-27T22:52:05.918+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:52:00+00:00, run_after=2024-06-27T22:53:00+00:00 2024-06-27T22:52:05.926346502Z [2024-06-27T22:52:05.925+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:52:05.926367303Z [2024-06-27T22:52:05.926+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:51:00+00:00, run_id=scheduled__2024-06-27T22:51:00+00:00, run_start_date=2024-06-27 22:52:00.203285+00:00, run_end_date=2024-06-27 22:52:05.926058+00:00, run_duration=5.722773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:51:00+00:00, data_interval_end=2024-06-27 22:52:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:52:05.938079249Z [2024-06-27T22:52:05.937+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:52:00+00:00, run_after=2024-06-27T22:53:00+00:00 2024-06-27T22:52:06.177011384Z [2024-06-27T22:52:06.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:51:00+00:00 exited with status success for try_number 1 2024-06-27T22:52:06.177053440Z [2024-06-27T22:52:06.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:51:00+00:00 exited with status success for try_number 1 2024-06-27T22:52:06.194423232Z [2024-06-27T22:52:06.194+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:51:00+00:00, map_index=-1, run_start_date=2024-06-27 22:52:03.551126+00:00, run_end_date=2024-06-27 22:52:05.858381+00:00, run_duration=2.307255, state=success, executor_state=success, try_number=1, max_tries=1, job_id=93, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:52:00.259285+00:00, queued_by_job_id=2, pid=1404 2024-06-27T22:52:06.194607905Z [2024-06-27T22:52:06.194+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:51:00+00:00, map_index=-1, run_start_date=2024-06-27 22:52:04.073710+00:00, run_end_date=2024-06-27 22:52:05.858293+00:00, run_duration=1.784583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=94, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:52:00.259285+00:00, queued_by_job_id=2, pid=1415 2024-06-27T22:53:00.075585031Z [2024-06-27T22:53:00.075+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:53:00.102351115Z [2024-06-27T22:53:00.101+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:53:00+00:00, run_after=2024-06-27T22:54:00+00:00 2024-06-27T22:53:00.118567234Z [2024-06-27T22:53:00.118+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:53:00+00:00, run_after=2024-06-27T22:54:00+00:00 2024-06-27T22:53:00.184843585Z [2024-06-27T22:53:00.184+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T22:53:00.184866497Z 2024-06-27T22:53:00.184871258Z 2024-06-27T22:53:00.184875653Z 2024-06-27T22:53:00.185030111Z [2024-06-27T22:53:00.184+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:53:00.185054161Z [2024-06-27T22:53:00.184+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:53:00.185091166Z [2024-06-27T22:53:00.184+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:53:00.185558031Z [2024-06-27T22:53:00.185+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:53:00.185571533Z 2024-06-27T22:53:00.185575944Z 2024-06-27T22:53:00.185580244Z 2024-06-27T22:53:00.188639933Z [2024-06-27T22:53:00.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:53:00.188664034Z [2024-06-27T22:53:00.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:53:00.188919792Z [2024-06-27T22:53:00.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:53:00.188932932Z [2024-06-27T22:53:00.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:53:00.189119413Z [2024-06-27T22:53:00.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:53:00.189165524Z [2024-06-27T22:53:00.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:53:00.495703928Z [2024-06-27T22:53:00.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:52:00+00:00 exited with status queued for try_number 1 2024-06-27T22:53:00.497969881Z [2024-06-27T22:53:00.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:52:00+00:00 exited with status queued for try_number 1 2024-06-27T22:53:00.498115126Z [2024-06-27T22:53:00.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:52:00+00:00 exited with status queued for try_number 1 2024-06-27T22:53:00.506394060Z [2024-06-27T22:53:00.505+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e86d5df-b061-4620-a6bd-2cea23b86258 2024-06-27T22:53:00.506585407Z [2024-06-27T22:53:00.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5358be2f-ffcd-424e-be92-63b13acf7c5d 2024-06-27T22:53:00.506773997Z [2024-06-27T22:53:00.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to aafc8f73-1c3d-441e-bc5c-9c345569eab3 2024-06-27T22:53:01.698448043Z [2024-06-27T22:53:01.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:53:01.698863701Z [2024-06-27T22:53:01.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:52:00+00:00, run_id=scheduled__2024-06-27T22:52:00+00:00, run_start_date=2024-06-27 22:53:00.132130+00:00, run_end_date=2024-06-27 22:53:01.698361+00:00, run_duration=1.566231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:52:00+00:00, data_interval_end=2024-06-27 22:53:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:53:01.708951765Z [2024-06-27T22:53:01.708+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:53:00+00:00, run_after=2024-06-27T22:54:00+00:00 2024-06-27T22:53:02.004054605Z [2024-06-27T22:53:02.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:52:00+00:00 exited with status success for try_number 1 2024-06-27T22:53:02.011206005Z [2024-06-27T22:53:02.010+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:52:00+00:00, map_index=-1, run_start_date=2024-06-27 22:53:01.141957+00:00, run_end_date=2024-06-27 22:53:01.614194+00:00, run_duration=0.472237, state=success, executor_state=success, try_number=1, max_tries=1, job_id=95, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:53:00.186081+00:00, queued_by_job_id=2, pid=1441 2024-06-27T22:53:04.122615336Z [2024-06-27T22:53:04.122+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:53:04.124480613Z [2024-06-27T22:53:04.122+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:52:00+00:00, run_id=scheduled__2024-06-27T22:52:00+00:00, run_start_date=2024-06-27 22:53:00.131136+00:00, run_end_date=2024-06-27 22:53:04.122759+00:00, run_duration=3.991623, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:52:00+00:00, data_interval_end=2024-06-27 22:53:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:53:04.137187699Z [2024-06-27T22:53:04.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:53:00+00:00, run_after=2024-06-27T22:54:00+00:00 2024-06-27T22:53:04.232610897Z [2024-06-27T22:53:04.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:52:00+00:00 exited with status success for try_number 1 2024-06-27T22:53:04.241381901Z [2024-06-27T22:53:04.241+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:52:00+00:00, map_index=-1, run_start_date=2024-06-27 22:53:02.214883+00:00, run_end_date=2024-06-27 22:53:03.568307+00:00, run_duration=1.353424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=96, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:53:00.186081+00:00, queued_by_job_id=2, pid=1460 2024-06-27T22:53:05.307224858Z [2024-06-27T22:53:05.306+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:53:05.307483932Z [2024-06-27T22:53:05.307+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:52:00+00:00, run_id=scheduled__2024-06-27T22:52:00+00:00, run_start_date=2024-06-27 22:53:00.129830+00:00, run_end_date=2024-06-27 22:53:05.307213+00:00, run_duration=5.177383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:52:00+00:00, data_interval_end=2024-06-27 22:53:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:53:05.317356210Z [2024-06-27T22:53:05.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:53:00+00:00, run_after=2024-06-27T22:54:00+00:00 2024-06-27T22:53:05.356042891Z [2024-06-27T22:53:05.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:52:00+00:00 exited with status success for try_number 1 2024-06-27T22:53:05.362350885Z [2024-06-27T22:53:05.362+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:52:00+00:00, map_index=-1, run_start_date=2024-06-27 22:53:02.218198+00:00, run_end_date=2024-06-27 22:53:04.206421+00:00, run_duration=1.988223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=97, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:53:00.186081+00:00, queued_by_job_id=2, pid=1459 2024-06-27T22:54:00.111114965Z [2024-06-27T22:54:00.110+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:54:00+00:00, run_after=2024-06-27T22:55:00+00:00 2024-06-27T22:54:00.141364222Z [2024-06-27T22:54:00.140+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:54:00+00:00, run_after=2024-06-27T22:55:00+00:00 2024-06-27T22:54:00.155373942Z [2024-06-27T22:54:00.154+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:54:00.166287095Z [2024-06-27T22:54:00.165+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:54:00.267059208Z [2024-06-27T22:54:00.266+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T22:54:00.267098823Z 2024-06-27T22:54:00.267137241Z 2024-06-27T22:54:00.267147209Z 2024-06-27T22:54:00.267155794Z 2024-06-27T22:54:00.267180194Z [2024-06-27T22:54:00.266+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T22:54:00.267268978Z [2024-06-27T22:54:00.267+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:54:00.267399070Z [2024-06-27T22:54:00.267+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:54:00.267518991Z [2024-06-27T22:54:00.267+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:54:00.268106657Z [2024-06-27T22:54:00.267+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:54:00.268128330Z 2024-06-27T22:54:00.268138218Z 2024-06-27T22:54:00.268146790Z 2024-06-27T22:54:00.268155140Z 2024-06-27T22:54:00.272907272Z [2024-06-27T22:54:00.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:54:00.273016230Z [2024-06-27T22:54:00.272+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T22:54:00.273284596Z [2024-06-27T22:54:00.273+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:54:00.273409465Z [2024-06-27T22:54:00.273+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:54:00.273644537Z [2024-06-27T22:54:00.273+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:54:00.273761180Z [2024-06-27T22:54:00.273+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:54:00.273981042Z [2024-06-27T22:54:00.273+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:54:00.274111742Z [2024-06-27T22:54:00.273+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:54:00.631107093Z [2024-06-27T22:54:00.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:52:00+00:00 exited with status queued for try_number 1 2024-06-27T22:54:00.631289443Z [2024-06-27T22:54:00.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:53:00+00:00 exited with status queued for try_number 1 2024-06-27T22:54:00.631446860Z [2024-06-27T22:54:00.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:53:00+00:00 exited with status queued for try_number 1 2024-06-27T22:54:00.631909642Z [2024-06-27T22:54:00.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:53:00+00:00 exited with status queued for try_number 1 2024-06-27T22:54:00.644532251Z [2024-06-27T22:54:00.644+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d76c522-0c46-432c-8dca-380598d1b033 2024-06-27T22:54:00.644800757Z [2024-06-27T22:54:00.644+0000] {scheduler_job.py:635} INFO - Setting external_id for to 905fc5ba-b764-4c3e-a078-e008f7f826c9 2024-06-27T22:54:00.645003909Z [2024-06-27T22:54:00.644+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b778147-c6da-4919-9eb9-95e0a0127df0 2024-06-27T22:54:00.646745557Z [2024-06-27T22:54:00.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to c74ea592-fc6b-4af8-8b31-54c555a94fec 2024-06-27T22:54:02.927802237Z [2024-06-27T22:54:02.927+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:54:02.928076642Z [2024-06-27T22:54:02.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 22:52:00+00:00, run_id=scheduled__2024-06-27T22:52:00+00:00, run_start_date=2024-06-27 22:54:00.183021+00:00, run_end_date=2024-06-27 22:54:02.927741+00:00, run_duration=2.74472, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:52:00+00:00, data_interval_end=2024-06-27 22:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T22:54:02.938429498Z [2024-06-27T22:54:02.938+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T22:54:00+00:00, run_after=2024-06-27T22:56:00+00:00 2024-06-27T22:54:02.950817147Z [2024-06-27T22:54:02.950+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:54:02.950948858Z [2024-06-27T22:54:02.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:53:00+00:00, run_id=scheduled__2024-06-27T22:53:00+00:00, run_start_date=2024-06-27 22:54:00.186261+00:00, run_end_date=2024-06-27 22:54:02.950634+00:00, run_duration=2.764373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:53:00+00:00, data_interval_end=2024-06-27 22:54:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:54:02.960287381Z [2024-06-27T22:54:02.959+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:54:00+00:00, run_after=2024-06-27T22:55:00+00:00 2024-06-27T22:54:03.014356820Z [2024-06-27T22:54:03.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:52:00+00:00 exited with status success for try_number 1 2024-06-27T22:54:03.014531343Z [2024-06-27T22:54:03.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:53:00+00:00 exited with status success for try_number 1 2024-06-27T22:54:03.028300709Z [2024-06-27T22:54:03.027+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T22:52:00+00:00, map_index=-1, run_start_date=2024-06-27 22:54:01.341047+00:00, run_end_date=2024-06-27 22:54:02.001788+00:00, run_duration=0.660741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=98, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:54:00.268946+00:00, queued_by_job_id=2, pid=1492 2024-06-27T22:54:03.029918658Z [2024-06-27T22:54:03.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:53:00+00:00, map_index=-1, run_start_date=2024-06-27 22:54:01.445412+00:00, run_end_date=2024-06-27 22:54:01.998457+00:00, run_duration=0.553045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=99, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:54:00.268946+00:00, queued_by_job_id=2, pid=1493 2024-06-27T22:54:04.690146876Z [2024-06-27T22:54:04.689+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:54:04.691114241Z [2024-06-27T22:54:04.690+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:53:00+00:00, run_id=scheduled__2024-06-27T22:53:00+00:00, run_start_date=2024-06-27 22:54:00.184852+00:00, run_end_date=2024-06-27 22:54:04.690090+00:00, run_duration=4.505238, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:53:00+00:00, data_interval_end=2024-06-27 22:54:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:54:04.702328718Z [2024-06-27T22:54:04.702+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:54:00+00:00, run_after=2024-06-27T22:55:00+00:00 2024-06-27T22:54:04.762249890Z [2024-06-27T22:54:04.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:53:00+00:00 exited with status success for try_number 1 2024-06-27T22:54:04.769427350Z [2024-06-27T22:54:04.768+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:53:00+00:00, map_index=-1, run_start_date=2024-06-27 22:54:02.887928+00:00, run_end_date=2024-06-27 22:54:04.431995+00:00, run_duration=1.544067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:54:00.268946+00:00, queued_by_job_id=2, pid=1517 2024-06-27T22:54:05.853921909Z [2024-06-27T22:54:05.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:54:05.854232814Z [2024-06-27T22:54:05.854+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:53:00+00:00, run_id=scheduled__2024-06-27T22:53:00+00:00, run_start_date=2024-06-27 22:54:00.187752+00:00, run_end_date=2024-06-27 22:54:05.853866+00:00, run_duration=5.666114, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:53:00+00:00, data_interval_end=2024-06-27 22:54:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:54:05.862836645Z [2024-06-27T22:54:05.862+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:54:00+00:00, run_after=2024-06-27T22:55:00+00:00 2024-06-27T22:54:05.901072171Z [2024-06-27T22:54:05.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:53:00+00:00 exited with status success for try_number 1 2024-06-27T22:54:05.906115434Z [2024-06-27T22:54:05.905+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:53:00+00:00, map_index=-1, run_start_date=2024-06-27 22:54:02.810504+00:00, run_end_date=2024-06-27 22:54:05.020378+00:00, run_duration=2.209874, state=success, executor_state=success, try_number=1, max_tries=1, job_id=100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:54:00.268946+00:00, queued_by_job_id=2, pid=1516 2024-06-27T22:55:00.982179066Z [2024-06-27T22:55:00.981+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:55:00+00:00, run_after=2024-06-27T22:56:00+00:00 2024-06-27T22:55:00.991224963Z [2024-06-27T22:55:00.990+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:55:01.004743525Z [2024-06-27T22:55:01.004+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:55:00+00:00, run_after=2024-06-27T22:56:00+00:00 2024-06-27T22:55:01.025080524Z [2024-06-27T22:55:01.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:55:00+00:00, run_after=2024-06-27T23:00:00+00:00 2024-06-27T22:55:01.152019076Z [2024-06-27T22:55:01.151+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T22:55:01.152215986Z 2024-06-27T22:55:01.152291525Z 2024-06-27T22:55:01.152308347Z 2024-06-27T22:55:01.152387251Z 2024-06-27T22:55:01.152402463Z [2024-06-27T22:55:01.151+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:55:01.152414793Z [2024-06-27T22:55:01.151+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:55:01.152427449Z [2024-06-27T22:55:01.151+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:55:01.152513239Z [2024-06-27T22:55:01.151+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:55:01.152761940Z [2024-06-27T22:55:01.152+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:55:01.152789045Z 2024-06-27T22:55:01.152796882Z 2024-06-27T22:55:01.152802932Z 2024-06-27T22:55:01.152808991Z 2024-06-27T22:55:01.158831592Z [2024-06-27T22:55:01.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T22:55:01.158844159Z [2024-06-27T22:55:01.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:55:01.159346496Z [2024-06-27T22:55:01.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:55:01.159361553Z [2024-06-27T22:55:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:55:01.159669679Z [2024-06-27T22:55:01.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:55:01.159687929Z [2024-06-27T22:55:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:55:01.159879112Z [2024-06-27T22:55:01.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:55:01.159902614Z [2024-06-27T22:55:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:55:01.604114777Z [2024-06-27T22:55:01.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:50:00+00:00 exited with status queued for try_number 1 2024-06-27T22:55:01.604174074Z [2024-06-27T22:55:01.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:54:00+00:00 exited with status queued for try_number 1 2024-06-27T22:55:01.604178213Z [2024-06-27T22:55:01.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:54:00+00:00 exited with status queued for try_number 1 2024-06-27T22:55:01.604313260Z [2024-06-27T22:55:01.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:54:00+00:00 exited with status queued for try_number 1 2024-06-27T22:55:01.618200063Z [2024-06-27T22:55:01.617+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2eaee315-49cb-47dd-93b3-72b0407bfdeb 2024-06-27T22:55:01.618268339Z [2024-06-27T22:55:01.618+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f240a88-5566-4b49-8d39-db38b736bc60 2024-06-27T22:55:01.618374238Z [2024-06-27T22:55:01.618+0000] {scheduler_job.py:635} INFO - Setting external_id for to 132cabb9-f126-47b6-83b0-afac9d33ab4b 2024-06-27T22:55:01.618541951Z [2024-06-27T22:55:01.618+0000] {scheduler_job.py:635} INFO - Setting external_id for to 659f73ee-a221-4538-bebe-b0b5aa5d7699 2024-06-27T22:55:02.949209608Z [2024-06-27T22:55:02.948+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:55:02.949499997Z [2024-06-27T22:55:02.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:54:00+00:00, run_id=scheduled__2024-06-27T22:54:00+00:00, run_start_date=2024-06-27 22:55:01.052934+00:00, run_end_date=2024-06-27 22:55:02.949125+00:00, run_duration=1.896191, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:54:00+00:00, data_interval_end=2024-06-27 22:55:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:55:02.963749491Z [2024-06-27T22:55:02.962+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:55:00+00:00, run_after=2024-06-27T22:56:00+00:00 2024-06-27T22:55:03.037579890Z [2024-06-27T22:55:03.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:54:00+00:00 exited with status success for try_number 1 2024-06-27T22:55:03.056953144Z [2024-06-27T22:55:03.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:54:00+00:00, map_index=-1, run_start_date=2024-06-27 22:55:02.240581+00:00, run_end_date=2024-06-27 22:55:02.683538+00:00, run_duration=0.442957, state=success, executor_state=success, try_number=1, max_tries=1, job_id=102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:55:01.154830+00:00, queued_by_job_id=2, pid=1550 2024-06-27T22:55:05.165636243Z [2024-06-27T22:55:05.165+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:55:05.165660384Z 2024-06-27T22:55:05.165882868Z [2024-06-27T22:55:05.165+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:55:05.166445941Z [2024-06-27T22:55:05.166+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:55:05.166458447Z 2024-06-27T22:55:05.168918583Z [2024-06-27T22:55:05.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-27T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T22:55:05.169147162Z [2024-06-27T22:55:05.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-27T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:55:05.295731549Z [2024-06-27T22:55:05.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T22:50:00+00:00 exited with status queued for try_number 1 2024-06-27T22:55:05.296208391Z [2024-06-27T22:55:05.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:50:00+00:00 exited with status success for try_number 1 2024-06-27T22:55:05.308053341Z [2024-06-27T22:55:05.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to a164e56f-6451-49e7-b50b-e3a2816b71b8 2024-06-27T22:55:05.308303274Z [2024-06-27T22:55:05.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T22:50:00+00:00, map_index=-1, run_start_date=2024-06-27 22:55:03.669311+00:00, run_end_date=2024-06-27 22:55:04.443446+00:00, run_duration=0.774135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=104, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:55:01.154830+00:00, queued_by_job_id=2, pid=1575 2024-06-27T22:55:06.513171011Z [2024-06-27T22:55:06.512+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:55:06.513452769Z [2024-06-27T22:55:06.513+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:54:00+00:00, run_id=scheduled__2024-06-27T22:54:00+00:00, run_start_date=2024-06-27 22:55:01.048563+00:00, run_end_date=2024-06-27 22:55:06.513108+00:00, run_duration=5.464545, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:54:00+00:00, data_interval_end=2024-06-27 22:55:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:55:06.522130297Z [2024-06-27T22:55:06.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:55:00+00:00, run_after=2024-06-27T22:56:00+00:00 2024-06-27T22:55:06.528413832Z [2024-06-27T22:55:06.528+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:55:06.528680535Z [2024-06-27T22:55:06.528+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:54:00+00:00, run_id=scheduled__2024-06-27T22:54:00+00:00, run_start_date=2024-06-27 22:55:01.050816+00:00, run_end_date=2024-06-27 22:55:06.528359+00:00, run_duration=5.477543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:54:00+00:00, data_interval_end=2024-06-27 22:55:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:55:06.538048610Z [2024-06-27T22:55:06.537+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:55:00+00:00, run_after=2024-06-27T22:56:00+00:00 2024-06-27T22:55:06.586081516Z [2024-06-27T22:55:06.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:54:00+00:00 exited with status success for try_number 1 2024-06-27T22:55:06.586197456Z [2024-06-27T22:55:06.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:54:00+00:00 exited with status success for try_number 1 2024-06-27T22:55:06.596006082Z [2024-06-27T22:55:06.595+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:54:00+00:00, map_index=-1, run_start_date=2024-06-27 22:55:03.732687+00:00, run_end_date=2024-06-27 22:55:05.369392+00:00, run_duration=1.636705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:55:01.154830+00:00, queued_by_job_id=2, pid=1576 2024-06-27T22:55:06.596293362Z [2024-06-27T22:55:06.596+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:54:00+00:00, map_index=-1, run_start_date=2024-06-27 22:55:03.586517+00:00, run_end_date=2024-06-27 22:55:05.415404+00:00, run_duration=1.828887, state=success, executor_state=success, try_number=1, max_tries=1, job_id=103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:55:01.154830+00:00, queued_by_job_id=2, pid=1574 2024-06-27T22:55:07.976884910Z [2024-06-27T22:55:07.976+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:55:07.976911166Z 2024-06-27T22:55:07.977434054Z [2024-06-27T22:55:07.977+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:55:07.977986736Z [2024-06-27T22:55:07.977+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:55:07.978000412Z 2024-06-27T22:55:07.980443895Z [2024-06-27T22:55:07.980+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-27T22:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T22:55:07.981722314Z [2024-06-27T22:55:07.980+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-27T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T22:55:08.033096661Z [2024-06-27T22:55:08.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T22:50:00+00:00 exited with status queued for try_number 1 2024-06-27T22:55:08.033125252Z [2024-06-27T22:55:08.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T22:50:00+00:00 exited with status success for try_number 1 2024-06-27T22:55:08.038122788Z [2024-06-27T22:55:08.037+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8138bbe2-8ce0-4cc9-abb9-89f854717699 2024-06-27T22:55:08.038278591Z [2024-06-27T22:55:08.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-27T22:50:00+00:00, map_index=-1, run_start_date=2024-06-27 22:55:07.354390+00:00, run_end_date=2024-06-27 22:55:07.726238+00:00, run_duration=0.371848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=106, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:55:05.167046+00:00, queued_by_job_id=2, pid=1599 2024-06-27T22:55:10.297584763Z [2024-06-27T22:55:10.297+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T22:55:10.297597168Z 2024-06-27T22:55:10.297611213Z [2024-06-27T22:55:10.297+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:55:10.298090388Z [2024-06-27T22:55:10.297+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:55:10.298095827Z 2024-06-27T22:55:10.300055014Z [2024-06-27T22:55:10.299+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-27T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:55:10.300079469Z [2024-06-27T22:55:10.299+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-27T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T22:55:10.379726140Z [2024-06-27T22:55:10.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T22:50:00+00:00 exited with status queued for try_number 1 2024-06-27T22:55:10.380212701Z [2024-06-27T22:55:10.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T22:50:00+00:00 exited with status success for try_number 1 2024-06-27T22:55:10.391479962Z [2024-06-27T22:55:10.391+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c3c9f69-ee63-4675-93ac-c126b6562668 2024-06-27T22:55:10.391985764Z [2024-06-27T22:55:10.391+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-27T22:50:00+00:00, map_index=0, run_start_date=2024-06-27 22:55:09.647013+00:00, run_end_date=2024-06-27 22:55:09.975365+00:00, run_duration=0.328352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=107, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:55:07.978241+00:00, queued_by_job_id=2, pid=1607 2024-06-27T22:55:12.634839360Z [2024-06-27T22:55:12.634+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:55:12.635061582Z [2024-06-27T22:55:12.634+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:50:00+00:00, run_id=scheduled__2024-06-27T22:50:00+00:00, run_start_date=2024-06-27 22:55:01.045458+00:00, run_end_date=2024-06-27 22:55:12.634745+00:00, run_duration=11.589287, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:50:00+00:00, data_interval_end=2024-06-27 22:55:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-27T22:55:12.641783275Z [2024-06-27T22:55:12.641+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:55:00+00:00, run_after=2024-06-27T23:00:00+00:00 2024-06-27T22:55:12.671858159Z [2024-06-27T22:55:12.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T22:50:00+00:00 exited with status success for try_number 1 2024-06-27T22:55:12.681879772Z [2024-06-27T22:55:12.681+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-27T22:50:00+00:00, map_index=-1, run_start_date=2024-06-27 22:55:12.012595+00:00, run_end_date=2024-06-27 22:55:12.356276+00:00, run_duration=0.343681, state=success, executor_state=success, try_number=1, max_tries=1, job_id=108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:55:10.298323+00:00, queued_by_job_id=2, pid=1615 2024-06-27T22:56:01.033875763Z [2024-06-27T22:56:01.033+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:56:00+00:00, run_after=2024-06-27T22:57:00+00:00 2024-06-27T22:56:01.042514666Z [2024-06-27T22:56:01.042+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:56:01.050329383Z [2024-06-27T22:56:01.050+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:56:01.065312501Z [2024-06-27T22:56:01.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:56:00+00:00, run_after=2024-06-27T22:57:00+00:00 2024-06-27T22:56:01.149435290Z [2024-06-27T22:56:01.149+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T22:56:01.149455727Z 2024-06-27T22:56:01.149460061Z 2024-06-27T22:56:01.149463743Z 2024-06-27T22:56:01.149467501Z 2024-06-27T22:56:01.150148171Z [2024-06-27T22:56:01.149+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T22:56:01.150389722Z [2024-06-27T22:56:01.150+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:56:01.150652901Z [2024-06-27T22:56:01.150+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:56:01.150991497Z [2024-06-27T22:56:01.150+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:56:01.151712200Z [2024-06-27T22:56:01.151+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:56:01.151724169Z 2024-06-27T22:56:01.151728939Z 2024-06-27T22:56:01.151732670Z 2024-06-27T22:56:01.151736514Z 2024-06-27T22:56:01.155340535Z [2024-06-27T22:56:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:56:01.155599512Z [2024-06-27T22:56:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T22:56:01.155980521Z [2024-06-27T22:56:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:56:01.156220429Z [2024-06-27T22:56:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:56:01.156536438Z [2024-06-27T22:56:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:56:01.156732482Z [2024-06-27T22:56:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:56:01.157269127Z [2024-06-27T22:56:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:56:01.157472733Z [2024-06-27T22:56:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:56:01.498724941Z [2024-06-27T22:56:01.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:54:00+00:00 exited with status queued for try_number 1 2024-06-27T22:56:01.499032874Z [2024-06-27T22:56:01.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status queued for try_number 1 2024-06-27T22:56:01.499184534Z [2024-06-27T22:56:01.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status queued for try_number 1 2024-06-27T22:56:01.500436068Z [2024-06-27T22:56:01.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status queued for try_number 1 2024-06-27T22:56:01.528225116Z [2024-06-27T22:56:01.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1c2add3-d16a-4c48-b360-8f4df3fcf59e 2024-06-27T22:56:01.528536465Z [2024-06-27T22:56:01.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0efc8621-5acf-4a7a-9aa7-e691943a9fe7 2024-06-27T22:56:01.528784244Z [2024-06-27T22:56:01.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86fc98db-4b4b-49a5-bb93-b5c7c0674300 2024-06-27T22:56:01.528992248Z [2024-06-27T22:56:01.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07f16021-5e95-4f21-885b-b1f7d5d325e4 2024-06-27T22:56:03.936422010Z [2024-06-27T22:56:03.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:56:03.937720742Z [2024-06-27T22:56:03.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 22:54:00+00:00, run_id=scheduled__2024-06-27T22:54:00+00:00, run_start_date=2024-06-27 22:56:01.077044+00:00, run_end_date=2024-06-27 22:56:03.937300+00:00, run_duration=2.860256, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:54:00+00:00, data_interval_end=2024-06-27 22:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T22:56:03.958001715Z [2024-06-27T22:56:03.957+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T22:56:00+00:00, run_after=2024-06-27T22:58:00+00:00 2024-06-27T22:56:03.997744127Z [2024-06-27T22:56:03.997+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:56:03.998011729Z [2024-06-27T22:56:03.997+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:55:00+00:00, run_id=scheduled__2024-06-27T22:55:00+00:00, run_start_date=2024-06-27 22:56:01.078553+00:00, run_end_date=2024-06-27 22:56:03.997713+00:00, run_duration=2.91916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:55:00+00:00, data_interval_end=2024-06-27 22:56:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:56:04.015586030Z [2024-06-27T22:56:04.015+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:56:00+00:00, run_after=2024-06-27T22:57:00+00:00 2024-06-27T22:56:04.201023557Z [2024-06-27T22:56:04.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:54:00+00:00 exited with status success for try_number 1 2024-06-27T22:56:04.201388018Z [2024-06-27T22:56:04.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status success for try_number 1 2024-06-27T22:56:04.217614941Z [2024-06-27T22:56:04.217+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T22:54:00+00:00, map_index=-1, run_start_date=2024-06-27 22:56:02.297712+00:00, run_end_date=2024-06-27 22:56:02.920802+00:00, run_duration=0.62309, state=success, executor_state=success, try_number=1, max_tries=1, job_id=110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:56:01.152761+00:00, queued_by_job_id=2, pid=1640 2024-06-27T22:56:04.218104932Z [2024-06-27T22:56:04.217+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:55:00+00:00, map_index=-1, run_start_date=2024-06-27 22:56:02.262308+00:00, run_end_date=2024-06-27 22:56:02.867102+00:00, run_duration=0.604794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:56:01.152761+00:00, queued_by_job_id=2, pid=1639 2024-06-27T22:56:05.745325955Z [2024-06-27T22:56:05.744+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:56:05.749755148Z [2024-06-27T22:56:05.746+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:55:00+00:00, run_id=scheduled__2024-06-27T22:55:00+00:00, run_start_date=2024-06-27 22:56:01.080698+00:00, run_end_date=2024-06-27 22:56:05.746746+00:00, run_duration=4.666048, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:55:00+00:00, data_interval_end=2024-06-27 22:56:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:56:05.773712362Z [2024-06-27T22:56:05.773+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:56:00+00:00, run_after=2024-06-27T22:57:00+00:00 2024-06-27T22:56:05.863676731Z [2024-06-27T22:56:05.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status success for try_number 1 2024-06-27T22:56:05.870653226Z [2024-06-27T22:56:05.870+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:55:00+00:00, map_index=-1, run_start_date=2024-06-27 22:56:03.839418+00:00, run_end_date=2024-06-27 22:56:05.497863+00:00, run_duration=1.658445, state=success, executor_state=success, try_number=1, max_tries=1, job_id=112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:56:01.152761+00:00, queued_by_job_id=2, pid=1664 2024-06-27T22:56:06.968425833Z [2024-06-27T22:56:06.967+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:56:06.971443016Z [2024-06-27T22:56:06.968+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:55:00+00:00, run_id=scheduled__2024-06-27T22:55:00+00:00, run_start_date=2024-06-27 22:56:01.079684+00:00, run_end_date=2024-06-27 22:56:06.968624+00:00, run_duration=5.88894, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:55:00+00:00, data_interval_end=2024-06-27 22:56:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:56:06.989624300Z [2024-06-27T22:56:06.989+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:56:00+00:00, run_after=2024-06-27T22:57:00+00:00 2024-06-27T22:56:07.054521823Z [2024-06-27T22:56:07.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status success for try_number 1 2024-06-27T22:56:07.061085797Z [2024-06-27T22:56:07.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:55:00+00:00, map_index=-1, run_start_date=2024-06-27 22:56:03.724178+00:00, run_end_date=2024-06-27 22:56:05.858152+00:00, run_duration=2.133974, state=success, executor_state=success, try_number=1, max_tries=1, job_id=111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:56:01.152761+00:00, queued_by_job_id=2, pid=1663 2024-06-27T22:56:44.134484017Z [2024-06-27T22:56:44.134+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T22:57:00.538604668Z [2024-06-27T22:57:00.538+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:57:00+00:00, run_after=2024-06-27T22:58:00+00:00 2024-06-27T22:57:00.550114546Z [2024-06-27T22:57:00.549+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:57:00.577080456Z [2024-06-27T22:57:00.576+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:57:00+00:00, run_after=2024-06-27T22:58:00+00:00 2024-06-27T22:57:00.713693894Z [2024-06-27T22:57:00.711+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T22:57:00.713710141Z 2024-06-27T22:57:00.713713796Z 2024-06-27T22:57:00.713717005Z 2024-06-27T22:57:00.713720437Z [2024-06-27T22:57:00.711+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:57:00.713723617Z [2024-06-27T22:57:00.711+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:57:00.713726636Z [2024-06-27T22:57:00.711+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:57:00.713730566Z [2024-06-27T22:57:00.712+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:57:00.713733616Z 2024-06-27T22:57:00.713736625Z 2024-06-27T22:57:00.713739860Z 2024-06-27T22:57:00.718519950Z [2024-06-27T22:57:00.718+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:57:00.726153501Z [2024-06-27T22:57:00.718+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:57:00.726668299Z [2024-06-27T22:57:00.726+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:57:00.726908170Z [2024-06-27T22:57:00.726+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:57:00.727208803Z [2024-06-27T22:57:00.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:57:00.727374041Z [2024-06-27T22:57:00.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:57:01.459720797Z [2024-06-27T22:57:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:56:00+00:00 exited with status queued for try_number 1 2024-06-27T22:57:01.465257180Z [2024-06-27T22:57:01.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:56:00+00:00 exited with status queued for try_number 1 2024-06-27T22:57:01.466498907Z [2024-06-27T22:57:01.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:56:00+00:00 exited with status queued for try_number 1 2024-06-27T22:57:01.522517756Z [2024-06-27T22:57:01.522+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4c497e1-5c4e-47f5-a892-a809f3ccc8db 2024-06-27T22:57:01.522802374Z [2024-06-27T22:57:01.522+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1edd1bed-0cd1-4d73-b1bf-98fb6c6c4714 2024-06-27T22:57:01.526736669Z [2024-06-27T22:57:01.526+0000] {scheduler_job.py:635} INFO - Setting external_id for to c20d9087-8ca1-4115-bed6-f7e14ed4a815 2024-06-27T22:57:04.276341540Z [2024-06-27T22:57:04.275+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:57:04.276705031Z [2024-06-27T22:57:04.276+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:56:00+00:00, run_id=scheduled__2024-06-27T22:56:00+00:00, run_start_date=2024-06-27 22:57:00.618323+00:00, run_end_date=2024-06-27 22:57:04.276338+00:00, run_duration=3.658015, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:56:00+00:00, data_interval_end=2024-06-27 22:57:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:57:04.312934901Z [2024-06-27T22:57:04.304+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:57:00+00:00, run_after=2024-06-27T22:58:00+00:00 2024-06-27T22:57:04.451511137Z [2024-06-27T22:57:04.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:56:00+00:00 exited with status success for try_number 1 2024-06-27T22:57:04.466346196Z [2024-06-27T22:57:04.465+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:56:00+00:00, map_index=-1, run_start_date=2024-06-27 22:57:02.571073+00:00, run_end_date=2024-06-27 22:57:03.451513+00:00, run_duration=0.88044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:57:00.713318+00:00, queued_by_job_id=2, pid=1696 2024-06-27T22:57:07.497114084Z [2024-06-27T22:57:07.496+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:57:07.497614132Z [2024-06-27T22:57:07.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:56:00+00:00, run_id=scheduled__2024-06-27T22:56:00+00:00, run_start_date=2024-06-27 22:57:00.615677+00:00, run_end_date=2024-06-27 22:57:07.497230+00:00, run_duration=6.881553, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:56:00+00:00, data_interval_end=2024-06-27 22:57:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:57:07.522253758Z [2024-06-27T22:57:07.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:57:00+00:00, run_after=2024-06-27T22:58:00+00:00 2024-06-27T22:57:07.638882881Z [2024-06-27T22:57:07.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:56:00+00:00 exited with status success for try_number 1 2024-06-27T22:57:07.669582056Z [2024-06-27T22:57:07.669+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:56:00+00:00, map_index=-1, run_start_date=2024-06-27 22:57:04.847846+00:00, run_end_date=2024-06-27 22:57:07.031888+00:00, run_duration=2.184042, state=success, executor_state=success, try_number=1, max_tries=1, job_id=114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:57:00.713318+00:00, queued_by_job_id=2, pid=1714 2024-06-27T22:57:08.724883313Z [2024-06-27T22:57:08.724+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:57:08.728967927Z [2024-06-27T22:57:08.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:56:00+00:00, run_id=scheduled__2024-06-27T22:56:00+00:00, run_start_date=2024-06-27 22:57:00.617198+00:00, run_end_date=2024-06-27 22:57:08.724758+00:00, run_duration=8.10756, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:56:00+00:00, data_interval_end=2024-06-27 22:57:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:57:08.740988590Z [2024-06-27T22:57:08.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:57:00+00:00, run_after=2024-06-27T22:58:00+00:00 2024-06-27T22:57:08.768816853Z [2024-06-27T22:57:08.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:56:00+00:00 exited with status success for try_number 1 2024-06-27T22:57:08.799848725Z [2024-06-27T22:57:08.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:56:00+00:00, map_index=-1, run_start_date=2024-06-27 22:57:05.417986+00:00, run_end_date=2024-06-27 22:57:08.206526+00:00, run_duration=2.78854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:57:00.713318+00:00, queued_by_job_id=2, pid=1715 2024-06-27T22:58:00.623572312Z [2024-06-27T22:58:00.623+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:58:00.630311656Z [2024-06-27T22:58:00.629+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:58:00.644572831Z [2024-06-27T22:58:00.644+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:58:00+00:00, run_after=2024-06-27T22:59:00+00:00 2024-06-27T22:58:00.664324638Z [2024-06-27T22:58:00.664+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:58:00+00:00, run_after=2024-06-27T22:59:00+00:00 2024-06-27T22:58:00.766807404Z [2024-06-27T22:58:00.766+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T22:58:00.766831589Z 2024-06-27T22:58:00.766842503Z 2024-06-27T22:58:00.766847240Z 2024-06-27T22:58:00.766851831Z 2024-06-27T22:58:00.766983616Z [2024-06-27T22:58:00.766+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T22:58:00.767052392Z [2024-06-27T22:58:00.766+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:58:00.767218694Z [2024-06-27T22:58:00.767+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:58:00.767248120Z [2024-06-27T22:58:00.767+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:58:00.768065257Z [2024-06-27T22:58:00.767+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:58:00.768078959Z 2024-06-27T22:58:00.768084168Z 2024-06-27T22:58:00.768104726Z 2024-06-27T22:58:00.768110049Z 2024-06-27T22:58:00.773993297Z [2024-06-27T22:58:00.773+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:58:00.774963963Z [2024-06-27T22:58:00.773+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T22:58:00.777795569Z [2024-06-27T22:58:00.777+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:58:00.781064419Z [2024-06-27T22:58:00.780+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:58:00.781880587Z [2024-06-27T22:58:00.781+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:58:00.782854322Z [2024-06-27T22:58:00.782+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:58:00.787160864Z [2024-06-27T22:58:00.786+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:58:00.787668228Z [2024-06-27T22:58:00.787+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:58:01.255272828Z [2024-06-27T22:58:01.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:56:00+00:00 exited with status queued for try_number 1 2024-06-27T22:58:01.255715394Z [2024-06-27T22:58:01.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:57:00+00:00 exited with status queued for try_number 1 2024-06-27T22:58:01.255848806Z [2024-06-27T22:58:01.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:57:00+00:00 exited with status queued for try_number 1 2024-06-27T22:58:01.255974319Z [2024-06-27T22:58:01.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:57:00+00:00 exited with status queued for try_number 1 2024-06-27T22:58:01.271749153Z [2024-06-27T22:58:01.271+0000] {scheduler_job.py:635} INFO - Setting external_id for to b296874e-b3e0-4962-8b4a-ad808fc4cefe 2024-06-27T22:58:01.271939419Z [2024-06-27T22:58:01.271+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a818c29-b661-4d07-9345-3da15f565f0f 2024-06-27T22:58:01.272232483Z [2024-06-27T22:58:01.272+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74ab5951-576f-44f9-8b35-9983a40c4790 2024-06-27T22:58:01.273821221Z [2024-06-27T22:58:01.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7b984fc-60fe-42ff-8cdb-7129ea9af8c7 2024-06-27T22:58:03.835297585Z [2024-06-27T22:58:03.834+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:58:03.837544764Z [2024-06-27T22:58:03.835+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 22:56:00+00:00, run_id=scheduled__2024-06-27T22:56:00+00:00, run_start_date=2024-06-27 22:58:00.676234+00:00, run_end_date=2024-06-27 22:58:03.835258+00:00, run_duration=3.159024, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:56:00+00:00, data_interval_end=2024-06-27 22:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T22:58:03.862261351Z [2024-06-27T22:58:03.859+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T22:58:00+00:00, run_after=2024-06-27T23:00:00+00:00 2024-06-27T22:58:03.931551208Z [2024-06-27T22:58:03.930+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:58:03.936312272Z [2024-06-27T22:58:03.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:57:00+00:00, run_id=scheduled__2024-06-27T22:57:00+00:00, run_start_date=2024-06-27 22:58:00.682994+00:00, run_end_date=2024-06-27 22:58:03.931321+00:00, run_duration=3.248327, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:57:00+00:00, data_interval_end=2024-06-27 22:58:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:58:03.992879968Z [2024-06-27T22:58:03.992+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:58:00+00:00, run_after=2024-06-27T22:59:00+00:00 2024-06-27T22:58:04.224678057Z [2024-06-27T22:58:04.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:56:00+00:00 exited with status success for try_number 1 2024-06-27T22:58:04.224796595Z [2024-06-27T22:58:04.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:57:00+00:00 exited with status success for try_number 1 2024-06-27T22:58:04.268460477Z [2024-06-27T22:58:04.268+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T22:56:00+00:00, map_index=-1, run_start_date=2024-06-27 22:58:02.251794+00:00, run_end_date=2024-06-27 22:58:03.066021+00:00, run_duration=0.814227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:58:00.769410+00:00, queued_by_job_id=2, pid=1748 2024-06-27T22:58:04.269254663Z [2024-06-27T22:58:04.268+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:57:00+00:00, map_index=-1, run_start_date=2024-06-27 22:58:02.666011+00:00, run_end_date=2024-06-27 22:58:03.378097+00:00, run_duration=0.712086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:58:00.769410+00:00, queued_by_job_id=2, pid=1749 2024-06-27T22:58:09.025176585Z [2024-06-27T22:58:09.024+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:58:09.025436639Z [2024-06-27T22:58:09.025+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:57:00+00:00, run_id=scheduled__2024-06-27T22:57:00+00:00, run_start_date=2024-06-27 22:58:00.681267+00:00, run_end_date=2024-06-27 22:58:09.025055+00:00, run_duration=8.343788, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:57:00+00:00, data_interval_end=2024-06-27 22:58:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:58:09.037418088Z [2024-06-27T22:58:09.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:58:00+00:00, run_after=2024-06-27T22:59:00+00:00 2024-06-27T22:58:09.089380952Z [2024-06-27T22:58:09.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:57:00+00:00 exited with status success for try_number 1 2024-06-27T22:58:09.094774874Z [2024-06-27T22:58:09.094+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:57:00+00:00, map_index=-1, run_start_date=2024-06-27 22:58:06.241215+00:00, run_end_date=2024-06-27 22:58:07.959098+00:00, run_duration=1.717883, state=success, executor_state=success, try_number=1, max_tries=1, job_id=118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:58:00.769410+00:00, queued_by_job_id=2, pid=1772 2024-06-27T22:58:10.154363515Z [2024-06-27T22:58:10.153+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:58:10.155150265Z [2024-06-27T22:58:10.154+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:57:00+00:00, run_id=scheduled__2024-06-27T22:57:00+00:00, run_start_date=2024-06-27 22:58:00.677574+00:00, run_end_date=2024-06-27 22:58:10.154281+00:00, run_duration=9.476707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:57:00+00:00, data_interval_end=2024-06-27 22:58:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:58:10.165821488Z [2024-06-27T22:58:10.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:58:00+00:00, run_after=2024-06-27T22:59:00+00:00 2024-06-27T22:58:10.212338146Z [2024-06-27T22:58:10.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:57:00+00:00 exited with status success for try_number 1 2024-06-27T22:58:10.217945594Z [2024-06-27T22:58:10.217+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:57:00+00:00, map_index=-1, run_start_date=2024-06-27 22:58:06.749153+00:00, run_end_date=2024-06-27 22:58:09.084045+00:00, run_duration=2.334892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:58:00.769410+00:00, queued_by_job_id=2, pid=1773 2024-06-27T22:59:00.705407336Z [2024-06-27T22:59:00.704+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:59:00+00:00, run_after=2024-06-27T23:00:00+00:00 2024-06-27T22:59:00.717607014Z [2024-06-27T22:59:00.717+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:59:00+00:00, run_after=2024-06-27T23:00:00+00:00 2024-06-27T22:59:00.726016154Z [2024-06-27T22:59:00.725+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T22:59:00.805783858Z [2024-06-27T22:59:00.805+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T22:59:00.805810026Z 2024-06-27T22:59:00.805814474Z 2024-06-27T22:59:00.805818199Z 2024-06-27T22:59:00.805829484Z [2024-06-27T22:59:00.805+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T22:59:00.805893849Z [2024-06-27T22:59:00.805+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:59:00.805984714Z [2024-06-27T22:59:00.805+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T22:59:00.806475145Z [2024-06-27T22:59:00.806+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T22:59:00.806486129Z 2024-06-27T22:59:00.806489655Z 2024-06-27T22:59:00.806492842Z 2024-06-27T22:59:00.809325145Z [2024-06-27T22:59:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:59:00.809377043Z [2024-06-27T22:59:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T22:59:00.809560839Z [2024-06-27T22:59:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:59:00.809637199Z [2024-06-27T22:59:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T22:59:00.809803596Z [2024-06-27T22:59:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T22:59:00.809859313Z [2024-06-27T22:59:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T22:59:01.039596832Z [2024-06-27T22:59:01.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:58:00+00:00 exited with status queued for try_number 1 2024-06-27T22:59:01.039828075Z [2024-06-27T22:59:01.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:58:00+00:00 exited with status queued for try_number 1 2024-06-27T22:59:01.040018178Z [2024-06-27T22:59:01.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:58:00+00:00 exited with status queued for try_number 1 2024-06-27T22:59:01.054669509Z [2024-06-27T22:59:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2fea4f0a-c3cb-441e-ab7d-31ff579ae2c8 2024-06-27T22:59:01.054897203Z [2024-06-27T22:59:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1e7993d-c78c-41cd-a95e-bff25eebef30 2024-06-27T22:59:01.055120981Z [2024-06-27T22:59:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d16ef41-96f0-4774-85f6-5a0f357b1ecd 2024-06-27T22:59:02.238283956Z [2024-06-27T22:59:02.236+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:59:02.239048150Z [2024-06-27T22:59:02.238+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:58:00+00:00, run_id=scheduled__2024-06-27T22:58:00+00:00, run_start_date=2024-06-27 22:59:00.740650+00:00, run_end_date=2024-06-27 22:59:02.238399+00:00, run_duration=1.497749, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:58:00+00:00, data_interval_end=2024-06-27 22:59:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T22:59:02.278839109Z [2024-06-27T22:59:02.278+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T22:59:00+00:00, run_after=2024-06-27T23:00:00+00:00 2024-06-27T22:59:03.467615745Z [2024-06-27T22:59:03.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:58:00+00:00 exited with status success for try_number 1 2024-06-27T22:59:03.477823361Z [2024-06-27T22:59:03.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:58:00+00:00, map_index=-1, run_start_date=2024-06-27 22:59:01.738490+00:00, run_end_date=2024-06-27 22:59:02.188749+00:00, run_duration=0.450259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:59:00.807082+00:00, queued_by_job_id=2, pid=1805 2024-06-27T22:59:04.796157305Z [2024-06-27T22:59:04.795+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:59:04.796519085Z [2024-06-27T22:59:04.796+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:58:00+00:00, run_id=scheduled__2024-06-27T22:58:00+00:00, run_start_date=2024-06-27 22:59:00.738548+00:00, run_end_date=2024-06-27 22:59:04.796085+00:00, run_duration=4.057537, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:58:00+00:00, data_interval_end=2024-06-27 22:59:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T22:59:04.813977115Z [2024-06-27T22:59:04.813+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:59:00+00:00, run_after=2024-06-27T23:00:00+00:00 2024-06-27T22:59:04.869088218Z [2024-06-27T22:59:04.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:58:00+00:00 exited with status success for try_number 1 2024-06-27T22:59:04.877755964Z [2024-06-27T22:59:04.877+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:58:00+00:00, map_index=-1, run_start_date=2024-06-27 22:59:03.000020+00:00, run_end_date=2024-06-27 22:59:04.402325+00:00, run_duration=1.402305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:59:00.807082+00:00, queued_by_job_id=2, pid=1823 2024-06-27T22:59:05.919187434Z [2024-06-27T22:59:05.918+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T22:59:05.923456941Z [2024-06-27T22:59:05.922+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:58:00+00:00, run_id=scheduled__2024-06-27T22:58:00+00:00, run_start_date=2024-06-27 22:59:00.741980+00:00, run_end_date=2024-06-27 22:59:05.922178+00:00, run_duration=5.180198, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:58:00+00:00, data_interval_end=2024-06-27 22:59:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T22:59:05.947155980Z [2024-06-27T22:59:05.946+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T22:59:00+00:00, run_after=2024-06-27T23:00:00+00:00 2024-06-27T22:59:05.996213895Z [2024-06-27T22:59:05.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:58:00+00:00 exited with status success for try_number 1 2024-06-27T22:59:06.004157915Z [2024-06-27T22:59:06.003+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:58:00+00:00, map_index=-1, run_start_date=2024-06-27 22:59:03.134275+00:00, run_end_date=2024-06-27 22:59:05.066981+00:00, run_duration=1.932706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 22:59:00.807082+00:00, queued_by_job_id=2, pid=1824 2024-06-27T23:00:00.585312696Z [2024-06-27T23:00:00.584+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:00:00+00:00, run_after=2024-06-27T23:01:00+00:00 2024-06-27T23:00:00.598032626Z [2024-06-27T23:00:00.597+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:00:00+00:00, run_after=2024-06-27T23:05:00+00:00 2024-06-27T23:00:00.604672187Z [2024-06-27T23:00:00.604+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:00:00.617088362Z [2024-06-27T23:00:00.616+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:00:00+00:00, run_after=2024-06-27T23:01:00+00:00 2024-06-27T23:00:00.624746225Z [2024-06-27T23:00:00.624+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:00:00.718360254Z [2024-06-27T23:00:00.718+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T23:00:00.718389017Z 2024-06-27T23:00:00.718392380Z 2024-06-27T23:00:00.718396259Z 2024-06-27T23:00:00.718399743Z 2024-06-27T23:00:00.718402894Z 2024-06-27T23:00:00.718847437Z [2024-06-27T23:00:00.718+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:00:00.719438987Z [2024-06-27T23:00:00.719+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:00:00.719713559Z [2024-06-27T23:00:00.719+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:00:00.719850466Z [2024-06-27T23:00:00.719+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:00:00.719970086Z [2024-06-27T23:00:00.719+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:00:00.720617628Z [2024-06-27T23:00:00.720+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:00:00.720625570Z 2024-06-27T23:00:00.720631170Z 2024-06-27T23:00:00.720636548Z 2024-06-27T23:00:00.720639919Z 2024-06-27T23:00:00.720643223Z 2024-06-27T23:00:00.725219890Z [2024-06-27T23:00:00.724+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T23:00:00.725392261Z [2024-06-27T23:00:00.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:00:00.725626512Z [2024-06-27T23:00:00.725+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:00:00.725783875Z [2024-06-27T23:00:00.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:00:00.726010160Z [2024-06-27T23:00:00.725+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:00:00.726123890Z [2024-06-27T23:00:00.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:00:00.726358697Z [2024-06-27T23:00:00.726+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:00:00.726515293Z [2024-06-27T23:00:00.726+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:00:00.727004589Z [2024-06-27T23:00:00.726+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:00:00.727207014Z [2024-06-27T23:00:00.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:00:01.418789320Z [2024-06-27T23:00:01.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status queued for try_number 1 2024-06-27T23:00:01.427114344Z [2024-06-27T23:00:01.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:58:00+00:00 exited with status queued for try_number 1 2024-06-27T23:00:01.432925353Z [2024-06-27T23:00:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:59:00+00:00 exited with status queued for try_number 1 2024-06-27T23:00:01.460002896Z [2024-06-27T23:00:01.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:59:00+00:00 exited with status queued for try_number 1 2024-06-27T23:00:01.460296778Z [2024-06-27T23:00:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:59:00+00:00 exited with status queued for try_number 1 2024-06-27T23:00:01.489990280Z [2024-06-27T23:00:01.489+0000] {scheduler_job.py:635} INFO - Setting external_id for to affe24e2-dd72-49f1-bc9c-61603fe675c6 2024-06-27T23:00:01.495302826Z [2024-06-27T23:00:01.489+0000] {scheduler_job.py:635} INFO - Setting external_id for to afdebc96-a365-4312-b9be-ea00d8559819 2024-06-27T23:00:01.495661809Z [2024-06-27T23:00:01.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69ce3ce4-a235-4c58-9321-3aa8eab879a9 2024-06-27T23:00:01.495861681Z [2024-06-27T23:00:01.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8af08a96-3e2c-4e52-b6ad-a19e727bb51d 2024-06-27T23:00:01.496126982Z [2024-06-27T23:00:01.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5dd30110-fdd7-4918-b2ff-698dab33fa89 2024-06-27T23:00:04.116732766Z [2024-06-27T23:00:04.114+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:00:04.116764980Z [2024-06-27T23:00:04.114+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 22:58:00+00:00, run_id=scheduled__2024-06-27T22:58:00+00:00, run_start_date=2024-06-27 23:00:00.638451+00:00, run_end_date=2024-06-27 23:00:04.114501+00:00, run_duration=3.47605, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:58:00+00:00, data_interval_end=2024-06-27 23:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:00:04.131933636Z [2024-06-27T23:00:04.131+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:00:00+00:00, run_after=2024-06-27T23:02:00+00:00 2024-06-27T23:00:04.152370215Z [2024-06-27T23:00:04.148+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:00:04.152395475Z [2024-06-27T23:00:04.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 22:59:00+00:00, run_id=scheduled__2024-06-27T22:59:00+00:00, run_start_date=2024-06-27 23:00:00.641654+00:00, run_end_date=2024-06-27 23:00:04.148933+00:00, run_duration=3.507279, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:59:00+00:00, data_interval_end=2024-06-27 23:00:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:00:04.188066354Z [2024-06-27T23:00:04.187+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:00:00+00:00, run_after=2024-06-27T23:01:00+00:00 2024-06-27T23:00:04.463802250Z [2024-06-27T23:00:04.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T22:58:00+00:00 exited with status success for try_number 1 2024-06-27T23:00:04.469403906Z [2024-06-27T23:00:04.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:59:00+00:00 exited with status success for try_number 1 2024-06-27T23:00:04.528034976Z [2024-06-27T23:00:04.522+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T22:58:00+00:00, map_index=-1, run_start_date=2024-06-27 23:00:02.989511+00:00, run_end_date=2024-06-27 23:00:03.563290+00:00, run_duration=0.573779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:00:00.721874+00:00, queued_by_job_id=2, pid=1859 2024-06-27T23:00:04.528486300Z [2024-06-27T23:00:04.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:59:00+00:00, map_index=-1, run_start_date=2024-06-27 23:00:02.603407+00:00, run_end_date=2024-06-27 23:00:03.334059+00:00, run_duration=0.730652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:00:00.721874+00:00, queued_by_job_id=2, pid=1858 2024-06-27T23:00:06.307882680Z [2024-06-27T23:00:06.302+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:00:06.307908299Z 2024-06-27T23:00:06.308036292Z [2024-06-27T23:00:06.307+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:00:06.308635809Z [2024-06-27T23:00:06.308+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:00:06.308645118Z 2024-06-27T23:00:06.314798084Z [2024-06-27T23:00:06.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-27T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T23:00:06.315258504Z [2024-06-27T23:00:06.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-27T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:00:06.437846162Z [2024-06-27T23:00:06.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status queued for try_number 1 2024-06-27T23:00:06.448533916Z [2024-06-27T23:00:06.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0cfefe41-00ae-48c7-931b-56523b4ae310 2024-06-27T23:00:06.627310092Z [2024-06-27T23:00:06.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status success for try_number 1 2024-06-27T23:00:06.652124082Z [2024-06-27T23:00:06.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T22:55:00+00:00, map_index=-1, run_start_date=2024-06-27 23:00:05.253161+00:00, run_end_date=2024-06-27 23:00:06.145740+00:00, run_duration=0.892579, state=success, executor_state=success, try_number=1, max_tries=1, job_id=125, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:00:00.721874+00:00, queued_by_job_id=2, pid=1887 2024-06-27T23:00:07.712009191Z [2024-06-27T23:00:07.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:00:07.712299584Z [2024-06-27T23:00:07.712+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:59:00+00:00, run_id=scheduled__2024-06-27T22:59:00+00:00, run_start_date=2024-06-27 23:00:00.639713+00:00, run_end_date=2024-06-27 23:00:07.711922+00:00, run_duration=7.072209, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:59:00+00:00, data_interval_end=2024-06-27 23:00:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:00:07.733487796Z [2024-06-27T23:00:07.729+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:00:00+00:00, run_after=2024-06-27T23:01:00+00:00 2024-06-27T23:00:07.970202944Z [2024-06-27T23:00:07.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:59:00+00:00 exited with status success for try_number 1 2024-06-27T23:00:07.986615235Z [2024-06-27T23:00:07.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:59:00+00:00, map_index=-1, run_start_date=2024-06-27 23:00:05.699359+00:00, run_end_date=2024-06-27 23:00:07.545468+00:00, run_duration=1.846109, state=success, executor_state=success, try_number=1, max_tries=1, job_id=127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:00:00.721874+00:00, queued_by_job_id=2, pid=1890 2024-06-27T23:00:08.423185497Z [2024-06-27T23:00:08.422+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:00:08.423427798Z [2024-06-27T23:00:08.423+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:59:00+00:00, run_id=scheduled__2024-06-27T22:59:00+00:00, run_start_date=2024-06-27 23:00:00.640708+00:00, run_end_date=2024-06-27 23:00:08.423098+00:00, run_duration=7.78239, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:59:00+00:00, data_interval_end=2024-06-27 23:00:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:00:08.456013188Z [2024-06-27T23:00:08.455+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:00:00+00:00, run_after=2024-06-27T23:01:00+00:00 2024-06-27T23:00:08.552370653Z [2024-06-27T23:00:08.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T22:59:00+00:00 exited with status success for try_number 1 2024-06-27T23:00:08.559692944Z [2024-06-27T23:00:08.559+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T22:59:00+00:00, map_index=-1, run_start_date=2024-06-27 23:00:05.536473+00:00, run_end_date=2024-06-27 23:00:07.875210+00:00, run_duration=2.338737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:00:00.721874+00:00, queued_by_job_id=2, pid=1889 2024-06-27T23:00:09.689966555Z [2024-06-27T23:00:09.689+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:00:09.689997099Z 2024-06-27T23:00:09.690656220Z [2024-06-27T23:00:09.689+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:00:09.691715713Z [2024-06-27T23:00:09.691+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:00:09.691731709Z 2024-06-27T23:00:09.694984513Z [2024-06-27T23:00:09.694+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-27T22:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T23:00:09.695093125Z [2024-06-27T23:00:09.694+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-27T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T23:00:09.754783931Z [2024-06-27T23:00:09.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status queued for try_number 1 2024-06-27T23:00:09.754806963Z [2024-06-27T23:00:09.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status success for try_number 1 2024-06-27T23:00:09.761794113Z [2024-06-27T23:00:09.761+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b71510d-06c8-4dba-897c-806cc0d07362 2024-06-27T23:00:09.762058568Z [2024-06-27T23:00:09.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-27T22:55:00+00:00, map_index=-1, run_start_date=2024-06-27 23:00:08.813218+00:00, run_end_date=2024-06-27 23:00:09.187230+00:00, run_duration=0.374012, state=success, executor_state=success, try_number=1, max_tries=1, job_id=128, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:00:06.309066+00:00, queued_by_job_id=2, pid=1913 2024-06-27T23:00:12.473533002Z [2024-06-27T23:00:12.473+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:00:12.473561738Z 2024-06-27T23:00:12.473745739Z [2024-06-27T23:00:12.473+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:00:12.474362716Z [2024-06-27T23:00:12.474+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:00:12.474371662Z 2024-06-27T23:00:12.476443979Z [2024-06-27T23:00:12.476+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-27T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:00:12.477062585Z [2024-06-27T23:00:12.476+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-27T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:00:12.551163506Z [2024-06-27T23:00:12.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status queued for try_number 1 2024-06-27T23:00:12.551269815Z [2024-06-27T23:00:12.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status success for try_number 1 2024-06-27T23:00:12.559636547Z [2024-06-27T23:00:12.559+0000] {scheduler_job.py:635} INFO - Setting external_id for to 864bf4cd-33bf-4ed7-b235-0ab731b80d47 2024-06-27T23:00:12.559856066Z [2024-06-27T23:00:12.559+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-27T22:55:00+00:00, map_index=0, run_start_date=2024-06-27 23:00:11.411716+00:00, run_end_date=2024-06-27 23:00:11.751593+00:00, run_duration=0.339877, state=success, executor_state=success, try_number=1, max_tries=1, job_id=129, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:00:09.692373+00:00, queued_by_job_id=2, pid=1921 2024-06-27T23:00:16.494219511Z [2024-06-27T23:00:16.493+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:00:16.494599074Z [2024-06-27T23:00:16.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 22:55:00+00:00, run_id=scheduled__2024-06-27T22:55:00+00:00, run_start_date=2024-06-27 23:00:00.637164+00:00, run_end_date=2024-06-27 23:00:16.494107+00:00, run_duration=15.856943, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:55:00+00:00, data_interval_end=2024-06-27 23:00:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-27T23:00:16.503774903Z [2024-06-27T23:00:16.503+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:00:00+00:00, run_after=2024-06-27T23:05:00+00:00 2024-06-27T23:00:16.602843324Z [2024-06-27T23:00:16.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status success for try_number 1 2024-06-27T23:00:16.614929823Z [2024-06-27T23:00:16.614+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-27T22:55:00+00:00, map_index=-1, run_start_date=2024-06-27 23:00:14.835492+00:00, run_end_date=2024-06-27 23:00:15.543920+00:00, run_duration=0.708428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:00:12.474721+00:00, queued_by_job_id=2, pid=1929 2024-06-27T23:01:01.032600829Z [2024-06-27T23:01:01.032+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:01:00+00:00, run_after=2024-06-27T23:02:00+00:00 2024-06-27T23:01:01.047559461Z [2024-06-27T23:01:01.047+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:01:00+00:00, run_after=2024-06-27T23:02:00+00:00 2024-06-27T23:01:01.057286129Z [2024-06-27T23:01:01.056+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:01:01.117818123Z [2024-06-27T23:01:01.117+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:01:01.117843421Z 2024-06-27T23:01:01.117849964Z 2024-06-27T23:01:01.117868561Z 2024-06-27T23:01:01.117891512Z [2024-06-27T23:01:01.117+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:01:01.117897437Z [2024-06-27T23:01:01.117+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:01:01.118133357Z [2024-06-27T23:01:01.117+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:01:01.118744520Z [2024-06-27T23:01:01.118+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:01:01.118821291Z 2024-06-27T23:01:01.118828496Z 2024-06-27T23:01:01.118834343Z 2024-06-27T23:01:01.121759622Z [2024-06-27T23:01:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:01:01.121847924Z [2024-06-27T23:01:01.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:01:01.122180926Z [2024-06-27T23:01:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:01:01.122290096Z [2024-06-27T23:01:01.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:01:01.122546013Z [2024-06-27T23:01:01.122+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:01:01.122669671Z [2024-06-27T23:01:01.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:01:01.375444802Z [2024-06-27T23:01:01.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status queued for try_number 1 2024-06-27T23:01:01.378428953Z [2024-06-27T23:01:01.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status queued for try_number 1 2024-06-27T23:01:01.378748893Z [2024-06-27T23:01:01.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status queued for try_number 1 2024-06-27T23:01:01.388122861Z [2024-06-27T23:01:01.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to 363c0c12-417e-4237-9bea-7f131bd2d674 2024-06-27T23:01:01.388319036Z [2024-06-27T23:01:01.388+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d213719-e46c-4b0d-8a0b-b2b3847f23d3 2024-06-27T23:01:01.388466922Z [2024-06-27T23:01:01.388+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa1bc6d3-2336-462e-8033-6ef2e6b0e996 2024-06-27T23:01:02.596356434Z [2024-06-27T23:01:02.595+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:01:02.597424848Z [2024-06-27T23:01:02.596+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:00:00+00:00, run_id=scheduled__2024-06-27T23:00:00+00:00, run_start_date=2024-06-27 23:01:01.068467+00:00, run_end_date=2024-06-27 23:01:02.596247+00:00, run_duration=1.52778, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:00:00+00:00, data_interval_end=2024-06-27 23:01:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:01:02.613968187Z [2024-06-27T23:01:02.613+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:01:00+00:00, run_after=2024-06-27T23:02:00+00:00 2024-06-27T23:01:03.777135600Z [2024-06-27T23:01:03.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status success for try_number 1 2024-06-27T23:01:03.792937253Z [2024-06-27T23:01:03.790+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:00:00+00:00, map_index=-1, run_start_date=2024-06-27 23:01:02.139426+00:00, run_end_date=2024-06-27 23:01:02.573493+00:00, run_duration=0.434067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:01:01.119381+00:00, queued_by_job_id=2, pid=1951 2024-06-27T23:01:05.934621251Z [2024-06-27T23:01:05.934+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:01:05.935041970Z [2024-06-27T23:01:05.934+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:00:00+00:00, run_id=scheduled__2024-06-27T23:00:00+00:00, run_start_date=2024-06-27 23:01:01.070005+00:00, run_end_date=2024-06-27 23:01:05.934722+00:00, run_duration=4.864717, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:00:00+00:00, data_interval_end=2024-06-27 23:01:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:01:05.943848285Z [2024-06-27T23:01:05.943+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:01:00+00:00, run_after=2024-06-27T23:02:00+00:00 2024-06-27T23:01:05.949894280Z [2024-06-27T23:01:05.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:01:05.950235293Z [2024-06-27T23:01:05.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:00:00+00:00, run_id=scheduled__2024-06-27T23:00:00+00:00, run_start_date=2024-06-27 23:01:01.071132+00:00, run_end_date=2024-06-27 23:01:05.949943+00:00, run_duration=4.878811, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:00:00+00:00, data_interval_end=2024-06-27 23:01:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:01:05.959915780Z [2024-06-27T23:01:05.959+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:01:00+00:00, run_after=2024-06-27T23:02:00+00:00 2024-06-27T23:01:05.995793956Z [2024-06-27T23:01:05.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status success for try_number 1 2024-06-27T23:01:05.996547660Z [2024-06-27T23:01:05.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status success for try_number 1 2024-06-27T23:01:06.007929333Z [2024-06-27T23:01:06.007+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:00:00+00:00, map_index=-1, run_start_date=2024-06-27 23:01:03.287339+00:00, run_end_date=2024-06-27 23:01:05.163660+00:00, run_duration=1.876321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:01:01.119381+00:00, queued_by_job_id=2, pid=1970 2024-06-27T23:01:06.009149364Z [2024-06-27T23:01:06.008+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:00:00+00:00, map_index=-1, run_start_date=2024-06-27 23:01:03.212247+00:00, run_end_date=2024-06-27 23:01:05.700454+00:00, run_duration=2.488207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:01:01.119381+00:00, queued_by_job_id=2, pid=1969 2024-06-27T23:01:42.999588097Z [2024-06-27T23:01:42.999+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:01:43.047291206Z [2024-06-27T23:01:43.046+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:01:43.047314107Z 2024-06-27T23:01:43.047429365Z [2024-06-27T23:01:43.047+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 has 0/16 running and queued tasks 2024-06-27T23:01:43.048003434Z [2024-06-27T23:01:43.047+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:01:43.048014940Z 2024-06-27T23:01:43.050422244Z [2024-06-27T23:01:43.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:01:43.050610850Z [2024-06-27T23:01:43.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:01:43.111600247Z [2024-06-27T23:01:43.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status queued for try_number 1 2024-06-27T23:01:43.121094409Z [2024-06-27T23:01:43.120+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdb1d5bf-122d-4f1f-b670-6b5580702a7d 2024-06-27T23:01:44.251323712Z [2024-06-27T23:01:44.251+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T23:01:46.924452420Z [2024-06-27T23:01:46.923+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:01:46.924813882Z [2024-06-27T23:01:46.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, execution_date=2024-06-27 23:00:00+00:00, run_id=scheduled__2024-06-27T23:00:00+00:00, run_start_date=2024-06-27 23:01:43.017464+00:00, run_end_date=2024-06-27 23:01:46.924272+00:00, run_duration=3.906808, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:00:00+00:00, data_interval_end=2024-06-27 23:01:00+00:00, dag_hash=0cd82d0bba611ad18d25491c8cdcb9cd 2024-06-27T23:01:46.938784753Z [2024-06-27T23:01:46.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 to 2024-06-27T23:01:00+00:00, run_after=2024-06-27T23:02:00+00:00 2024-06-27T23:01:46.986195764Z [2024-06-27T23:01:46.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status success for try_number 1 2024-06-27T23:01:46.994563623Z [2024-06-27T23:01:46.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:00:00+00:00, map_index=-1, run_start_date=2024-06-27 23:01:44.761551+00:00, run_end_date=2024-06-27 23:01:46.473616+00:00, run_duration=1.712065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:01:43.048361+00:00, queued_by_job_id=2, pid=2001 2024-06-27T23:01:58.210241799Z [2024-06-27T23:01:58.209+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 to 2024-06-27T23:00:00+00:00, run_after=2024-06-27T23:05:00+00:00 2024-06-27T23:01:58.267791611Z [2024-06-27T23:01:58.267+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:01:58.267810524Z 2024-06-27T23:01:58.267944476Z [2024-06-27T23:01:58.267+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 has 0/16 running and queued tasks 2024-06-27T23:01:58.268812570Z [2024-06-27T23:01:58.268+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:01:58.268823866Z 2024-06-27T23:01:58.271862198Z [2024-06-27T23:01:58.271+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T23:01:58.272056628Z [2024-06-27T23:01:58.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:01:58.359303693Z [2024-06-27T23:01:58.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status queued for try_number 1 2024-06-27T23:01:58.372324116Z [2024-06-27T23:01:58.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to 736f09d6-ebb7-4733-8d88-cca2300c1c60 2024-06-27T23:02:00.422673990Z [2024-06-27T23:02:00.422+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:02:00+00:00, run_after=2024-06-27T23:03:00+00:00 2024-06-27T23:02:00.430160392Z [2024-06-27T23:02:00.429+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:02:00.443156699Z [2024-06-27T23:02:00.442+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:02:00+00:00, run_after=2024-06-27T23:03:00+00:00 2024-06-27T23:02:00.456789287Z [2024-06-27T23:02:00.456+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:02:00.463135684Z [2024-06-27T23:02:00.462+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:02:00.577565247Z [2024-06-27T23:02:00.577+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-06-27T23:02:00.577581162Z 2024-06-27T23:02:00.577584672Z 2024-06-27T23:02:00.577588526Z 2024-06-27T23:02:00.577591574Z 2024-06-27T23:02:00.577606134Z 2024-06-27T23:02:00.577609546Z 2024-06-27T23:02:00.577623976Z [2024-06-27T23:02:00.577+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 has 0/16 running and queued tasks 2024-06-27T23:02:00.577937275Z [2024-06-27T23:02:00.577+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:02:00.578140237Z [2024-06-27T23:02:00.577+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:02:00.578305674Z [2024-06-27T23:02:00.578+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:02:00.578500138Z [2024-06-27T23:02:00.578+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 has 0/16 running and queued tasks 2024-06-27T23:02:00.578588150Z [2024-06-27T23:02:00.578+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:02:00.580833441Z [2024-06-27T23:02:00.580+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:02:00.580849217Z 2024-06-27T23:02:00.580853925Z 2024-06-27T23:02:00.580857752Z 2024-06-27T23:02:00.580861715Z 2024-06-27T23:02:00.580864934Z 2024-06-27T23:02:00.580868520Z 2024-06-27T23:02:00.587310891Z [2024-06-27T23:02:00.586+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', task_id='split_metrics', run_id='scheduled__2024-06-27T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T23:02:00.587590840Z [2024-06-27T23:02:00.587+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', 'split_metrics', 'scheduled__2024-06-27T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:02:00.587914349Z [2024-06-27T23:02:00.587+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:02:00.588108338Z [2024-06-27T23:02:00.587+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:02:00.588379319Z [2024-06-27T23:02:00.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:02:00.588558845Z [2024-06-27T23:02:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:02:00.589155585Z [2024-06-27T23:02:00.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:02:00.591132982Z [2024-06-27T23:02:00.590+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:02:00.591426753Z [2024-06-27T23:02:00.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:02:00.591603563Z [2024-06-27T23:02:00.591+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:02:00.591872941Z [2024-06-27T23:02:00.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:02:00.592070102Z [2024-06-27T23:02:00.591+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:02:01.178182317Z [2024-06-27T23:02:01.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.split_metrics run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status queued for try_number 1 2024-06-27T23:02:01.178238823Z [2024-06-27T23:02:01.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status queued for try_number 1 2024-06-27T23:02:01.178627922Z [2024-06-27T23:02:01.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:01:00+00:00 exited with status queued for try_number 1 2024-06-27T23:02:01.180723741Z [2024-06-27T23:02:01.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:01:00+00:00 exited with status queued for try_number 1 2024-06-27T23:02:01.180880654Z [2024-06-27T23:02:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:01:00+00:00 exited with status queued for try_number 1 2024-06-27T23:02:01.180979964Z [2024-06-27T23:02:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:01:00+00:00 exited with status queued for try_number 1 2024-06-27T23:02:01.181031371Z [2024-06-27T23:02:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status success for try_number 1 2024-06-27T23:02:01.242610620Z [2024-06-27T23:02:01.242+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20c09f62-7445-447c-ac1d-ebec94071d42 2024-06-27T23:02:01.242785718Z [2024-06-27T23:02:01.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T22:55:00+00:00, map_index=-1, run_start_date=2024-06-27 23:02:00.072128+00:00, run_end_date=2024-06-27 23:02:00.457975+00:00, run_duration=0.385847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=135, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:01:58.269265+00:00, queued_by_job_id=2, pid=2014 2024-06-27T23:02:01.242993443Z [2024-06-27T23:02:01.242+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff8f54c0-6298-4899-a56c-03c92132f634 2024-06-27T23:02:01.244369670Z [2024-06-27T23:02:01.244+0000] {scheduler_job.py:635} INFO - Setting external_id for to 310ddde6-019d-45e4-83e0-131a667937d2 2024-06-27T23:02:01.244588201Z [2024-06-27T23:02:01.244+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6fcd19dc-f02b-46fb-8107-aa87d0eaa964 2024-06-27T23:02:01.247524442Z [2024-06-27T23:02:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to af5ceadb-172e-4d94-a604-1a3f5c677f6e 2024-06-27T23:02:01.247746024Z [2024-06-27T23:02:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8436e285-fe31-4438-bb0d-e28c63ea64aa 2024-06-27T23:02:03.499412792Z [2024-06-27T23:02:03.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:02:03.499837131Z [2024-06-27T23:02:03.499+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:00:00+00:00, run_id=scheduled__2024-06-27T23:00:00+00:00, run_start_date=2024-06-27 23:02:00.472423+00:00, run_end_date=2024-06-27 23:02:03.499478+00:00, run_duration=3.027055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:00:00+00:00, data_interval_end=2024-06-27 23:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:02:03.508804693Z [2024-06-27T23:02:03.508+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:02:00+00:00, run_after=2024-06-27T23:04:00+00:00 2024-06-27T23:02:03.516033141Z [2024-06-27T23:02:03.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:02:03.516299928Z [2024-06-27T23:02:03.516+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:01:00+00:00, run_id=scheduled__2024-06-27T23:01:00+00:00, run_start_date=2024-06-27 23:02:00.476188+00:00, run_end_date=2024-06-27 23:02:03.515974+00:00, run_duration=3.039786, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:01:00+00:00, data_interval_end=2024-06-27 23:02:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:02:03.545695243Z [2024-06-27T23:02:03.545+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:02:00+00:00, run_after=2024-06-27T23:03:00+00:00 2024-06-27T23:02:03.640829416Z [2024-06-27T23:02:03.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status success for try_number 1 2024-06-27T23:02:03.641304979Z [2024-06-27T23:02:03.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:01:00+00:00 exited with status success for try_number 1 2024-06-27T23:02:03.655658738Z [2024-06-27T23:02:03.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:00:00+00:00, map_index=-1, run_start_date=2024-06-27 23:02:01.863015+00:00, run_end_date=2024-06-27 23:02:02.485616+00:00, run_duration=0.622601, state=success, executor_state=success, try_number=1, max_tries=1, job_id=136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:02:00.582291+00:00, queued_by_job_id=2, pid=2026 2024-06-27T23:02:03.655938079Z [2024-06-27T23:02:03.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:01:00+00:00, map_index=-1, run_start_date=2024-06-27 23:02:02.464944+00:00, run_end_date=2024-06-27 23:02:02.973350+00:00, run_duration=0.508406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:02:00.582291+00:00, queued_by_job_id=2, pid=2037 2024-06-27T23:02:06.012902164Z [2024-06-27T23:02:06.012+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:02:06.013258122Z [2024-06-27T23:02:06.013+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:01:00+00:00, run_id=scheduled__2024-06-27T23:01:00+00:00, run_start_date=2024-06-27 23:02:00.474222+00:00, run_end_date=2024-06-27 23:02:06.012817+00:00, run_duration=5.538595, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:01:00+00:00, data_interval_end=2024-06-27 23:02:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:02:06.022494916Z [2024-06-27T23:02:06.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:02:00+00:00, run_after=2024-06-27T23:03:00+00:00 2024-06-27T23:02:06.068182683Z [2024-06-27T23:02:06.067+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:02:06.068218814Z 2024-06-27T23:02:06.068366539Z [2024-06-27T23:02:06.068+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 has 0/16 running and queued tasks 2024-06-27T23:02:06.069037349Z [2024-06-27T23:02:06.068+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:02:06.069049793Z 2024-06-27T23:02:06.071653567Z [2024-06-27T23:02:06.071+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', task_id='collect_metrics', run_id='scheduled__2024-06-27T22:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T23:02:06.071832658Z [2024-06-27T23:02:06.071+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', 'collect_metrics', 'scheduled__2024-06-27T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T23:02:06.130333952Z [2024-06-27T23:02:06.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.collect_metrics run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status queued for try_number 1 2024-06-27T23:02:06.130559357Z [2024-06-27T23:02:06.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.split_metrics run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status success for try_number 1 2024-06-27T23:02:06.130670990Z [2024-06-27T23:02:06.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:01:00+00:00 exited with status success for try_number 1 2024-06-27T23:02:06.138184955Z [2024-06-27T23:02:06.137+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b206444-5196-4fa5-bada-6d9f7ccddb03 2024-06-27T23:02:06.138459586Z [2024-06-27T23:02:06.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=split_metrics, run_id=scheduled__2024-06-27T22:55:00+00:00, map_index=-1, run_start_date=2024-06-27 23:02:04.475373+00:00, run_end_date=2024-06-27 23:02:04.910641+00:00, run_duration=0.435268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=140, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:02:00.582291+00:00, queued_by_job_id=2, pid=2074 2024-06-27T23:02:06.138718654Z [2024-06-27T23:02:06.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:01:00+00:00, map_index=-1, run_start_date=2024-06-27 23:02:03.983293+00:00, run_end_date=2024-06-27 23:02:05.593931+00:00, run_duration=1.610638, state=success, executor_state=success, try_number=1, max_tries=1, job_id=139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:02:00.582291+00:00, queued_by_job_id=2, pid=2063 2024-06-27T23:02:07.455779977Z [2024-06-27T23:02:07.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:02:07.456115461Z [2024-06-27T23:02:07.455+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:01:00+00:00, run_id=scheduled__2024-06-27T23:01:00+00:00, run_start_date=2024-06-27 23:02:00.477090+00:00, run_end_date=2024-06-27 23:02:07.455682+00:00, run_duration=6.978592, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:01:00+00:00, data_interval_end=2024-06-27 23:02:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:02:07.465393559Z [2024-06-27T23:02:07.465+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:02:00+00:00, run_after=2024-06-27T23:03:00+00:00 2024-06-27T23:02:07.471988406Z [2024-06-27T23:02:07.471+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:02:07.472349333Z [2024-06-27T23:02:07.472+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, execution_date=2024-06-27 23:01:00+00:00, run_id=scheduled__2024-06-27T23:01:00+00:00, run_start_date=2024-06-27 23:02:00.475254+00:00, run_end_date=2024-06-27 23:02:07.471929+00:00, run_duration=6.996675, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:01:00+00:00, data_interval_end=2024-06-27 23:02:00+00:00, dag_hash=0cd82d0bba611ad18d25491c8cdcb9cd 2024-06-27T23:02:07.482631497Z [2024-06-27T23:02:07.482+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 to 2024-06-27T23:02:00+00:00, run_after=2024-06-27T23:03:00+00:00 2024-06-27T23:02:07.533819955Z [2024-06-27T23:02:07.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:01:00+00:00 exited with status success for try_number 1 2024-06-27T23:02:07.533834243Z [2024-06-27T23:02:07.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:01:00+00:00 exited with status success for try_number 1 2024-06-27T23:02:07.555449147Z [2024-06-27T23:02:07.555+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:01:00+00:00, map_index=-1, run_start_date=2024-06-27 23:02:04.700988+00:00, run_end_date=2024-06-27 23:02:06.557577+00:00, run_duration=1.856589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:02:00.582291+00:00, queued_by_job_id=2, pid=2080 2024-06-27T23:02:07.555982614Z [2024-06-27T23:02:07.555+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:01:00+00:00, map_index=-1, run_start_date=2024-06-27 23:02:03.847661+00:00, run_end_date=2024-06-27 23:02:06.236967+00:00, run_duration=2.389306, state=success, executor_state=success, try_number=1, max_tries=1, job_id=138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:02:00.582291+00:00, queued_by_job_id=2, pid=2057 2024-06-27T23:02:08.652077221Z [2024-06-27T23:02:08.651+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:02:08.652137132Z 2024-06-27T23:02:08.652336023Z [2024-06-27T23:02:08.652+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 has 0/16 running and queued tasks 2024-06-27T23:02:08.653279462Z [2024-06-27T23:02:08.653+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:02:08.653295699Z 2024-06-27T23:02:08.657779538Z [2024-06-27T23:02:08.657+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', task_id='send_prometheus', run_id='scheduled__2024-06-27T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:02:08.657969826Z [2024-06-27T23:02:08.657+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', 'send_prometheus', 'scheduled__2024-06-27T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:02:08.717045038Z [2024-06-27T23:02:08.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.send_prometheus run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status queued for try_number 1 2024-06-27T23:02:08.717066014Z [2024-06-27T23:02:08.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.collect_metrics run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status success for try_number 1 2024-06-27T23:02:08.727061720Z [2024-06-27T23:02:08.726+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7713574-cd0a-4a4f-be2b-3fc7aa40a18b 2024-06-27T23:02:08.727431379Z [2024-06-27T23:02:08.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=collect_metrics, run_id=scheduled__2024-06-27T22:55:00+00:00, map_index=0, run_start_date=2024-06-27 23:02:07.972166+00:00, run_end_date=2024-06-27 23:02:08.284856+00:00, run_duration=0.31269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=142, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:02:06.069659+00:00, queued_by_job_id=2, pid=2093 2024-06-27T23:02:10.579383870Z [2024-06-27T23:02:10.579+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2 to 2024-06-27T23:02:00+00:00, run_after=2024-06-27T23:03:00+00:00 2024-06-27T23:02:10.644546166Z [2024-06-27T23:02:10.642+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:02:10.644568951Z 2024-06-27T23:02:10.644683585Z [2024-06-27T23:02:10.644+0000] {scheduler_job.py:425} INFO - DAG vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2 has 0/16 running and queued tasks 2024-06-27T23:02:10.645385784Z [2024-06-27T23:02:10.645+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:02:10.645395882Z 2024-06-27T23:02:10.647742535Z [2024-06-27T23:02:10.647+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:02:10.647919726Z [2024-06-27T23:02:10.647+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:02:10.718298932Z [2024-06-27T23:02:10.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:01:00+00:00 exited with status queued for try_number 1 2024-06-27T23:02:10.731375690Z [2024-06-27T23:02:10.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f6d4700-02b2-44fe-92f3-119d50edfcd5 2024-06-27T23:02:11.892853582Z [2024-06-27T23:02:11.892+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:02:11.893034454Z [2024-06-27T23:02:11.892+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, execution_date=2024-06-27 22:55:00+00:00, run_id=scheduled__2024-06-27T22:55:00+00:00, run_start_date=2024-06-27 23:01:58.221348+00:00, run_end_date=2024-06-27 23:02:11.892785+00:00, run_duration=13.671437, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 22:55:00+00:00, data_interval_end=2024-06-27 23:00:00+00:00, dag_hash=db46d851de9d0b0add9b52655bea3a60 2024-06-27T23:02:11.900095885Z [2024-06-27T23:02:11.899+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 to 2024-06-27T23:00:00+00:00, run_after=2024-06-27T23:05:00+00:00 2024-06-27T23:02:11.946664070Z [2024-06-27T23:02:11.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.send_prometheus run_id=scheduled__2024-06-27T22:55:00+00:00 exited with status success for try_number 1 2024-06-27T23:02:11.956066973Z [2024-06-27T23:02:11.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=send_prometheus, run_id=scheduled__2024-06-27T22:55:00+00:00, map_index=-1, run_start_date=2024-06-27 23:02:10.532504+00:00, run_end_date=2024-06-27 23:02:10.907924+00:00, run_duration=0.37542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:02:08.653866+00:00, queued_by_job_id=2, pid=2101 2024-06-27T23:02:14.811336582Z [2024-06-27T23:02:14.810+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:02:14.811797827Z [2024-06-27T23:02:14.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2, execution_date=2024-06-27 23:01:00+00:00, run_id=scheduled__2024-06-27T23:01:00+00:00, run_start_date=2024-06-27 23:02:10.591524+00:00, run_end_date=2024-06-27 23:02:14.811452+00:00, run_duration=4.219928, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:01:00+00:00, data_interval_end=2024-06-27 23:02:00+00:00, dag_hash=446a7141a579a5f8aebb5156c02c4e21 2024-06-27T23:02:14.821327272Z [2024-06-27T23:02:14.821+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2 to 2024-06-27T23:02:00+00:00, run_after=2024-06-27T23:03:00+00:00 2024-06-27T23:02:14.856331985Z [2024-06-27T23:02:14.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:01:00+00:00 exited with status success for try_number 1 2024-06-27T23:02:14.862143318Z [2024-06-27T23:02:14.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:01:00+00:00, map_index=-1, run_start_date=2024-06-27 23:02:12.339402+00:00, run_end_date=2024-06-27 23:02:13.619815+00:00, run_duration=1.280413, state=success, executor_state=success, try_number=1, max_tries=1, job_id=144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:02:10.645775+00:00, queued_by_job_id=2, pid=2109 2024-06-27T23:03:00.919836895Z [2024-06-27T23:03:00.919+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:03:00+00:00, run_after=2024-06-27T23:04:00+00:00 2024-06-27T23:03:00.932938810Z [2024-06-27T23:03:00.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:03:00+00:00, run_after=2024-06-27T23:04:00+00:00 2024-06-27T23:03:00.945952730Z [2024-06-27T23:03:00.945+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2 to 2024-06-27T23:03:00+00:00, run_after=2024-06-27T23:04:00+00:00 2024-06-27T23:03:00.952858699Z [2024-06-27T23:03:00.952+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:03:00.959494535Z [2024-06-27T23:03:00.959+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:03:01.057555957Z [2024-06-27T23:03:01.057+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T23:03:01.057571798Z 2024-06-27T23:03:01.057575284Z 2024-06-27T23:03:01.057578300Z 2024-06-27T23:03:01.057581459Z 2024-06-27T23:03:01.057584838Z 2024-06-27T23:03:01.057587901Z [2024-06-27T23:03:01.057+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:03:01.057636064Z [2024-06-27T23:03:01.057+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:03:01.057723464Z [2024-06-27T23:03:01.057+0000] {scheduler_job.py:425} INFO - DAG vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2 has 0/16 running and queued tasks 2024-06-27T23:03:01.057809331Z [2024-06-27T23:03:01.057+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 has 0/16 running and queued tasks 2024-06-27T23:03:01.057890686Z [2024-06-27T23:03:01.057+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:03:01.058419619Z [2024-06-27T23:03:01.058+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:03:01.058437437Z 2024-06-27T23:03:01.058440867Z 2024-06-27T23:03:01.058443807Z 2024-06-27T23:03:01.058446999Z 2024-06-27T23:03:01.058450190Z 2024-06-27T23:03:01.061789810Z [2024-06-27T23:03:01.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:03:01.061853584Z [2024-06-27T23:03:01.061+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:03:01.062087684Z [2024-06-27T23:03:01.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:03:01.062176482Z [2024-06-27T23:03:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:03:01.062367913Z [2024-06-27T23:03:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:03:01.062432266Z [2024-06-27T23:03:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:03:01.062599190Z [2024-06-27T23:03:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:03:01.062653878Z [2024-06-27T23:03:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:03:01.062824411Z [2024-06-27T23:03:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:03:01.062943475Z [2024-06-27T23:03:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:03:01.656162384Z [2024-06-27T23:03:01.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:02:00+00:00 exited with status queued for try_number 1 2024-06-27T23:03:01.658274192Z [2024-06-27T23:03:01.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:02:00+00:00 exited with status queued for try_number 1 2024-06-27T23:03:01.663030398Z [2024-06-27T23:03:01.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:02:00+00:00 exited with status queued for try_number 1 2024-06-27T23:03:01.663302568Z [2024-06-27T23:03:01.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:02:00+00:00 exited with status queued for try_number 1 2024-06-27T23:03:01.663582831Z [2024-06-27T23:03:01.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:02:00+00:00 exited with status queued for try_number 1 2024-06-27T23:03:01.688083658Z [2024-06-27T23:03:01.687+0000] {scheduler_job.py:635} INFO - Setting external_id for to c803f19a-7137-4f95-ab1d-2d70cfe8fb19 2024-06-27T23:03:01.688293988Z [2024-06-27T23:03:01.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to f19118f7-c295-43e4-8c1c-f2f64b17069e 2024-06-27T23:03:01.688445569Z [2024-06-27T23:03:01.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b7ab021-1b4d-4a25-8560-c71af72f38d8 2024-06-27T23:03:01.688903910Z [2024-06-27T23:03:01.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f4d0c17-656c-4cef-af45-9a4ea27d4b2a 2024-06-27T23:03:01.689119387Z [2024-06-27T23:03:01.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf0f20c5-a295-4373-bc54-60df74771e7f 2024-06-27T23:03:04.676210242Z [2024-06-27T23:03:04.675+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:03:04.676516356Z [2024-06-27T23:03:04.676+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:02:00+00:00, run_id=scheduled__2024-06-27T23:02:00+00:00, run_start_date=2024-06-27 23:03:00.972415+00:00, run_end_date=2024-06-27 23:03:04.676150+00:00, run_duration=3.703735, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:02:00+00:00, data_interval_end=2024-06-27 23:03:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:03:04.698281555Z [2024-06-27T23:03:04.697+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:03:00+00:00, run_after=2024-06-27T23:04:00+00:00 2024-06-27T23:03:04.813022024Z [2024-06-27T23:03:04.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:02:00+00:00 exited with status success for try_number 1 2024-06-27T23:03:04.824429493Z [2024-06-27T23:03:04.824+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:02:00+00:00, map_index=-1, run_start_date=2024-06-27 23:03:02.881418+00:00, run_end_date=2024-06-27 23:03:03.522213+00:00, run_duration=0.640795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:03:01.059146+00:00, queued_by_job_id=2, pid=2138 2024-06-27T23:03:08.389452162Z [2024-06-27T23:03:08.389+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:03:08.389584409Z [2024-06-27T23:03:08.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2, execution_date=2024-06-27 23:02:00+00:00, run_id=scheduled__2024-06-27T23:02:00+00:00, run_start_date=2024-06-27 23:03:00.976292+00:00, run_end_date=2024-06-27 23:03:08.389343+00:00, run_duration=7.413051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:02:00+00:00, data_interval_end=2024-06-27 23:03:00+00:00, dag_hash=446a7141a579a5f8aebb5156c02c4e21 2024-06-27T23:03:08.399814619Z [2024-06-27T23:03:08.399+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2 to 2024-06-27T23:03:00+00:00, run_after=2024-06-27T23:04:00+00:00 2024-06-27T23:03:08.409022422Z [2024-06-27T23:03:08.408+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:03:08.409187923Z [2024-06-27T23:03:08.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, execution_date=2024-06-27 23:02:00+00:00, run_id=scheduled__2024-06-27T23:02:00+00:00, run_start_date=2024-06-27 23:03:00.978487+00:00, run_end_date=2024-06-27 23:03:08.408957+00:00, run_duration=7.43047, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:02:00+00:00, data_interval_end=2024-06-27 23:03:00+00:00, dag_hash=0cd82d0bba611ad18d25491c8cdcb9cd 2024-06-27T23:03:08.418546516Z [2024-06-27T23:03:08.418+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 to 2024-06-27T23:03:00+00:00, run_after=2024-06-27T23:04:00+00:00 2024-06-27T23:03:08.425661361Z [2024-06-27T23:03:08.425+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:03:08.425871078Z [2024-06-27T23:03:08.425+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:02:00+00:00, run_id=scheduled__2024-06-27T23:02:00+00:00, run_start_date=2024-06-27 23:03:00.974374+00:00, run_end_date=2024-06-27 23:03:08.425592+00:00, run_duration=7.451218, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:02:00+00:00, data_interval_end=2024-06-27 23:03:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:03:08.439185096Z [2024-06-27T23:03:08.438+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:03:00+00:00, run_after=2024-06-27T23:04:00+00:00 2024-06-27T23:03:08.448178198Z [2024-06-27T23:03:08.447+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:03:08.448362826Z [2024-06-27T23:03:08.448+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:02:00+00:00, run_id=scheduled__2024-06-27T23:02:00+00:00, run_start_date=2024-06-27 23:03:00.980558+00:00, run_end_date=2024-06-27 23:03:08.448072+00:00, run_duration=7.467514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:02:00+00:00, data_interval_end=2024-06-27 23:03:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:03:08.459913497Z [2024-06-27T23:03:08.458+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:03:00+00:00, run_after=2024-06-27T23:04:00+00:00 2024-06-27T23:03:08.503140917Z [2024-06-27T23:03:08.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:02:00+00:00 exited with status success for try_number 1 2024-06-27T23:03:08.503202833Z [2024-06-27T23:03:08.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:02:00+00:00 exited with status success for try_number 1 2024-06-27T23:03:08.503307321Z [2024-06-27T23:03:08.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:02:00+00:00 exited with status success for try_number 1 2024-06-27T23:03:08.503400579Z [2024-06-27T23:03:08.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:02:00+00:00 exited with status success for try_number 1 2024-06-27T23:03:08.521465693Z [2024-06-27T23:03:08.520+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:02:00+00:00, map_index=-1, run_start_date=2024-06-27 23:03:04.855662+00:00, run_end_date=2024-06-27 23:03:07.216972+00:00, run_duration=2.36131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:03:01.059146+00:00, queued_by_job_id=2, pid=2158 2024-06-27T23:03:08.521674514Z [2024-06-27T23:03:08.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:02:00+00:00, map_index=-1, run_start_date=2024-06-27 23:03:04.912857+00:00, run_end_date=2024-06-27 23:03:07.349118+00:00, run_duration=2.436261, state=success, executor_state=success, try_number=1, max_tries=1, job_id=147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:03:01.059146+00:00, queued_by_job_id=2, pid=2159 2024-06-27T23:03:08.521895857Z [2024-06-27T23:03:08.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:02:00+00:00, map_index=-1, run_start_date=2024-06-27 23:03:06.003252+00:00, run_end_date=2024-06-27 23:03:07.476337+00:00, run_duration=1.473085, state=success, executor_state=success, try_number=1, max_tries=1, job_id=149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:03:01.059146+00:00, queued_by_job_id=2, pid=2181 2024-06-27T23:03:08.522109538Z [2024-06-27T23:03:08.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:02:00+00:00, map_index=-1, run_start_date=2024-06-27 23:03:05.868459+00:00, run_end_date=2024-06-27 23:03:07.812833+00:00, run_duration=1.944374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:03:01.059146+00:00, queued_by_job_id=2, pid=2180 2024-06-27T23:04:00.252571810Z [2024-06-27T23:04:00.252+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:04:00.269205737Z [2024-06-27T23:04:00.268+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:04:00+00:00, run_after=2024-06-27T23:05:00+00:00 2024-06-27T23:04:00.277807125Z [2024-06-27T23:04:00.277+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:04:00.297852557Z [2024-06-27T23:04:00.297+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2 to 2024-06-27T23:04:00+00:00, run_after=2024-06-27T23:05:00+00:00 2024-06-27T23:04:00.312608906Z [2024-06-27T23:04:00.311+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:04:00.340846568Z [2024-06-27T23:04:00.340+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:04:00+00:00, run_after=2024-06-27T23:05:00+00:00 2024-06-27T23:04:00.461018738Z [2024-06-27T23:04:00.460+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-06-27T23:04:00.461066591Z 2024-06-27T23:04:00.461077760Z 2024-06-27T23:04:00.461086954Z 2024-06-27T23:04:00.461095702Z 2024-06-27T23:04:00.461132181Z 2024-06-27T23:04:00.461141289Z 2024-06-27T23:04:00.461535381Z [2024-06-27T23:04:00.461+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:04:00.461938951Z [2024-06-27T23:04:00.461+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:04:00.462269094Z [2024-06-27T23:04:00.462+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 has 0/16 running and queued tasks 2024-06-27T23:04:00.462605519Z [2024-06-27T23:04:00.462+0000] {scheduler_job.py:425} INFO - DAG vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2 has 0/16 running and queued tasks 2024-06-27T23:04:00.462981872Z [2024-06-27T23:04:00.462+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:04:00.463311329Z [2024-06-27T23:04:00.463+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:04:00.464663480Z [2024-06-27T23:04:00.464+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:04:00.464681283Z 2024-06-27T23:04:00.464687709Z 2024-06-27T23:04:00.464693288Z 2024-06-27T23:04:00.464699139Z 2024-06-27T23:04:00.464704820Z 2024-06-27T23:04:00.464709919Z 2024-06-27T23:04:00.471693465Z [2024-06-27T23:04:00.471+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:04:00.471994747Z [2024-06-27T23:04:00.471+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:04:00.472383362Z [2024-06-27T23:04:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:04:00.472610541Z [2024-06-27T23:04:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:04:00.473123401Z [2024-06-27T23:04:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:04:00.473362531Z [2024-06-27T23:04:00.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:04:00.473846405Z [2024-06-27T23:04:00.473+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:04:00.474070886Z [2024-06-27T23:04:00.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:04:00.474447825Z [2024-06-27T23:04:00.474+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:04:00.474670385Z [2024-06-27T23:04:00.474+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:04:00.475260982Z [2024-06-27T23:04:00.475+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:04:00.475374948Z [2024-06-27T23:04:00.475+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:04:01.100241905Z [2024-06-27T23:04:01.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:02:00+00:00 exited with status queued for try_number 1 2024-06-27T23:04:01.100994507Z [2024-06-27T23:04:01.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:03:00+00:00 exited with status queued for try_number 1 2024-06-27T23:04:01.101168195Z [2024-06-27T23:04:01.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:03:00+00:00 exited with status queued for try_number 1 2024-06-27T23:04:01.101257561Z [2024-06-27T23:04:01.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:03:00+00:00 exited with status queued for try_number 1 2024-06-27T23:04:01.101379621Z [2024-06-27T23:04:01.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:03:00+00:00 exited with status queued for try_number 1 2024-06-27T23:04:01.101527712Z [2024-06-27T23:04:01.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:03:00+00:00 exited with status queued for try_number 1 2024-06-27T23:04:01.115169724Z [2024-06-27T23:04:01.114+0000] {scheduler_job.py:635} INFO - Setting external_id for to e750105d-f706-41ce-b955-08cb634d123f 2024-06-27T23:04:01.115574958Z [2024-06-27T23:04:01.115+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ec7d197-65f0-4dbe-8dcc-1b22c2b12d07 2024-06-27T23:04:01.115968938Z [2024-06-27T23:04:01.115+0000] {scheduler_job.py:635} INFO - Setting external_id for to aba13ee2-8fa8-49cf-b2c5-2495835336dc 2024-06-27T23:04:01.116475920Z [2024-06-27T23:04:01.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e887983-b984-41b9-a0f9-ffff9d9c9be1 2024-06-27T23:04:01.116722977Z [2024-06-27T23:04:01.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1dc6026f-06de-489e-a64c-150f1f1eb8f1 2024-06-27T23:04:01.116968413Z [2024-06-27T23:04:01.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8d2533e-9028-4a4b-9c91-f8163ad4b3b6 2024-06-27T23:04:03.675599276Z [2024-06-27T23:04:03.675+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:04:03.676267945Z [2024-06-27T23:04:03.676+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:02:00+00:00, run_id=scheduled__2024-06-27T23:02:00+00:00, run_start_date=2024-06-27 23:04:00.354312+00:00, run_end_date=2024-06-27 23:04:03.675841+00:00, run_duration=3.321529, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:02:00+00:00, data_interval_end=2024-06-27 23:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:04:03.683818650Z [2024-06-27T23:04:03.683+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:04:00+00:00, run_after=2024-06-27T23:06:00+00:00 2024-06-27T23:04:03.690880463Z [2024-06-27T23:04:03.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:04:03.691223992Z [2024-06-27T23:04:03.690+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:03:00+00:00, run_id=scheduled__2024-06-27T23:03:00+00:00, run_start_date=2024-06-27 23:04:00.355703+00:00, run_end_date=2024-06-27 23:04:03.690835+00:00, run_duration=3.335132, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:03:00+00:00, data_interval_end=2024-06-27 23:04:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:04:03.702289146Z [2024-06-27T23:04:03.702+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:04:00+00:00, run_after=2024-06-27T23:05:00+00:00 2024-06-27T23:04:03.800516341Z [2024-06-27T23:04:03.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:02:00+00:00 exited with status success for try_number 1 2024-06-27T23:04:03.800533856Z [2024-06-27T23:04:03.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:03:00+00:00 exited with status success for try_number 1 2024-06-27T23:04:03.815451877Z [2024-06-27T23:04:03.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:02:00+00:00, map_index=-1, run_start_date=2024-06-27 23:04:01.655072+00:00, run_end_date=2024-06-27 23:04:02.530746+00:00, run_duration=0.875674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:04:00.467372+00:00, queued_by_job_id=2, pid=2212 2024-06-27T23:04:03.815467165Z [2024-06-27T23:04:03.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:03:00+00:00, map_index=-1, run_start_date=2024-06-27 23:04:02.437062+00:00, run_end_date=2024-06-27 23:04:03.202468+00:00, run_duration=0.765406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:04:00.467372+00:00, queued_by_job_id=2, pid=2224 2024-06-27T23:04:05.718322384Z [2024-06-27T23:04:05.717+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:04:05.718519013Z [2024-06-27T23:04:05.718+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2, execution_date=2024-06-27 23:03:00+00:00, run_id=scheduled__2024-06-27T23:03:00+00:00, run_start_date=2024-06-27 23:04:00.358457+00:00, run_end_date=2024-06-27 23:04:05.718253+00:00, run_duration=5.359796, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:03:00+00:00, data_interval_end=2024-06-27 23:04:00+00:00, dag_hash=446a7141a579a5f8aebb5156c02c4e21 2024-06-27T23:04:05.735462055Z [2024-06-27T23:04:05.734+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2 to 2024-06-27T23:04:00+00:00, run_after=2024-06-27T23:05:00+00:00 2024-06-27T23:04:06.940519810Z [2024-06-27T23:04:06.940+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:04:06.940824602Z [2024-06-27T23:04:06.940+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, execution_date=2024-06-27 23:03:00+00:00, run_id=scheduled__2024-06-27T23:03:00+00:00, run_start_date=2024-06-27 23:04:00.356950+00:00, run_end_date=2024-06-27 23:04:06.940493+00:00, run_duration=6.583543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:03:00+00:00, data_interval_end=2024-06-27 23:04:00+00:00, dag_hash=0cd82d0bba611ad18d25491c8cdcb9cd 2024-06-27T23:04:06.948720710Z [2024-06-27T23:04:06.948+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 to 2024-06-27T23:04:00+00:00, run_after=2024-06-27T23:05:00+00:00 2024-06-27T23:04:06.955034456Z [2024-06-27T23:04:06.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:04:06.955347693Z [2024-06-27T23:04:06.955+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:03:00+00:00, run_id=scheduled__2024-06-27T23:03:00+00:00, run_start_date=2024-06-27 23:04:00.360716+00:00, run_end_date=2024-06-27 23:04:06.954957+00:00, run_duration=6.594241, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:03:00+00:00, data_interval_end=2024-06-27 23:04:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:04:06.964188086Z [2024-06-27T23:04:06.963+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:04:00+00:00, run_after=2024-06-27T23:05:00+00:00 2024-06-27T23:04:06.970657127Z [2024-06-27T23:04:06.970+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:04:06.970925154Z [2024-06-27T23:04:06.970+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:03:00+00:00, run_id=scheduled__2024-06-27T23:03:00+00:00, run_start_date=2024-06-27 23:04:00.359647+00:00, run_end_date=2024-06-27 23:04:06.970595+00:00, run_duration=6.610948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:03:00+00:00, data_interval_end=2024-06-27 23:04:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:04:06.980382867Z [2024-06-27T23:04:06.980+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:04:00+00:00, run_after=2024-06-27T23:05:00+00:00 2024-06-27T23:04:07.048936148Z [2024-06-27T23:04:07.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:03:00+00:00 exited with status success for try_number 1 2024-06-27T23:04:07.049178964Z [2024-06-27T23:04:07.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:03:00+00:00 exited with status success for try_number 1 2024-06-27T23:04:07.049681918Z [2024-06-27T23:04:07.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:03:00+00:00 exited with status success for try_number 1 2024-06-27T23:04:07.049890849Z [2024-06-27T23:04:07.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:03:00+00:00 exited with status success for try_number 1 2024-06-27T23:04:07.065911215Z [2024-06-27T23:04:07.065+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:03:00+00:00, map_index=-1, run_start_date=2024-06-27 23:04:03.768243+00:00, run_end_date=2024-06-27 23:04:05.572329+00:00, run_duration=1.804086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:04:00.467372+00:00, queued_by_job_id=2, pid=2244 2024-06-27T23:04:07.071398908Z [2024-06-27T23:04:07.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:03:00+00:00, map_index=-1, run_start_date=2024-06-27 23:04:03.621185+00:00, run_end_date=2024-06-27 23:04:05.691360+00:00, run_duration=2.070175, state=success, executor_state=success, try_number=1, max_tries=1, job_id=152, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:04:00.467372+00:00, queued_by_job_id=2, pid=2243 2024-06-27T23:04:07.073789512Z [2024-06-27T23:04:07.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:03:00+00:00, map_index=-1, run_start_date=2024-06-27 23:04:04.633569+00:00, run_end_date=2024-06-27 23:04:06.457842+00:00, run_duration=1.824273, state=success, executor_state=success, try_number=1, max_tries=1, job_id=155, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:04:00.467372+00:00, queued_by_job_id=2, pid=2266 2024-06-27T23:04:07.077388998Z [2024-06-27T23:04:07.077+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:03:00+00:00, map_index=-1, run_start_date=2024-06-27 23:04:04.359718+00:00, run_end_date=2024-06-27 23:04:06.477211+00:00, run_duration=2.117493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=154, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:04:00.467372+00:00, queued_by_job_id=2, pid=2265 2024-06-27T23:05:00.362942243Z [2024-06-27T23:05:00.362+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:05:00.379815462Z [2024-06-27T23:05:00.379+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 to 2024-06-27T23:05:00+00:00, run_after=2024-06-27T23:10:00+00:00 2024-06-27T23:05:00.393792824Z [2024-06-27T23:05:00.393+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2 to 2024-06-27T23:05:00+00:00, run_after=2024-06-27T23:06:00+00:00 2024-06-27T23:05:00.405397602Z [2024-06-27T23:05:00.405+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:05:00+00:00, run_after=2024-06-27T23:06:00+00:00 2024-06-27T23:05:00.417219856Z [2024-06-27T23:05:00.416+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:05:00+00:00, run_after=2024-06-27T23:06:00+00:00 2024-06-27T23:05:00.430978256Z [2024-06-27T23:05:00.430+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:05:00+00:00, run_after=2024-06-27T23:10:00+00:00 2024-06-27T23:05:00.440822885Z [2024-06-27T23:05:00.440+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:05:00.566000751Z [2024-06-27T23:05:00.565+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-06-27T23:05:00.566017662Z 2024-06-27T23:05:00.566021154Z 2024-06-27T23:05:00.566024860Z 2024-06-27T23:05:00.566043920Z 2024-06-27T23:05:00.566047629Z 2024-06-27T23:05:00.566050692Z 2024-06-27T23:05:00.566053593Z 2024-06-27T23:05:00.566552796Z [2024-06-27T23:05:00.566+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:05:00.566981950Z [2024-06-27T23:05:00.566+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 has 0/16 running and queued tasks 2024-06-27T23:05:00.567311492Z [2024-06-27T23:05:00.567+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 has 0/16 running and queued tasks 2024-06-27T23:05:00.567767992Z [2024-06-27T23:05:00.567+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:05:00.568237763Z [2024-06-27T23:05:00.568+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:05:00.568708637Z [2024-06-27T23:05:00.568+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:05:00.569045439Z [2024-06-27T23:05:00.568+0000] {scheduler_job.py:425} INFO - DAG vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2 has 0/16 running and queued tasks 2024-06-27T23:05:00.570331501Z [2024-06-27T23:05:00.570+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:05:00.570337405Z 2024-06-27T23:05:00.570340899Z 2024-06-27T23:05:00.570344649Z 2024-06-27T23:05:00.570348098Z 2024-06-27T23:05:00.570351561Z 2024-06-27T23:05:00.570354986Z 2024-06-27T23:05:00.570358225Z 2024-06-27T23:05:00.577320353Z [2024-06-27T23:05:00.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T23:05:00.577656180Z [2024-06-27T23:05:00.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:05:00.578067284Z [2024-06-27T23:05:00.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T23:05:00.578335961Z [2024-06-27T23:05:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:05:00.578746539Z [2024-06-27T23:05:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:05:00.579014695Z [2024-06-27T23:05:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:05:00.579386024Z [2024-06-27T23:05:00.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:05:00.579665878Z [2024-06-27T23:05:00.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:05:00.580032302Z [2024-06-27T23:05:00.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:05:00.580272882Z [2024-06-27T23:05:00.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:05:00.580580234Z [2024-06-27T23:05:00.580+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:05:00.580782618Z [2024-06-27T23:05:00.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:05:00.581102629Z [2024-06-27T23:05:00.580+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:05:00.581326168Z [2024-06-27T23:05:00.581+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:05:01.230019821Z [2024-06-27T23:05:01.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status queued for try_number 1 2024-06-27T23:05:01.230243857Z [2024-06-27T23:05:01.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status queued for try_number 1 2024-06-27T23:05:01.230394261Z [2024-06-27T23:05:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:04:00+00:00 exited with status queued for try_number 1 2024-06-27T23:05:01.230586792Z [2024-06-27T23:05:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:04:00+00:00 exited with status queued for try_number 1 2024-06-27T23:05:01.230748912Z [2024-06-27T23:05:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:04:00+00:00 exited with status queued for try_number 1 2024-06-27T23:05:01.230935265Z [2024-06-27T23:05:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:04:00+00:00 exited with status queued for try_number 1 2024-06-27T23:05:01.231061774Z [2024-06-27T23:05:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:04:00+00:00 exited with status queued for try_number 1 2024-06-27T23:05:01.241413617Z [2024-06-27T23:05:01.241+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37bfae1c-115a-4f98-9836-af2c2bacde39 2024-06-27T23:05:01.243292793Z [2024-06-27T23:05:01.241+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a08d913-db9c-48dd-95c8-c374409ef01a 2024-06-27T23:05:01.243490110Z [2024-06-27T23:05:01.243+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8282e559-aea2-443a-85f2-451143c6a72b 2024-06-27T23:05:01.243688934Z [2024-06-27T23:05:01.243+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08f32589-2f1a-4c40-9d0e-9bb18660e535 2024-06-27T23:05:01.243860560Z [2024-06-27T23:05:01.243+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ab40f77-1a73-4bdb-9487-794ca4bb4432 2024-06-27T23:05:01.244034537Z [2024-06-27T23:05:01.243+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ee84862-79d9-40cd-80b8-2e174e5a3fa0 2024-06-27T23:05:01.244214038Z [2024-06-27T23:05:01.244+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56cab143-c77d-439c-81f0-6e44e866d9e7 2024-06-27T23:05:02.949578581Z [2024-06-27T23:05:02.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:05:02.949915624Z [2024-06-27T23:05:02.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:04:00+00:00, run_id=scheduled__2024-06-27T23:04:00+00:00, run_start_date=2024-06-27 23:05:00.454730+00:00, run_end_date=2024-06-27 23:05:02.949515+00:00, run_duration=2.494785, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:04:00+00:00, data_interval_end=2024-06-27 23:05:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:05:02.965565595Z [2024-06-27T23:05:02.965+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:05:00+00:00, run_after=2024-06-27T23:06:00+00:00 2024-06-27T23:05:03.199144938Z [2024-06-27T23:05:03.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:04:00+00:00 exited with status success for try_number 1 2024-06-27T23:05:03.216953720Z [2024-06-27T23:05:03.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:04:00+00:00, map_index=-1, run_start_date=2024-06-27 23:05:02.040944+00:00, run_end_date=2024-06-27 23:05:02.516350+00:00, run_duration=0.475406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=156, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:05:00.572835+00:00, queued_by_job_id=2, pid=2303 2024-06-27T23:05:04.605757193Z [2024-06-27T23:05:04.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:04:00+00:00 exited with status failed for try_number 1 2024-06-27T23:05:04.620803616Z [2024-06-27T23:05:04.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:04:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:05:00.572835+00:00, queued_by_job_id=2, pid=None 2024-06-27T23:05:04.621158966Z [2024-06-27T23:05:04.620+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T23:05:04.625411478Z [2024-06-27T23:05:04.625+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T23:05:04.655110383Z [2024-06-27T23:05:04.654+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240627T230400, start_date=, end_date=20240627T230504 2024-06-27T23:05:05.957070698Z [2024-06-27T23:05:05.956+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:05:05.957088892Z 2024-06-27T23:05:05.959359625Z [2024-06-27T23:05:05.957+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:05:05.962521015Z [2024-06-27T23:05:05.962+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:05:05.962537191Z 2024-06-27T23:05:05.965144818Z [2024-06-27T23:05:05.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-27T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T23:05:05.966328406Z [2024-06-27T23:05:05.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-27T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:05:06.063504171Z [2024-06-27T23:05:06.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status queued for try_number 1 2024-06-27T23:05:06.063605080Z [2024-06-27T23:05:06.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status success for try_number 1 2024-06-27T23:05:06.063741065Z [2024-06-27T23:05:06.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status failed for try_number 1 2024-06-27T23:05:06.063881243Z [2024-06-27T23:05:06.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:04:00+00:00 exited with status failed for try_number 1 2024-06-27T23:05:06.072111441Z [2024-06-27T23:05:06.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:04:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:05:00.572835+00:00, queued_by_job_id=2, pid=None 2024-06-27T23:05:06.072642010Z [2024-06-27T23:05:06.072+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T23:05:06.080848865Z [2024-06-27T23:05:06.079+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T23:05:06.116193652Z [2024-06-27T23:05:06.115+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240627T230400, start_date=, end_date=20240627T230506 2024-06-27T23:05:06.141148000Z [2024-06-27T23:05:06.140+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T23:00:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:05:00.572835+00:00, queued_by_job_id=2, pid=None 2024-06-27T23:05:06.147458604Z [2024-06-27T23:05:06.147+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T23:05:06.150126699Z [2024-06-27T23:05:06.149+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T23:05:06.173970717Z [2024-06-27T23:05:06.173+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=extract_metrics_from_vnfrs, execution_date=20240627T230000, start_date=, end_date=20240627T230506 2024-06-27T23:05:06.187139237Z [2024-06-27T23:05:06.186+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T23:00:00+00:00, map_index=-1, run_start_date=2024-06-27 23:05:03.709877+00:00, run_end_date=2024-06-27 23:05:04.392317+00:00, run_duration=0.68244, state=success, executor_state=success, try_number=1, max_tries=1, job_id=157, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:05:00.572835+00:00, queued_by_job_id=2, pid=2319 2024-06-27T23:05:06.187534756Z [2024-06-27T23:05:06.187+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8689e14b-4014-4c5d-8168-8fa7738723ec 2024-06-27T23:05:07.571935151Z [2024-06-27T23:05:07.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:05:07.572882421Z [2024-06-27T23:05:07.572+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:04:00+00:00, run_id=scheduled__2024-06-27T23:04:00+00:00, run_start_date=2024-06-27 23:05:00.453657+00:00, run_end_date=2024-06-27 23:05:07.571993+00:00, run_duration=7.118336, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:04:00+00:00, data_interval_end=2024-06-27 23:05:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:05:07.585759159Z [2024-06-27T23:05:07.585+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:05:00+00:00, run_after=2024-06-27T23:06:00+00:00 2024-06-27T23:05:07.592679164Z [2024-06-27T23:05:07.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:05:07.593022668Z [2024-06-27T23:05:07.592+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:04:00+00:00, run_id=scheduled__2024-06-27T23:04:00+00:00, run_start_date=2024-06-27 23:05:00.457238+00:00, run_end_date=2024-06-27 23:05:07.592665+00:00, run_duration=7.135427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:04:00+00:00, data_interval_end=2024-06-27 23:05:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:05:07.602447531Z [2024-06-27T23:05:07.602+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:05:00+00:00, run_after=2024-06-27T23:06:00+00:00 2024-06-27T23:05:07.700214093Z [2024-06-27T23:05:07.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:04:00+00:00 exited with status success for try_number 1 2024-06-27T23:05:07.700421748Z [2024-06-27T23:05:07.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:04:00+00:00 exited with status success for try_number 1 2024-06-27T23:05:07.715208174Z [2024-06-27T23:05:07.714+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:04:00+00:00, map_index=-1, run_start_date=2024-06-27 23:05:05.050960+00:00, run_end_date=2024-06-27 23:05:06.712869+00:00, run_duration=1.661909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:05:00.572835+00:00, queued_by_job_id=2, pid=2362 2024-06-27T23:05:07.721221739Z [2024-06-27T23:05:07.720+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:04:00+00:00, map_index=-1, run_start_date=2024-06-27 23:05:05.402319+00:00, run_end_date=2024-06-27 23:05:07.399388+00:00, run_duration=1.997069, state=success, executor_state=success, try_number=1, max_tries=1, job_id=159, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:05:00.572835+00:00, queued_by_job_id=2, pid=2366 2024-06-27T23:05:08.895562579Z [2024-06-27T23:05:08.895+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:05:08.895573308Z 2024-06-27T23:05:08.895751263Z [2024-06-27T23:05:08.895+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:05:08.896526834Z [2024-06-27T23:05:08.896+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:05:08.896538933Z 2024-06-27T23:05:08.899047473Z [2024-06-27T23:05:08.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-27T23:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T23:05:08.899159190Z [2024-06-27T23:05:08.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-27T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T23:05:08.963396683Z [2024-06-27T23:05:08.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status queued for try_number 1 2024-06-27T23:05:08.972856450Z [2024-06-27T23:05:08.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1cebe44-5083-4de9-8e39-3a70d64b8471 2024-06-27T23:05:09.107164525Z [2024-06-27T23:05:09.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status success for try_number 1 2024-06-27T23:05:09.132195171Z [2024-06-27T23:05:09.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-27T23:00:00+00:00, map_index=-1, run_start_date=2024-06-27 23:05:08.344945+00:00, run_end_date=2024-06-27 23:05:08.720507+00:00, run_duration=0.375562, state=success, executor_state=success, try_number=1, max_tries=1, job_id=160, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:05:05.962943+00:00, queued_by_job_id=2, pid=2384 2024-06-27T23:05:11.607381194Z [2024-06-27T23:05:11.607+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:05:11.607404092Z 2024-06-27T23:05:11.607647369Z [2024-06-27T23:05:11.607+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:05:11.608276288Z [2024-06-27T23:05:11.607+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:05:11.608304965Z 2024-06-27T23:05:11.611907793Z [2024-06-27T23:05:11.611+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-27T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:05:11.612262952Z [2024-06-27T23:05:11.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-27T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:05:11.666264810Z [2024-06-27T23:05:11.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status queued for try_number 1 2024-06-27T23:05:11.666644893Z [2024-06-27T23:05:11.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status success for try_number 1 2024-06-27T23:05:11.674425988Z [2024-06-27T23:05:11.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba41d77a-43fd-4f7b-b5de-262f3135289e 2024-06-27T23:05:11.674734844Z [2024-06-27T23:05:11.674+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-27T23:00:00+00:00, map_index=0, run_start_date=2024-06-27 23:05:10.834154+00:00, run_end_date=2024-06-27 23:05:11.156280+00:00, run_duration=0.322126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=161, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:05:08.896867+00:00, queued_by_job_id=2, pid=2392 2024-06-27T23:05:14.192524533Z [2024-06-27T23:05:14.192+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:05:14.193038244Z [2024-06-27T23:05:14.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:00:00+00:00, run_id=scheduled__2024-06-27T23:00:00+00:00, run_start_date=2024-06-27 23:05:00.452685+00:00, run_end_date=2024-06-27 23:05:14.192376+00:00, run_duration=13.739691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:00:00+00:00, data_interval_end=2024-06-27 23:05:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-27T23:05:14.201569178Z [2024-06-27T23:05:14.201+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:05:00+00:00, run_after=2024-06-27T23:10:00+00:00 2024-06-27T23:05:14.269017526Z [2024-06-27T23:05:14.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status success for try_number 1 2024-06-27T23:05:14.276180535Z [2024-06-27T23:05:14.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-27T23:00:00+00:00, map_index=-1, run_start_date=2024-06-27 23:05:13.338516+00:00, run_end_date=2024-06-27 23:05:13.705985+00:00, run_duration=0.367469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:05:11.609171+00:00, queued_by_job_id=2, pid=2400 2024-06-27T23:05:15.361703469Z [2024-06-27T23:05:15.361+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:05:15.361720951Z 2024-06-27T23:05:15.361970194Z [2024-06-27T23:05:15.361+0000] {scheduler_job.py:425} INFO - DAG vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2 has 0/16 running and queued tasks 2024-06-27T23:05:15.362793144Z [2024-06-27T23:05:15.362+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:05:15.362804754Z 2024-06-27T23:05:15.365129498Z [2024-06-27T23:05:15.364+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:04:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:05:15.365354419Z [2024-06-27T23:05:15.365+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:05:15.418076979Z [2024-06-27T23:05:15.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:04:00+00:00 exited with status queued for try_number 2 2024-06-27T23:05:15.423164884Z [2024-06-27T23:05:15.422+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14916b35-e5cb-4f35-b65b-28e5b8cf812f 2024-06-27T23:05:16.692865282Z [2024-06-27T23:05:16.687+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-06-27T23:05:16.692879833Z 2024-06-27T23:05:16.692883407Z 2024-06-27T23:05:16.693901530Z [2024-06-27T23:05:16.693+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 has 0/16 running and queued tasks 2024-06-27T23:05:16.693912390Z [2024-06-27T23:05:16.693+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 has 0/16 running and queued tasks 2024-06-27T23:05:16.695629464Z [2024-06-27T23:05:16.694+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:05:16.695642170Z 2024-06-27T23:05:16.695645863Z 2024-06-27T23:05:16.742821829Z [2024-06-27T23:05:16.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T23:00:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-06-27T23:05:16.742859660Z [2024-06-27T23:05:16.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:05:16.742863470Z [2024-06-27T23:05:16.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:04:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:05:16.742876650Z [2024-06-27T23:05:16.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:05:16.994641229Z [2024-06-27T23:05:16.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status queued for try_number 2 2024-06-27T23:05:16.994837580Z [2024-06-27T23:05:16.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:04:00+00:00 exited with status queued for try_number 2 2024-06-27T23:05:17.017636793Z [2024-06-27T23:05:17.017+0000] {scheduler_job.py:635} INFO - Setting external_id for to f715a037-a178-40f8-9ea7-649da23562b4 2024-06-27T23:05:17.017988504Z [2024-06-27T23:05:17.017+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95e46851-ac8a-4f8d-a266-c9202495dcc9 2024-06-27T23:05:18.237391699Z [2024-06-27T23:05:18.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:04:00+00:00 exited with status failed for try_number 2 2024-06-27T23:05:18.243358947Z [2024-06-27T23:05:18.243+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:04:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-06-27 23:05:04.632754+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:05:15.363388+00:00, queued_by_job_id=2, pid=None 2024-06-27T23:05:18.244105199Z [2024-06-27T23:05:18.243+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T23:05:18.247813499Z [2024-06-27T23:05:18.247+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T23:05:18.262791808Z [2024-06-27T23:05:18.262+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240627T230400, start_date=, end_date=20240627T230518 2024-06-27T23:05:19.391797066Z [2024-06-27T23:05:19.391+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-27T23:05:19.392362841Z [2024-06-27T23:05:19.392+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2, execution_date=2024-06-27 23:04:00+00:00, run_id=scheduled__2024-06-27T23:04:00+00:00, run_start_date=2024-06-27 23:05:00.459319+00:00, run_end_date=2024-06-27 23:05:19.391908+00:00, run_duration=18.932589, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:04:00+00:00, data_interval_end=2024-06-27 23:05:00+00:00, dag_hash=446a7141a579a5f8aebb5156c02c4e21 2024-06-27T23:05:19.404403786Z [2024-06-27T23:05:19.404+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_61a7bc51-7e95-45c7-953c-dcc542c96fd2 to 2024-06-27T23:05:00+00:00, run_after=2024-06-27T23:06:00+00:00 2024-06-27T23:05:19.439641398Z [2024-06-27T23:05:19.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:00:00+00:00 exited with status failed for try_number 2 2024-06-27T23:05:19.439766149Z [2024-06-27T23:05:19.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:04:00+00:00 exited with status failed for try_number 2 2024-06-27T23:05:19.447144846Z [2024-06-27T23:05:19.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:04:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-06-27 23:05:06.086931+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:05:16.700866+00:00, queued_by_job_id=2, pid=None 2024-06-27T23:05:19.447665836Z [2024-06-27T23:05:19.447+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T23:05:19.450747578Z [2024-06-27T23:05:19.450+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T23:05:19.469898794Z [2024-06-27T23:05:19.469+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240627T230400, start_date=, end_date=20240627T230519 2024-06-27T23:05:19.495853985Z [2024-06-27T23:05:19.495+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T23:00:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-06-27 23:05:06.156419+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:05:16.700866+00:00, queued_by_job_id=2, pid=None 2024-06-27T23:05:19.496703068Z [2024-06-27T23:05:19.496+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T23:05:19.501012166Z [2024-06-27T23:05:19.500+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-27T23:05:19.516444997Z [2024-06-27T23:05:19.516+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, task_id=extract_metrics_from_vnfrs, execution_date=20240627T230000, start_date=, end_date=20240627T230519 2024-06-27T23:05:20.580651037Z [2024-06-27T23:05:20.580+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-27T23:05:20.581119302Z [2024-06-27T23:05:20.580+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, execution_date=2024-06-27 23:04:00+00:00, run_id=scheduled__2024-06-27T23:04:00+00:00, run_start_date=2024-06-27 23:05:00.458236+00:00, run_end_date=2024-06-27 23:05:20.580659+00:00, run_duration=20.122423, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:04:00+00:00, data_interval_end=2024-06-27 23:05:00+00:00, dag_hash=0cd82d0bba611ad18d25491c8cdcb9cd 2024-06-27T23:05:20.596039100Z [2024-06-27T23:05:20.595+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 to 2024-06-27T23:05:00+00:00, run_after=2024-06-27T23:06:00+00:00 2024-06-27T23:05:23.156209049Z [2024-06-27T23:05:23.155+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-27T23:05:23.156886230Z [2024-06-27T23:05:23.156+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2, execution_date=2024-06-27 23:00:00+00:00, run_id=scheduled__2024-06-27T23:00:00+00:00, run_start_date=2024-06-27 23:05:00.451422+00:00, run_end_date=2024-06-27 23:05:23.156406+00:00, run_duration=22.704984, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:00:00+00:00, data_interval_end=2024-06-27 23:05:00+00:00, dag_hash=db46d851de9d0b0add9b52655bea3a60 2024-06-27T23:05:23.164829596Z [2024-06-27T23:05:23.164+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_61a7bc51-7e95-45c7-953c-dcc542c96fd2 to 2024-06-27T23:05:00+00:00, run_after=2024-06-27T23:10:00+00:00 2024-06-27T23:06:00.784984443Z [2024-06-27T23:06:00.784+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:06:00+00:00, run_after=2024-06-27T23:07:00+00:00 2024-06-27T23:06:00.793885959Z [2024-06-27T23:06:00.793+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:06:00.806142738Z [2024-06-27T23:06:00.805+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:06:00+00:00, run_after=2024-06-27T23:07:00+00:00 2024-06-27T23:06:00.813280082Z [2024-06-27T23:06:00.812+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:06:00.896201612Z [2024-06-27T23:06:00.895+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:06:00.896220330Z 2024-06-27T23:06:00.896229399Z 2024-06-27T23:06:00.896252269Z 2024-06-27T23:06:00.896256190Z 2024-06-27T23:06:00.896654971Z [2024-06-27T23:06:00.896+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:06:00.897020802Z [2024-06-27T23:06:00.896+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:06:00.897344456Z [2024-06-27T23:06:00.897+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:06:00.897667315Z [2024-06-27T23:06:00.897+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:06:00.898898424Z [2024-06-27T23:06:00.898+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:06:00.898907663Z 2024-06-27T23:06:00.898911564Z 2024-06-27T23:06:00.898915243Z 2024-06-27T23:06:00.898919475Z 2024-06-27T23:06:00.905290567Z [2024-06-27T23:06:00.904+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:06:00.905839054Z [2024-06-27T23:06:00.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:06:00.906455304Z [2024-06-27T23:06:00.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:06:00.906906710Z [2024-06-27T23:06:00.906+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:06:00.907694948Z [2024-06-27T23:06:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:06:00.908126491Z [2024-06-27T23:06:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:06:00.908661156Z [2024-06-27T23:06:00.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:06:00.909034211Z [2024-06-27T23:06:00.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:06:01.383796538Z [2024-06-27T23:06:01.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:04:00+00:00 exited with status queued for try_number 1 2024-06-27T23:06:01.384659110Z [2024-06-27T23:06:01.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:05:00+00:00 exited with status queued for try_number 1 2024-06-27T23:06:01.384848265Z [2024-06-27T23:06:01.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:05:00+00:00 exited with status queued for try_number 1 2024-06-27T23:06:01.385009711Z [2024-06-27T23:06:01.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:05:00+00:00 exited with status queued for try_number 1 2024-06-27T23:06:01.404341931Z [2024-06-27T23:06:01.403+0000] {scheduler_job.py:635} INFO - Setting external_id for to b638894d-7fad-4455-84be-b9656ede6b32 2024-06-27T23:06:01.404649985Z [2024-06-27T23:06:01.404+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9f6ec3d-91e4-41da-b3ae-546cb2caa243 2024-06-27T23:06:01.409159484Z [2024-06-27T23:06:01.408+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74710ded-344c-4713-b27f-3cbb31014c82 2024-06-27T23:06:01.409490221Z [2024-06-27T23:06:01.409+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ad35142-6d08-4350-b35d-055a5d6dac6b 2024-06-27T23:06:02.661187129Z [2024-06-27T23:06:02.660+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:06:02.661672064Z [2024-06-27T23:06:02.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:04:00+00:00, run_id=scheduled__2024-06-27T23:04:00+00:00, run_start_date=2024-06-27 23:06:00.824288+00:00, run_end_date=2024-06-27 23:06:02.661244+00:00, run_duration=1.836956, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:04:00+00:00, data_interval_end=2024-06-27 23:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:06:02.674582985Z [2024-06-27T23:06:02.674+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:06:00+00:00, run_after=2024-06-27T23:08:00+00:00 2024-06-27T23:06:02.785894747Z [2024-06-27T23:06:02.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:04:00+00:00 exited with status success for try_number 1 2024-06-27T23:06:02.791744991Z [2024-06-27T23:06:02.790+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:04:00+00:00, map_index=-1, run_start_date=2024-06-27 23:06:01.851931+00:00, run_end_date=2024-06-27 23:06:02.383700+00:00, run_duration=0.531769, state=success, executor_state=success, try_number=1, max_tries=1, job_id=163, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:06:00.900915+00:00, queued_by_job_id=2, pid=2459 2024-06-27T23:06:03.897479115Z [2024-06-27T23:06:03.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:06:03.898434034Z [2024-06-27T23:06:03.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:05:00+00:00, run_id=scheduled__2024-06-27T23:05:00+00:00, run_start_date=2024-06-27 23:06:00.825562+00:00, run_end_date=2024-06-27 23:06:03.897955+00:00, run_duration=3.072393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:05:00+00:00, data_interval_end=2024-06-27 23:06:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:06:03.913393712Z [2024-06-27T23:06:03.913+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:06:00+00:00, run_after=2024-06-27T23:07:00+00:00 2024-06-27T23:06:03.989424899Z [2024-06-27T23:06:03.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:05:00+00:00 exited with status success for try_number 1 2024-06-27T23:06:03.999498681Z [2024-06-27T23:06:03.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:05:00+00:00, map_index=-1, run_start_date=2024-06-27 23:06:02.014938+00:00, run_end_date=2024-06-27 23:06:02.730022+00:00, run_duration=0.715084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:06:00.900915+00:00, queued_by_job_id=2, pid=2460 2024-06-27T23:06:05.052721217Z [2024-06-27T23:06:05.052+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:06:05.053114448Z [2024-06-27T23:06:05.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:05:00+00:00, run_id=scheduled__2024-06-27T23:05:00+00:00, run_start_date=2024-06-27 23:06:00.827804+00:00, run_end_date=2024-06-27 23:06:05.052825+00:00, run_duration=4.225021, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:05:00+00:00, data_interval_end=2024-06-27 23:06:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:06:05.089055222Z [2024-06-27T23:06:05.088+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:06:00+00:00, run_after=2024-06-27T23:07:00+00:00 2024-06-27T23:06:05.141892425Z [2024-06-27T23:06:05.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:05:00+00:00 exited with status success for try_number 1 2024-06-27T23:06:05.148835418Z [2024-06-27T23:06:05.148+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:05:00+00:00, map_index=-1, run_start_date=2024-06-27 23:06:03.316106+00:00, run_end_date=2024-06-27 23:06:04.851872+00:00, run_duration=1.535766, state=success, executor_state=success, try_number=1, max_tries=1, job_id=165, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:06:00.900915+00:00, queued_by_job_id=2, pid=2483 2024-06-27T23:06:06.200716728Z [2024-06-27T23:06:06.200+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:06:06.201238848Z [2024-06-27T23:06:06.200+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:05:00+00:00, run_id=scheduled__2024-06-27T23:05:00+00:00, run_start_date=2024-06-27 23:06:00.826773+00:00, run_end_date=2024-06-27 23:06:06.200652+00:00, run_duration=5.373879, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:05:00+00:00, data_interval_end=2024-06-27 23:06:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:06:06.229973023Z [2024-06-27T23:06:06.229+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:06:00+00:00, run_after=2024-06-27T23:07:00+00:00 2024-06-27T23:06:06.280921952Z [2024-06-27T23:06:06.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:05:00+00:00 exited with status success for try_number 1 2024-06-27T23:06:06.286887637Z [2024-06-27T23:06:06.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:05:00+00:00, map_index=-1, run_start_date=2024-06-27 23:06:03.401722+00:00, run_end_date=2024-06-27 23:06:05.412845+00:00, run_duration=2.011123, state=success, executor_state=success, try_number=1, max_tries=1, job_id=166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:06:00.900915+00:00, queued_by_job_id=2, pid=2484 2024-06-27T23:06:44.326397872Z [2024-06-27T23:06:44.325+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T23:07:00.784658302Z [2024-06-27T23:07:00.784+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:07:00+00:00, run_after=2024-06-27T23:08:00+00:00 2024-06-27T23:07:00.792596576Z [2024-06-27T23:07:00.792+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:07:00.807407015Z [2024-06-27T23:07:00.807+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:07:00+00:00, run_after=2024-06-27T23:08:00+00:00 2024-06-27T23:07:00.915201343Z [2024-06-27T23:07:00.914+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:07:00.915216910Z 2024-06-27T23:07:00.915220242Z 2024-06-27T23:07:00.915235816Z 2024-06-27T23:07:00.915298671Z [2024-06-27T23:07:00.915+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:07:00.915527826Z [2024-06-27T23:07:00.915+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:07:00.915703871Z [2024-06-27T23:07:00.915+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:07:00.916498342Z [2024-06-27T23:07:00.916+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:07:00.916508490Z 2024-06-27T23:07:00.916511764Z 2024-06-27T23:07:00.916515368Z 2024-06-27T23:07:00.921312413Z [2024-06-27T23:07:00.920+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:07:00.921506845Z [2024-06-27T23:07:00.921+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:07:00.921902623Z [2024-06-27T23:07:00.921+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:07:00.922156619Z [2024-06-27T23:07:00.921+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:07:00.922530660Z [2024-06-27T23:07:00.922+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:07:00.922731414Z [2024-06-27T23:07:00.922+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:07:01.328283909Z [2024-06-27T23:07:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:06:00+00:00 exited with status queued for try_number 1 2024-06-27T23:07:01.329412603Z [2024-06-27T23:07:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:06:00+00:00 exited with status queued for try_number 1 2024-06-27T23:07:01.330941548Z [2024-06-27T23:07:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:06:00+00:00 exited with status queued for try_number 1 2024-06-27T23:07:01.348692629Z [2024-06-27T23:07:01.348+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46ff53b5-29a7-4551-af81-e4724b12335d 2024-06-27T23:07:01.349089529Z [2024-06-27T23:07:01.348+0000] {scheduler_job.py:635} INFO - Setting external_id for to c80daed2-2d02-4274-8097-8016cf756190 2024-06-27T23:07:01.349822457Z [2024-06-27T23:07:01.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to 948906ac-c7e6-4ea7-94cf-1ba9ca8ced69 2024-06-27T23:07:02.873322280Z [2024-06-27T23:07:02.872+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:07:02.873616577Z [2024-06-27T23:07:02.873+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:06:00+00:00, run_id=scheduled__2024-06-27T23:06:00+00:00, run_start_date=2024-06-27 23:07:00.824135+00:00, run_end_date=2024-06-27 23:07:02.873219+00:00, run_duration=2.049084, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:06:00+00:00, data_interval_end=2024-06-27 23:07:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:07:02.888147128Z [2024-06-27T23:07:02.887+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:07:00+00:00, run_after=2024-06-27T23:08:00+00:00 2024-06-27T23:07:02.970204199Z [2024-06-27T23:07:02.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:06:00+00:00 exited with status success for try_number 1 2024-06-27T23:07:02.977733236Z [2024-06-27T23:07:02.977+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:06:00+00:00, map_index=-1, run_start_date=2024-06-27 23:07:02.118590+00:00, run_end_date=2024-06-27 23:07:02.660610+00:00, run_duration=0.54202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:07:00.917431+00:00, queued_by_job_id=2, pid=2517 2024-06-27T23:07:04.860269436Z [2024-06-27T23:07:04.859+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:07:04.860879586Z [2024-06-27T23:07:04.860+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:06:00+00:00, run_id=scheduled__2024-06-27T23:06:00+00:00, run_start_date=2024-06-27 23:07:00.826965+00:00, run_end_date=2024-06-27 23:07:04.860206+00:00, run_duration=4.033241, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:06:00+00:00, data_interval_end=2024-06-27 23:07:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:07:04.869198051Z [2024-06-27T23:07:04.868+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:07:00+00:00, run_after=2024-06-27T23:08:00+00:00 2024-06-27T23:07:04.918431878Z [2024-06-27T23:07:04.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:06:00+00:00 exited with status success for try_number 1 2024-06-27T23:07:04.925119886Z [2024-06-27T23:07:04.924+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:06:00+00:00, map_index=-1, run_start_date=2024-06-27 23:07:03.306087+00:00, run_end_date=2024-06-27 23:07:04.575973+00:00, run_duration=1.269886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:07:00.917431+00:00, queued_by_job_id=2, pid=2535 2024-06-27T23:07:05.974539804Z [2024-06-27T23:07:05.973+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:07:05.974900866Z [2024-06-27T23:07:05.974+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:06:00+00:00, run_id=scheduled__2024-06-27T23:06:00+00:00, run_start_date=2024-06-27 23:07:00.825622+00:00, run_end_date=2024-06-27 23:07:05.974494+00:00, run_duration=5.148872, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:06:00+00:00, data_interval_end=2024-06-27 23:07:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:07:05.986998475Z [2024-06-27T23:07:05.986+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:07:00+00:00, run_after=2024-06-27T23:08:00+00:00 2024-06-27T23:07:06.023397575Z [2024-06-27T23:07:06.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:06:00+00:00 exited with status success for try_number 1 2024-06-27T23:07:06.029563147Z [2024-06-27T23:07:06.029+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:06:00+00:00, map_index=-1, run_start_date=2024-06-27 23:07:03.382585+00:00, run_end_date=2024-06-27 23:07:05.131979+00:00, run_duration=1.749394, state=success, executor_state=success, try_number=1, max_tries=1, job_id=169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:07:00.917431+00:00, queued_by_job_id=2, pid=2536 2024-06-27T23:08:00.723949048Z [2024-06-27T23:08:00.723+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:08:00+00:00, run_after=2024-06-27T23:09:00+00:00 2024-06-27T23:08:00.739055289Z [2024-06-27T23:08:00.737+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:08:00.753143517Z [2024-06-27T23:08:00.752+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:08:00.768271530Z [2024-06-27T23:08:00.767+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:08:00+00:00, run_after=2024-06-27T23:09:00+00:00 2024-06-27T23:08:00.865032504Z [2024-06-27T23:08:00.864+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:08:00.865077387Z 2024-06-27T23:08:00.865086562Z 2024-06-27T23:08:00.865093850Z 2024-06-27T23:08:00.865100654Z 2024-06-27T23:08:00.865262220Z [2024-06-27T23:08:00.865+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:08:00.865482585Z [2024-06-27T23:08:00.865+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:08:00.865691427Z [2024-06-27T23:08:00.865+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:08:00.865848762Z [2024-06-27T23:08:00.865+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:08:00.866502645Z [2024-06-27T23:08:00.866+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:08:00.866516801Z 2024-06-27T23:08:00.866547040Z 2024-06-27T23:08:00.866552822Z 2024-06-27T23:08:00.866557016Z 2024-06-27T23:08:00.870327146Z [2024-06-27T23:08:00.870+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:08:00.870500900Z [2024-06-27T23:08:00.870+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:08:00.870788657Z [2024-06-27T23:08:00.870+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:08:00.870929615Z [2024-06-27T23:08:00.870+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:08:00.871180758Z [2024-06-27T23:08:00.871+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:08:00.871340395Z [2024-06-27T23:08:00.871+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:08:00.871663887Z [2024-06-27T23:08:00.871+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:08:00.871881517Z [2024-06-27T23:08:00.871+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:08:01.240529691Z [2024-06-27T23:08:01.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:06:00+00:00 exited with status queued for try_number 1 2024-06-27T23:08:01.241010935Z [2024-06-27T23:08:01.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:07:00+00:00 exited with status queued for try_number 1 2024-06-27T23:08:01.241779711Z [2024-06-27T23:08:01.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:07:00+00:00 exited with status queued for try_number 1 2024-06-27T23:08:01.241976191Z [2024-06-27T23:08:01.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:07:00+00:00 exited with status queued for try_number 1 2024-06-27T23:08:01.276785429Z [2024-06-27T23:08:01.275+0000] {scheduler_job.py:635} INFO - Setting external_id for to e18dcf3a-3acc-4e1d-bd54-5578b04765c0 2024-06-27T23:08:01.277369406Z [2024-06-27T23:08:01.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3456b8d9-f682-4e36-ad72-5a5e783f9984 2024-06-27T23:08:01.278861337Z [2024-06-27T23:08:01.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58bcbd7f-020f-4d14-a797-5fb14e7aad0c 2024-06-27T23:08:01.279868143Z [2024-06-27T23:08:01.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7ba81dd-28cb-4caa-abff-7f5bc408f0bf 2024-06-27T23:08:02.614256533Z [2024-06-27T23:08:02.613+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:08:02.614816638Z [2024-06-27T23:08:02.614+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:07:00+00:00, run_id=scheduled__2024-06-27T23:07:00+00:00, run_start_date=2024-06-27 23:08:00.781677+00:00, run_end_date=2024-06-27 23:08:02.614159+00:00, run_duration=1.832482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:07:00+00:00, data_interval_end=2024-06-27 23:08:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:08:02.628659253Z [2024-06-27T23:08:02.627+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:08:00+00:00, run_after=2024-06-27T23:09:00+00:00 2024-06-27T23:08:03.466777203Z [2024-06-27T23:08:03.466+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:08:03.467108006Z [2024-06-27T23:08:03.466+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:06:00+00:00, run_id=scheduled__2024-06-27T23:06:00+00:00, run_start_date=2024-06-27 23:08:00.779594+00:00, run_end_date=2024-06-27 23:08:03.466658+00:00, run_duration=2.687064, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:06:00+00:00, data_interval_end=2024-06-27 23:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:08:03.481486974Z [2024-06-27T23:08:03.481+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:08:00+00:00, run_after=2024-06-27T23:10:00+00:00 2024-06-27T23:08:03.534419796Z [2024-06-27T23:08:03.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:06:00+00:00 exited with status success for try_number 1 2024-06-27T23:08:03.534451433Z [2024-06-27T23:08:03.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:07:00+00:00 exited with status success for try_number 1 2024-06-27T23:08:03.544253379Z [2024-06-27T23:08:03.543+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:07:00+00:00, map_index=-1, run_start_date=2024-06-27 23:08:01.979316+00:00, run_end_date=2024-06-27 23:08:02.567274+00:00, run_duration=0.587958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=170, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:08:00.867372+00:00, queued_by_job_id=2, pid=2569 2024-06-27T23:08:03.544484034Z [2024-06-27T23:08:03.544+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:06:00+00:00, map_index=-1, run_start_date=2024-06-27 23:08:02.423840+00:00, run_end_date=2024-06-27 23:08:02.849450+00:00, run_duration=0.42561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=171, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:08:00.867372+00:00, queued_by_job_id=2, pid=2575 2024-06-27T23:08:05.822104899Z [2024-06-27T23:08:05.821+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:08:05.822866819Z [2024-06-27T23:08:05.822+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:07:00+00:00, run_id=scheduled__2024-06-27T23:07:00+00:00, run_start_date=2024-06-27 23:08:00.783216+00:00, run_end_date=2024-06-27 23:08:05.822281+00:00, run_duration=5.039065, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:07:00+00:00, data_interval_end=2024-06-27 23:08:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:08:05.835472959Z [2024-06-27T23:08:05.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:08:00+00:00, run_after=2024-06-27T23:09:00+00:00 2024-06-27T23:08:05.842907936Z [2024-06-27T23:08:05.842+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:08:05.843513724Z [2024-06-27T23:08:05.843+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:07:00+00:00, run_id=scheduled__2024-06-27T23:07:00+00:00, run_start_date=2024-06-27 23:08:00.784304+00:00, run_end_date=2024-06-27 23:08:05.843098+00:00, run_duration=5.058794, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:07:00+00:00, data_interval_end=2024-06-27 23:08:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:08:05.853902478Z [2024-06-27T23:08:05.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:08:00+00:00, run_after=2024-06-27T23:09:00+00:00 2024-06-27T23:08:05.883445448Z [2024-06-27T23:08:05.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:07:00+00:00 exited with status success for try_number 1 2024-06-27T23:08:05.884167399Z [2024-06-27T23:08:05.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:07:00+00:00 exited with status success for try_number 1 2024-06-27T23:08:05.895766777Z [2024-06-27T23:08:05.894+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:07:00+00:00, map_index=-1, run_start_date=2024-06-27 23:08:03.571551+00:00, run_end_date=2024-06-27 23:08:05.274853+00:00, run_duration=1.703302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=173, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:08:00.867372+00:00, queued_by_job_id=2, pid=2594 2024-06-27T23:08:05.896134505Z [2024-06-27T23:08:05.895+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:07:00+00:00, map_index=-1, run_start_date=2024-06-27 23:08:03.405155+00:00, run_end_date=2024-06-27 23:08:05.513782+00:00, run_duration=2.108627, state=success, executor_state=success, try_number=1, max_tries=1, job_id=172, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:08:00.867372+00:00, queued_by_job_id=2, pid=2593 2024-06-27T23:09:00.252142176Z [2024-06-27T23:09:00.251+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:09:00+00:00, run_after=2024-06-27T23:10:00+00:00 2024-06-27T23:09:00.266746116Z [2024-06-27T23:09:00.266+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:09:00+00:00, run_after=2024-06-27T23:10:00+00:00 2024-06-27T23:09:00.277815371Z [2024-06-27T23:09:00.277+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:09:00.347730989Z [2024-06-27T23:09:00.347+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:09:00.347759526Z 2024-06-27T23:09:00.347764125Z 2024-06-27T23:09:00.347768269Z 2024-06-27T23:09:00.347964043Z [2024-06-27T23:09:00.347+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:09:00.348217092Z [2024-06-27T23:09:00.348+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:09:00.348476374Z [2024-06-27T23:09:00.348+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:09:00.349419482Z [2024-06-27T23:09:00.349+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:09:00.349453344Z 2024-06-27T23:09:00.349458491Z 2024-06-27T23:09:00.349462147Z 2024-06-27T23:09:00.352706547Z [2024-06-27T23:09:00.352+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:09:00.353038077Z [2024-06-27T23:09:00.352+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:09:00.353468447Z [2024-06-27T23:09:00.353+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:09:00.353751650Z [2024-06-27T23:09:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:09:00.354156391Z [2024-06-27T23:09:00.353+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:09:00.354359478Z [2024-06-27T23:09:00.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:09:00.622317880Z [2024-06-27T23:09:00.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:08:00+00:00 exited with status queued for try_number 1 2024-06-27T23:09:00.622456128Z [2024-06-27T23:09:00.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:08:00+00:00 exited with status queued for try_number 1 2024-06-27T23:09:00.622571172Z [2024-06-27T23:09:00.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:08:00+00:00 exited with status queued for try_number 1 2024-06-27T23:09:00.639389507Z [2024-06-27T23:09:00.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b9350b3-e55b-4a6c-bb4e-f9121abd9e91 2024-06-27T23:09:00.639592411Z [2024-06-27T23:09:00.639+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ffb7d1e-0ec9-402c-b0f8-b1a2f02ef7f8 2024-06-27T23:09:00.639782453Z [2024-06-27T23:09:00.639+0000] {scheduler_job.py:635} INFO - Setting external_id for to e24586b5-63b2-40f4-9ef6-9b3396a35b26 2024-06-27T23:09:01.903507273Z [2024-06-27T23:09:01.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:09:01.903940128Z [2024-06-27T23:09:01.903+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:08:00+00:00, run_id=scheduled__2024-06-27T23:08:00+00:00, run_start_date=2024-06-27 23:09:00.291931+00:00, run_end_date=2024-06-27 23:09:01.903418+00:00, run_duration=1.611487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:08:00+00:00, data_interval_end=2024-06-27 23:09:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:09:01.916647500Z [2024-06-27T23:09:01.916+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:09:00+00:00, run_after=2024-06-27T23:10:00+00:00 2024-06-27T23:09:01.983285309Z [2024-06-27T23:09:01.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:08:00+00:00 exited with status success for try_number 1 2024-06-27T23:09:01.989632874Z [2024-06-27T23:09:01.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:08:00+00:00, map_index=-1, run_start_date=2024-06-27 23:09:01.256074+00:00, run_end_date=2024-06-27 23:09:01.765444+00:00, run_duration=0.50937, state=success, executor_state=success, try_number=1, max_tries=1, job_id=174, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:09:00.350195+00:00, queued_by_job_id=2, pid=2626 2024-06-27T23:09:03.971203859Z [2024-06-27T23:09:03.970+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:09:03.971815236Z [2024-06-27T23:09:03.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:08:00+00:00, run_id=scheduled__2024-06-27T23:08:00+00:00, run_start_date=2024-06-27 23:09:00.293520+00:00, run_end_date=2024-06-27 23:09:03.971267+00:00, run_duration=3.677747, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:08:00+00:00, data_interval_end=2024-06-27 23:09:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:09:03.984083944Z [2024-06-27T23:09:03.983+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:09:00+00:00, run_after=2024-06-27T23:10:00+00:00 2024-06-27T23:09:05.145138031Z [2024-06-27T23:09:05.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:09:05.145464252Z [2024-06-27T23:09:05.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:08:00+00:00, run_id=scheduled__2024-06-27T23:08:00+00:00, run_start_date=2024-06-27 23:09:00.295232+00:00, run_end_date=2024-06-27 23:09:05.145127+00:00, run_duration=4.849895, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:08:00+00:00, data_interval_end=2024-06-27 23:09:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:09:05.153970438Z [2024-06-27T23:09:05.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:09:00+00:00, run_after=2024-06-27T23:10:00+00:00 2024-06-27T23:09:05.190432358Z [2024-06-27T23:09:05.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:08:00+00:00 exited with status success for try_number 1 2024-06-27T23:09:05.190522080Z [2024-06-27T23:09:05.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:08:00+00:00 exited with status success for try_number 1 2024-06-27T23:09:05.203428164Z [2024-06-27T23:09:05.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:08:00+00:00, map_index=-1, run_start_date=2024-06-27 23:09:02.393534+00:00, run_end_date=2024-06-27 23:09:03.897216+00:00, run_duration=1.503682, state=success, executor_state=success, try_number=1, max_tries=1, job_id=175, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:09:00.350195+00:00, queued_by_job_id=2, pid=2644 2024-06-27T23:09:05.204808757Z [2024-06-27T23:09:05.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:08:00+00:00, map_index=-1, run_start_date=2024-06-27 23:09:02.536817+00:00, run_end_date=2024-06-27 23:09:04.252036+00:00, run_duration=1.715219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=176, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:09:00.350195+00:00, queued_by_job_id=2, pid=2645 2024-06-27T23:10:00.727154122Z [2024-06-27T23:10:00.726+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:10:00+00:00, run_after=2024-06-27T23:15:00+00:00 2024-06-27T23:10:00.736087942Z [2024-06-27T23:10:00.735+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:10:00.743325224Z [2024-06-27T23:10:00.743+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:10:00.755478366Z [2024-06-27T23:10:00.755+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:10:00+00:00, run_after=2024-06-27T23:11:00+00:00 2024-06-27T23:10:00.768601226Z [2024-06-27T23:10:00.768+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:10:00+00:00, run_after=2024-06-27T23:11:00+00:00 2024-06-27T23:10:00.888871766Z [2024-06-27T23:10:00.888+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T23:10:00.888905005Z 2024-06-27T23:10:00.888910437Z 2024-06-27T23:10:00.888920234Z 2024-06-27T23:10:00.888926246Z 2024-06-27T23:10:00.888930756Z 2024-06-27T23:10:00.889352533Z [2024-06-27T23:10:00.889+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:10:00.889695635Z [2024-06-27T23:10:00.889+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:10:00.890088326Z [2024-06-27T23:10:00.889+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:10:00.890519560Z [2024-06-27T23:10:00.890+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:10:00.890927907Z [2024-06-27T23:10:00.890+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:10:00.894287227Z [2024-06-27T23:10:00.893+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:10:00.894303745Z 2024-06-27T23:10:00.894309390Z 2024-06-27T23:10:00.894314028Z 2024-06-27T23:10:00.894318786Z 2024-06-27T23:10:00.894323711Z 2024-06-27T23:10:00.905171437Z [2024-06-27T23:10:00.904+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T23:10:00.905958836Z [2024-06-27T23:10:00.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:10:00.906550285Z [2024-06-27T23:10:00.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:10:00.907362950Z [2024-06-27T23:10:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:10:00.908064731Z [2024-06-27T23:10:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:10:00.908434756Z [2024-06-27T23:10:00.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:10:00.908968367Z [2024-06-27T23:10:00.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:10:00.909280953Z [2024-06-27T23:10:00.909+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:10:00.909760555Z [2024-06-27T23:10:00.909+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:10:00.910072935Z [2024-06-27T23:10:00.909+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:10:01.445957974Z [2024-06-27T23:10:01.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:05:00+00:00 exited with status queued for try_number 1 2024-06-27T23:10:01.446082199Z [2024-06-27T23:10:01.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:08:00+00:00 exited with status queued for try_number 1 2024-06-27T23:10:01.446186824Z [2024-06-27T23:10:01.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:09:00+00:00 exited with status queued for try_number 1 2024-06-27T23:10:01.446309923Z [2024-06-27T23:10:01.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:09:00+00:00 exited with status queued for try_number 1 2024-06-27T23:10:01.446401342Z [2024-06-27T23:10:01.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:09:00+00:00 exited with status queued for try_number 1 2024-06-27T23:10:01.476112003Z [2024-06-27T23:10:01.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb614ef1-5cf5-417d-9c5a-93f259c7f80e 2024-06-27T23:10:01.479333064Z [2024-06-27T23:10:01.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab1b0e40-7960-475c-bff5-cc42b317ce90 2024-06-27T23:10:01.479573313Z [2024-06-27T23:10:01.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21f29761-16e7-4c8e-866b-6913304e4c87 2024-06-27T23:10:01.479784946Z [2024-06-27T23:10:01.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to a75851e7-9809-4195-a8df-8018f6f51ba5 2024-06-27T23:10:01.480013815Z [2024-06-27T23:10:01.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to da0997a6-d5da-4b9c-9729-1343d5014632 2024-06-27T23:10:03.958037951Z [2024-06-27T23:10:03.957+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:10:03.959764005Z [2024-06-27T23:10:03.959+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:08:00+00:00, run_id=scheduled__2024-06-27T23:08:00+00:00, run_start_date=2024-06-27 23:10:00.781011+00:00, run_end_date=2024-06-27 23:10:03.959159+00:00, run_duration=3.178148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:08:00+00:00, data_interval_end=2024-06-27 23:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:10:03.972306625Z [2024-06-27T23:10:03.971+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:10:00+00:00, run_after=2024-06-27T23:12:00+00:00 2024-06-27T23:10:03.988739202Z [2024-06-27T23:10:03.988+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:10:03.989175415Z [2024-06-27T23:10:03.988+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:09:00+00:00, run_id=scheduled__2024-06-27T23:09:00+00:00, run_start_date=2024-06-27 23:10:00.781995+00:00, run_end_date=2024-06-27 23:10:03.988730+00:00, run_duration=3.206735, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:09:00+00:00, data_interval_end=2024-06-27 23:10:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:10:04.012403627Z [2024-06-27T23:10:04.012+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:10:00+00:00, run_after=2024-06-27T23:11:00+00:00 2024-06-27T23:10:04.136736809Z [2024-06-27T23:10:04.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:08:00+00:00 exited with status success for try_number 1 2024-06-27T23:10:04.136770495Z [2024-06-27T23:10:04.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:09:00+00:00 exited with status success for try_number 1 2024-06-27T23:10:04.160929417Z [2024-06-27T23:10:04.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:09:00+00:00, map_index=-1, run_start_date=2024-06-27 23:10:02.134604+00:00, run_end_date=2024-06-27 23:10:02.686614+00:00, run_duration=0.55201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=177, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:10:00.897295+00:00, queued_by_job_id=2, pid=2679 2024-06-27T23:10:04.160964279Z [2024-06-27T23:10:04.157+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:08:00+00:00, map_index=-1, run_start_date=2024-06-27 23:10:02.269925+00:00, run_end_date=2024-06-27 23:10:02.935270+00:00, run_duration=0.665345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=178, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:10:00.897295+00:00, queued_by_job_id=2, pid=2680 2024-06-27T23:10:05.696970494Z [2024-06-27T23:10:05.696+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:10:05.697280852Z [2024-06-27T23:10:05.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:09:00+00:00, run_id=scheduled__2024-06-27T23:09:00+00:00, run_start_date=2024-06-27 23:10:00.783032+00:00, run_end_date=2024-06-27 23:10:05.696898+00:00, run_duration=4.913866, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:09:00+00:00, data_interval_end=2024-06-27 23:10:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:10:05.709703879Z [2024-06-27T23:10:05.709+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:10:00+00:00, run_after=2024-06-27T23:11:00+00:00 2024-06-27T23:10:05.749144941Z [2024-06-27T23:10:05.748+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:10:05.749159330Z 2024-06-27T23:10:05.749464119Z [2024-06-27T23:10:05.749+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:10:05.751072545Z [2024-06-27T23:10:05.750+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:10:05.751089840Z 2024-06-27T23:10:05.754446624Z [2024-06-27T23:10:05.754+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-27T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T23:10:05.754628815Z [2024-06-27T23:10:05.754+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-27T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:10:05.828283122Z [2024-06-27T23:10:05.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:05:00+00:00 exited with status queued for try_number 1 2024-06-27T23:10:05.832710767Z [2024-06-27T23:10:05.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:05:00+00:00 exited with status success for try_number 1 2024-06-27T23:10:05.832952264Z [2024-06-27T23:10:05.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:09:00+00:00 exited with status success for try_number 1 2024-06-27T23:10:05.853728803Z [2024-06-27T23:10:05.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T23:05:00+00:00, map_index=-1, run_start_date=2024-06-27 23:10:03.843800+00:00, run_end_date=2024-06-27 23:10:04.650662+00:00, run_duration=0.806862, state=success, executor_state=success, try_number=1, max_tries=1, job_id=180, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:10:00.897295+00:00, queued_by_job_id=2, pid=2710 2024-06-27T23:10:05.854075507Z [2024-06-27T23:10:05.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb07756b-e935-421c-b267-516ed8b25581 2024-06-27T23:10:05.854606195Z [2024-06-27T23:10:05.854+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:09:00+00:00, map_index=-1, run_start_date=2024-06-27 23:10:03.778842+00:00, run_end_date=2024-06-27 23:10:05.366611+00:00, run_duration=1.587769, state=success, executor_state=success, try_number=1, max_tries=1, job_id=179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:10:00.897295+00:00, queued_by_job_id=2, pid=2704 2024-06-27T23:10:06.617428679Z [2024-06-27T23:10:06.617+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:10:06.617859185Z [2024-06-27T23:10:06.617+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:09:00+00:00, run_id=scheduled__2024-06-27T23:09:00+00:00, run_start_date=2024-06-27 23:10:00.784022+00:00, run_end_date=2024-06-27 23:10:06.617536+00:00, run_duration=5.833514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:09:00+00:00, data_interval_end=2024-06-27 23:10:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:10:06.630081757Z [2024-06-27T23:10:06.629+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:10:00+00:00, run_after=2024-06-27T23:11:00+00:00 2024-06-27T23:10:06.708927685Z [2024-06-27T23:10:06.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:09:00+00:00 exited with status success for try_number 1 2024-06-27T23:10:06.715619248Z [2024-06-27T23:10:06.715+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:09:00+00:00, map_index=-1, run_start_date=2024-06-27 23:10:04.305382+00:00, run_end_date=2024-06-27 23:10:06.288838+00:00, run_duration=1.983456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:10:00.897295+00:00, queued_by_job_id=2, pid=2716 2024-06-27T23:10:08.923243984Z [2024-06-27T23:10:08.922+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:10:08.923271183Z 2024-06-27T23:10:08.923500367Z [2024-06-27T23:10:08.923+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:10:08.924236246Z [2024-06-27T23:10:08.924+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:10:08.924250181Z 2024-06-27T23:10:08.927814691Z [2024-06-27T23:10:08.927+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-27T23:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T23:10:08.928114908Z [2024-06-27T23:10:08.927+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-27T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T23:10:08.994461112Z [2024-06-27T23:10:08.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:05:00+00:00 exited with status queued for try_number 1 2024-06-27T23:10:08.995024989Z [2024-06-27T23:10:08.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:05:00+00:00 exited with status success for try_number 1 2024-06-27T23:10:09.005785190Z [2024-06-27T23:10:09.005+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf34d3f3-c5a9-486d-9ac8-9d3603ba14be 2024-06-27T23:10:09.006387722Z [2024-06-27T23:10:09.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-27T23:05:00+00:00, map_index=-1, run_start_date=2024-06-27 23:10:08.014949+00:00, run_end_date=2024-06-27 23:10:08.370035+00:00, run_duration=0.355086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=182, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:10:05.752175+00:00, queued_by_job_id=2, pid=2734 2024-06-27T23:10:11.299620513Z [2024-06-27T23:10:11.299+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:10:11.299637284Z 2024-06-27T23:10:11.299996045Z [2024-06-27T23:10:11.299+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:10:11.300619238Z [2024-06-27T23:10:11.300+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:10:11.300630300Z 2024-06-27T23:10:11.303618155Z [2024-06-27T23:10:11.303+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-27T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:10:11.303722024Z [2024-06-27T23:10:11.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-27T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:10:11.356777428Z [2024-06-27T23:10:11.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:05:00+00:00 exited with status queued for try_number 1 2024-06-27T23:10:11.356798667Z [2024-06-27T23:10:11.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:05:00+00:00 exited with status success for try_number 1 2024-06-27T23:10:11.363211682Z [2024-06-27T23:10:11.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21cbf814-25c1-4dba-99e3-76ab7afc4410 2024-06-27T23:10:11.363326609Z [2024-06-27T23:10:11.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-27T23:05:00+00:00, map_index=0, run_start_date=2024-06-27 23:10:10.685974+00:00, run_end_date=2024-06-27 23:10:11.024104+00:00, run_duration=0.33813, state=success, executor_state=success, try_number=1, max_tries=1, job_id=183, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:10:08.924734+00:00, queued_by_job_id=2, pid=2742 2024-06-27T23:10:13.984920577Z [2024-06-27T23:10:13.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:10:13.985323255Z [2024-06-27T23:10:13.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:05:00+00:00, run_id=scheduled__2024-06-27T23:05:00+00:00, run_start_date=2024-06-27 23:10:00.779756+00:00, run_end_date=2024-06-27 23:10:13.984904+00:00, run_duration=13.205148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:05:00+00:00, data_interval_end=2024-06-27 23:10:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-27T23:10:13.990777918Z [2024-06-27T23:10:13.990+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:10:00+00:00, run_after=2024-06-27T23:15:00+00:00 2024-06-27T23:10:14.027692364Z [2024-06-27T23:10:14.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:05:00+00:00 exited with status success for try_number 1 2024-06-27T23:10:14.040832201Z [2024-06-27T23:10:14.040+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-27T23:05:00+00:00, map_index=-1, run_start_date=2024-06-27 23:10:13.255459+00:00, run_end_date=2024-06-27 23:10:13.684721+00:00, run_duration=0.429262, state=success, executor_state=success, try_number=1, max_tries=1, job_id=184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:10:11.300925+00:00, queued_by_job_id=2, pid=2750 2024-06-27T23:11:00.714955193Z [2024-06-27T23:11:00.713+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:11:00.733778492Z [2024-06-27T23:11:00.732+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:11:00+00:00, run_after=2024-06-27T23:12:00+00:00 2024-06-27T23:11:00.751510594Z [2024-06-27T23:11:00.751+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:11:00+00:00, run_after=2024-06-27T23:12:00+00:00 2024-06-27T23:11:00.812846430Z [2024-06-27T23:11:00.812+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:11:00.812870484Z 2024-06-27T23:11:00.812874052Z 2024-06-27T23:11:00.812877150Z 2024-06-27T23:11:00.812880645Z [2024-06-27T23:11:00.812+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:11:00.813874943Z [2024-06-27T23:11:00.813+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:11:00.813888997Z [2024-06-27T23:11:00.813+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:11:00.814448263Z [2024-06-27T23:11:00.814+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:11:00.814453728Z 2024-06-27T23:11:00.814456964Z 2024-06-27T23:11:00.814460502Z 2024-06-27T23:11:00.817258725Z [2024-06-27T23:11:00.816+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:11:00.817271647Z [2024-06-27T23:11:00.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:11:00.817444871Z [2024-06-27T23:11:00.817+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:11:00.817527219Z [2024-06-27T23:11:00.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:11:00.817695675Z [2024-06-27T23:11:00.817+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:11:00.817720147Z [2024-06-27T23:11:00.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:11:01.166345930Z [2024-06-27T23:11:01.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:10:00+00:00 exited with status queued for try_number 1 2024-06-27T23:11:01.166533999Z [2024-06-27T23:11:01.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:10:00+00:00 exited with status queued for try_number 1 2024-06-27T23:11:01.166731671Z [2024-06-27T23:11:01.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:10:00+00:00 exited with status queued for try_number 1 2024-06-27T23:11:01.174909887Z [2024-06-27T23:11:01.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63de69df-2668-4e0a-bfc3-a1f2e3c24bff 2024-06-27T23:11:01.175137717Z [2024-06-27T23:11:01.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75f5768c-b0ff-40ad-8d15-58ba82e4261d 2024-06-27T23:11:01.175513477Z [2024-06-27T23:11:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d3e1de2-fefe-4590-8ab2-45682cc32691 2024-06-27T23:11:02.625512402Z [2024-06-27T23:11:02.625+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:11:02.625846007Z [2024-06-27T23:11:02.625+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:10:00+00:00, run_id=scheduled__2024-06-27T23:10:00+00:00, run_start_date=2024-06-27 23:11:00.764897+00:00, run_end_date=2024-06-27 23:11:02.625442+00:00, run_duration=1.860545, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:10:00+00:00, data_interval_end=2024-06-27 23:11:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:11:02.646331395Z [2024-06-27T23:11:02.645+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:11:00+00:00, run_after=2024-06-27T23:12:00+00:00 2024-06-27T23:11:02.706704068Z [2024-06-27T23:11:02.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:10:00+00:00 exited with status success for try_number 1 2024-06-27T23:11:02.716785705Z [2024-06-27T23:11:02.716+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:10:00+00:00, map_index=-1, run_start_date=2024-06-27 23:11:01.905113+00:00, run_end_date=2024-06-27 23:11:02.451566+00:00, run_duration=0.546453, state=success, executor_state=success, try_number=1, max_tries=1, job_id=185, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:11:00.815106+00:00, queued_by_job_id=2, pid=2772 2024-06-27T23:11:04.943273608Z [2024-06-27T23:11:04.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:11:04.943433222Z [2024-06-27T23:11:04.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:10:00+00:00, run_id=scheduled__2024-06-27T23:10:00+00:00, run_start_date=2024-06-27 23:11:00.766669+00:00, run_end_date=2024-06-27 23:11:04.943182+00:00, run_duration=4.176513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:10:00+00:00, data_interval_end=2024-06-27 23:11:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:11:04.960410694Z [2024-06-27T23:11:04.960+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:11:00+00:00, run_after=2024-06-27T23:12:00+00:00 2024-06-27T23:11:05.019810261Z [2024-06-27T23:11:05.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:10:00+00:00 exited with status success for try_number 1 2024-06-27T23:11:05.036737892Z [2024-06-27T23:11:05.036+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:10:00+00:00, map_index=-1, run_start_date=2024-06-27 23:11:03.121734+00:00, run_end_date=2024-06-27 23:11:04.495020+00:00, run_duration=1.373286, state=success, executor_state=success, try_number=1, max_tries=1, job_id=187, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:11:00.815106+00:00, queued_by_job_id=2, pid=2791 2024-06-27T23:11:06.159235525Z [2024-06-27T23:11:06.158+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:11:06.159413164Z [2024-06-27T23:11:06.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:10:00+00:00, run_id=scheduled__2024-06-27T23:10:00+00:00, run_start_date=2024-06-27 23:11:00.768195+00:00, run_end_date=2024-06-27 23:11:06.159148+00:00, run_duration=5.390953, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:10:00+00:00, data_interval_end=2024-06-27 23:11:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:11:06.172771501Z [2024-06-27T23:11:06.172+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:11:00+00:00, run_after=2024-06-27T23:12:00+00:00 2024-06-27T23:11:06.225755028Z [2024-06-27T23:11:06.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:10:00+00:00 exited with status success for try_number 1 2024-06-27T23:11:06.232744507Z [2024-06-27T23:11:06.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:10:00+00:00, map_index=-1, run_start_date=2024-06-27 23:11:03.108570+00:00, run_end_date=2024-06-27 23:11:05.106572+00:00, run_duration=1.998002, state=success, executor_state=success, try_number=1, max_tries=1, job_id=186, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:11:00.815106+00:00, queued_by_job_id=2, pid=2790 2024-06-27T23:11:44.421677669Z [2024-06-27T23:11:44.420+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T23:12:00.793681113Z [2024-06-27T23:12:00.793+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:12:00.808223639Z [2024-06-27T23:12:00.807+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:12:00+00:00, run_after=2024-06-27T23:13:00+00:00 2024-06-27T23:12:00.821499116Z [2024-06-27T23:12:00.821+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:12:00+00:00, run_after=2024-06-27T23:13:00+00:00 2024-06-27T23:12:00.832729466Z [2024-06-27T23:12:00.832+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:12:00.945491285Z [2024-06-27T23:12:00.944+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:12:00.945517402Z 2024-06-27T23:12:00.945523197Z 2024-06-27T23:12:00.945527770Z 2024-06-27T23:12:00.945532512Z 2024-06-27T23:12:00.945801246Z [2024-06-27T23:12:00.945+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:12:00.946109756Z [2024-06-27T23:12:00.945+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:12:00.946351084Z [2024-06-27T23:12:00.946+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:12:00.946578781Z [2024-06-27T23:12:00.946+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:12:00.947667805Z [2024-06-27T23:12:00.947+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:12:00.947680349Z 2024-06-27T23:12:00.947685232Z 2024-06-27T23:12:00.947689679Z 2024-06-27T23:12:00.947694541Z 2024-06-27T23:12:00.953275096Z [2024-06-27T23:12:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:12:00.953516411Z [2024-06-27T23:12:00.953+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:12:00.953847721Z [2024-06-27T23:12:00.953+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:12:00.954045131Z [2024-06-27T23:12:00.953+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:12:00.954382578Z [2024-06-27T23:12:00.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:12:00.955088485Z [2024-06-27T23:12:00.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:12:00.955105794Z [2024-06-27T23:12:00.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:12:00.955112304Z [2024-06-27T23:12:00.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:12:01.448382507Z [2024-06-27T23:12:01.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:10:00+00:00 exited with status queued for try_number 1 2024-06-27T23:12:01.448441551Z [2024-06-27T23:12:01.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:11:00+00:00 exited with status queued for try_number 1 2024-06-27T23:12:01.448500027Z [2024-06-27T23:12:01.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:11:00+00:00 exited with status queued for try_number 1 2024-06-27T23:12:01.448571837Z [2024-06-27T23:12:01.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:11:00+00:00 exited with status queued for try_number 1 2024-06-27T23:12:01.460475135Z [2024-06-27T23:12:01.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37f73690-94ec-44ea-9aef-8b316b6e2db8 2024-06-27T23:12:01.460529268Z [2024-06-27T23:12:01.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fa6f2e9-8b1e-47af-8fed-e6ac5b77cfae 2024-06-27T23:12:01.460663368Z [2024-06-27T23:12:01.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 655c38b1-528c-4171-98e4-54ac8701e41d 2024-06-27T23:12:01.460753457Z [2024-06-27T23:12:01.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9dba914-3a74-45c2-8fd0-b8e1dfa63f09 2024-06-27T23:12:02.671738113Z [2024-06-27T23:12:02.671+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:12:02.672043623Z [2024-06-27T23:12:02.671+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:10:00+00:00, run_id=scheduled__2024-06-27T23:10:00+00:00, run_start_date=2024-06-27 23:12:00.849853+00:00, run_end_date=2024-06-27 23:12:02.671599+00:00, run_duration=1.821746, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:10:00+00:00, data_interval_end=2024-06-27 23:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:12:02.679303333Z [2024-06-27T23:12:02.678+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:12:00+00:00, run_after=2024-06-27T23:14:00+00:00 2024-06-27T23:12:02.685194831Z [2024-06-27T23:12:02.684+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:12:02.685414258Z [2024-06-27T23:12:02.685+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:11:00+00:00, run_id=scheduled__2024-06-27T23:11:00+00:00, run_start_date=2024-06-27 23:12:00.851189+00:00, run_end_date=2024-06-27 23:12:02.685135+00:00, run_duration=1.833946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:11:00+00:00, data_interval_end=2024-06-27 23:12:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:12:02.695336371Z [2024-06-27T23:12:02.695+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:12:00+00:00, run_after=2024-06-27T23:13:00+00:00 2024-06-27T23:12:02.757566273Z [2024-06-27T23:12:02.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:10:00+00:00 exited with status success for try_number 1 2024-06-27T23:12:02.757625303Z [2024-06-27T23:12:02.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:11:00+00:00 exited with status success for try_number 1 2024-06-27T23:12:02.763612403Z [2024-06-27T23:12:02.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:10:00+00:00, map_index=-1, run_start_date=2024-06-27 23:12:01.886017+00:00, run_end_date=2024-06-27 23:12:02.415871+00:00, run_duration=0.529854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=188, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:12:00.949013+00:00, queued_by_job_id=2, pid=2824 2024-06-27T23:12:02.763798092Z [2024-06-27T23:12:02.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:11:00+00:00, map_index=-1, run_start_date=2024-06-27 23:12:02.033350+00:00, run_end_date=2024-06-27 23:12:02.478601+00:00, run_duration=0.445251, state=success, executor_state=success, try_number=1, max_tries=1, job_id=189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:12:00.949013+00:00, queued_by_job_id=2, pid=2825 2024-06-27T23:12:05.415338541Z [2024-06-27T23:12:05.414+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:12:05.416738078Z [2024-06-27T23:12:05.416+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:11:00+00:00, run_id=scheduled__2024-06-27T23:11:00+00:00, run_start_date=2024-06-27 23:12:00.852327+00:00, run_end_date=2024-06-27 23:12:05.415252+00:00, run_duration=4.562925, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:11:00+00:00, data_interval_end=2024-06-27 23:12:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:12:05.434095458Z [2024-06-27T23:12:05.433+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:12:00+00:00, run_after=2024-06-27T23:13:00+00:00 2024-06-27T23:12:05.453777632Z [2024-06-27T23:12:05.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:12:05.454551343Z [2024-06-27T23:12:05.454+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:11:00+00:00, run_id=scheduled__2024-06-27T23:11:00+00:00, run_start_date=2024-06-27 23:12:00.853438+00:00, run_end_date=2024-06-27 23:12:05.453721+00:00, run_duration=4.600283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:11:00+00:00, data_interval_end=2024-06-27 23:12:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:12:05.466759474Z [2024-06-27T23:12:05.466+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:12:00+00:00, run_after=2024-06-27T23:13:00+00:00 2024-06-27T23:12:05.496733587Z [2024-06-27T23:12:05.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:11:00+00:00 exited with status success for try_number 1 2024-06-27T23:12:05.496980141Z [2024-06-27T23:12:05.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:11:00+00:00 exited with status success for try_number 1 2024-06-27T23:12:05.518886602Z [2024-06-27T23:12:05.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:11:00+00:00, map_index=-1, run_start_date=2024-06-27 23:12:03.396821+00:00, run_end_date=2024-06-27 23:12:04.948524+00:00, run_duration=1.551703, state=success, executor_state=success, try_number=1, max_tries=1, job_id=191, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:12:00.949013+00:00, queued_by_job_id=2, pid=2849 2024-06-27T23:12:05.518910160Z [2024-06-27T23:12:05.518+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:11:00+00:00, map_index=-1, run_start_date=2024-06-27 23:12:03.262132+00:00, run_end_date=2024-06-27 23:12:04.970484+00:00, run_duration=1.708352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=190, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:12:00.949013+00:00, queued_by_job_id=2, pid=2848 2024-06-27T23:13:00.593652834Z [2024-06-27T23:13:00.593+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:13:00+00:00, run_after=2024-06-27T23:14:00+00:00 2024-06-27T23:13:00.611212583Z [2024-06-27T23:13:00.610+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:13:00+00:00, run_after=2024-06-27T23:14:00+00:00 2024-06-27T23:13:00.618098217Z [2024-06-27T23:13:00.617+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:13:00.673622331Z [2024-06-27T23:13:00.673+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:13:00.673663043Z 2024-06-27T23:13:00.673672928Z 2024-06-27T23:13:00.673681108Z 2024-06-27T23:13:00.673702951Z [2024-06-27T23:13:00.673+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:13:00.673881645Z [2024-06-27T23:13:00.673+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:13:00.674017688Z [2024-06-27T23:13:00.673+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:13:00.674667671Z [2024-06-27T23:13:00.674+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:13:00.674747875Z 2024-06-27T23:13:00.674801404Z 2024-06-27T23:13:00.674810012Z 2024-06-27T23:13:00.678546962Z [2024-06-27T23:13:00.678+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:13:00.678752886Z [2024-06-27T23:13:00.678+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:13:00.679039245Z [2024-06-27T23:13:00.678+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:13:00.679179427Z [2024-06-27T23:13:00.679+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:13:00.679420107Z [2024-06-27T23:13:00.679+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:13:00.679472162Z [2024-06-27T23:13:00.679+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:13:00.985363673Z [2024-06-27T23:13:00.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:12:00+00:00 exited with status queued for try_number 1 2024-06-27T23:13:00.985703204Z [2024-06-27T23:13:00.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:12:00+00:00 exited with status queued for try_number 1 2024-06-27T23:13:00.985735373Z [2024-06-27T23:13:00.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:12:00+00:00 exited with status queued for try_number 1 2024-06-27T23:13:00.995401117Z [2024-06-27T23:13:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c1ced96-6549-41ce-9a4c-118dadb89787 2024-06-27T23:13:00.995872331Z [2024-06-27T23:13:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25d64158-c1e3-4357-aa44-8e073eb97b89 2024-06-27T23:13:00.996158447Z [2024-06-27T23:13:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to b199a84c-48c8-4879-80f5-1a72548e0379 2024-06-27T23:13:02.184512342Z [2024-06-27T23:13:02.184+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:13:02.184910289Z [2024-06-27T23:13:02.184+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:12:00+00:00, run_id=scheduled__2024-06-27T23:12:00+00:00, run_start_date=2024-06-27 23:13:00.627556+00:00, run_end_date=2024-06-27 23:13:02.184506+00:00, run_duration=1.55695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:12:00+00:00, data_interval_end=2024-06-27 23:13:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:13:02.197221958Z [2024-06-27T23:13:02.196+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:13:00+00:00, run_after=2024-06-27T23:14:00+00:00 2024-06-27T23:13:02.244653431Z [2024-06-27T23:13:02.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:12:00+00:00 exited with status success for try_number 1 2024-06-27T23:13:02.252102329Z [2024-06-27T23:13:02.251+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:12:00+00:00, map_index=-1, run_start_date=2024-06-27 23:13:01.502580+00:00, run_end_date=2024-06-27 23:13:01.947716+00:00, run_duration=0.445136, state=success, executor_state=success, try_number=1, max_tries=1, job_id=192, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:13:00.676229+00:00, queued_by_job_id=2, pid=2881 2024-06-27T23:13:04.628324844Z [2024-06-27T23:13:04.627+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:13:04.628934153Z [2024-06-27T23:13:04.628+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:12:00+00:00, run_id=scheduled__2024-06-27T23:12:00+00:00, run_start_date=2024-06-27 23:13:00.628792+00:00, run_end_date=2024-06-27 23:13:04.628204+00:00, run_duration=3.999412, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:12:00+00:00, data_interval_end=2024-06-27 23:13:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:13:04.638192981Z [2024-06-27T23:13:04.637+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:13:00+00:00, run_after=2024-06-27T23:14:00+00:00 2024-06-27T23:13:05.856459087Z [2024-06-27T23:13:05.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:12:00+00:00 exited with status success for try_number 1 2024-06-27T23:13:05.901158081Z [2024-06-27T23:13:05.900+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:12:00+00:00, map_index=-1, run_start_date=2024-06-27 23:13:02.788831+00:00, run_end_date=2024-06-27 23:13:04.486768+00:00, run_duration=1.697937, state=success, executor_state=success, try_number=1, max_tries=1, job_id=193, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:13:00.676229+00:00, queued_by_job_id=2, pid=2899 2024-06-27T23:13:06.976937191Z [2024-06-27T23:13:06.976+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:13:06.977372150Z [2024-06-27T23:13:06.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:12:00+00:00, run_id=scheduled__2024-06-27T23:12:00+00:00, run_start_date=2024-06-27 23:13:00.629776+00:00, run_end_date=2024-06-27 23:13:06.976847+00:00, run_duration=6.347071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:12:00+00:00, data_interval_end=2024-06-27 23:13:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:13:06.991272417Z [2024-06-27T23:13:06.991+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:13:00+00:00, run_after=2024-06-27T23:14:00+00:00 2024-06-27T23:13:07.055313647Z [2024-06-27T23:13:07.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:12:00+00:00 exited with status success for try_number 1 2024-06-27T23:13:07.062515084Z [2024-06-27T23:13:07.062+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:12:00+00:00, map_index=-1, run_start_date=2024-06-27 23:13:02.888158+00:00, run_end_date=2024-06-27 23:13:05.943229+00:00, run_duration=3.055071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:13:00.676229+00:00, queued_by_job_id=2, pid=2900 2024-06-27T23:14:01.100775646Z [2024-06-27T23:14:01.100+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:14:01.122798450Z [2024-06-27T23:14:01.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:14:00+00:00, run_after=2024-06-27T23:15:00+00:00 2024-06-27T23:14:01.147182281Z [2024-06-27T23:14:01.146+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:14:01.160252175Z [2024-06-27T23:14:01.159+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:14:00+00:00, run_after=2024-06-27T23:15:00+00:00 2024-06-27T23:14:01.288433418Z [2024-06-27T23:14:01.288+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:14:01.288454675Z 2024-06-27T23:14:01.288458869Z 2024-06-27T23:14:01.288462521Z 2024-06-27T23:14:01.288483430Z 2024-06-27T23:14:01.290196621Z [2024-06-27T23:14:01.288+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:14:01.290208935Z [2024-06-27T23:14:01.288+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:14:01.290212547Z [2024-06-27T23:14:01.289+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:14:01.290215713Z [2024-06-27T23:14:01.289+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:14:01.290218996Z [2024-06-27T23:14:01.289+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:14:01.290222998Z 2024-06-27T23:14:01.290226109Z 2024-06-27T23:14:01.290229227Z 2024-06-27T23:14:01.290232221Z 2024-06-27T23:14:01.295698573Z [2024-06-27T23:14:01.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:14:01.295808748Z [2024-06-27T23:14:01.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:14:01.296105578Z [2024-06-27T23:14:01.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:14:01.296275167Z [2024-06-27T23:14:01.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:14:01.296648425Z [2024-06-27T23:14:01.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:14:01.296813864Z [2024-06-27T23:14:01.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:14:01.297124698Z [2024-06-27T23:14:01.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:14:01.297510770Z [2024-06-27T23:14:01.297+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:14:02.166197629Z [2024-06-27T23:14:02.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:12:00+00:00 exited with status queued for try_number 1 2024-06-27T23:14:02.166236576Z [2024-06-27T23:14:02.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:13:00+00:00 exited with status queued for try_number 1 2024-06-27T23:14:02.166360800Z [2024-06-27T23:14:02.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:13:00+00:00 exited with status queued for try_number 1 2024-06-27T23:14:02.166543979Z [2024-06-27T23:14:02.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:13:00+00:00 exited with status queued for try_number 1 2024-06-27T23:14:02.204373119Z [2024-06-27T23:14:02.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to 677a273e-48aa-4c21-97f6-9ab5c8777cf3 2024-06-27T23:14:02.204577731Z [2024-06-27T23:14:02.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fc744cb-3bb9-4378-93ae-b306131d87d8 2024-06-27T23:14:02.205598133Z [2024-06-27T23:14:02.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4459646-fa88-4a15-ac74-3a547d2427ab 2024-06-27T23:14:02.205799013Z [2024-06-27T23:14:02.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a506e14-3032-40ec-8988-e99243f72bfd 2024-06-27T23:14:05.441151296Z [2024-06-27T23:14:05.440+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:14:05.459769528Z [2024-06-27T23:14:05.459+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:12:00+00:00, run_id=scheduled__2024-06-27T23:12:00+00:00, run_start_date=2024-06-27 23:14:01.201173+00:00, run_end_date=2024-06-27 23:14:05.441070+00:00, run_duration=4.239897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:12:00+00:00, data_interval_end=2024-06-27 23:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:14:05.766644078Z [2024-06-27T23:14:05.766+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:14:00+00:00, run_after=2024-06-27T23:16:00+00:00 2024-06-27T23:14:07.101274089Z [2024-06-27T23:14:07.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:12:00+00:00 exited with status success for try_number 1 2024-06-27T23:14:07.151777132Z [2024-06-27T23:14:07.151+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:12:00+00:00, map_index=-1, run_start_date=2024-06-27 23:14:03.766864+00:00, run_end_date=2024-06-27 23:14:05.207740+00:00, run_duration=1.440876, state=success, executor_state=success, try_number=1, max_tries=1, job_id=195, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:14:01.290888+00:00, queued_by_job_id=2, pid=2932 2024-06-27T23:14:08.986144387Z [2024-06-27T23:14:08.985+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:14:08.986336753Z [2024-06-27T23:14:08.986+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:13:00+00:00, run_id=scheduled__2024-06-27T23:13:00+00:00, run_start_date=2024-06-27 23:14:01.205947+00:00, run_end_date=2024-06-27 23:14:08.986071+00:00, run_duration=7.780124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:13:00+00:00, data_interval_end=2024-06-27 23:14:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:14:09.076031086Z [2024-06-27T23:14:09.075+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:14:00+00:00, run_after=2024-06-27T23:15:00+00:00 2024-06-27T23:14:09.454813599Z [2024-06-27T23:14:09.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:13:00+00:00 exited with status success for try_number 1 2024-06-27T23:14:09.819576750Z [2024-06-27T23:14:09.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:13:00+00:00, map_index=-1, run_start_date=2024-06-27 23:14:04.720779+00:00, run_end_date=2024-06-27 23:14:07.974488+00:00, run_duration=3.253709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=196, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:14:01.290888+00:00, queued_by_job_id=2, pid=2938 2024-06-27T23:14:12.438577919Z [2024-06-27T23:14:12.438+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:14:12.438852938Z [2024-06-27T23:14:12.438+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:13:00+00:00, run_id=scheduled__2024-06-27T23:13:00+00:00, run_start_date=2024-06-27 23:14:01.208648+00:00, run_end_date=2024-06-27 23:14:12.438517+00:00, run_duration=11.229869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:13:00+00:00, data_interval_end=2024-06-27 23:14:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:14:12.453378438Z [2024-06-27T23:14:12.452+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:14:00+00:00, run_after=2024-06-27T23:15:00+00:00 2024-06-27T23:14:12.954088571Z [2024-06-27T23:14:12.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:13:00+00:00 exited with status success for try_number 1 2024-06-27T23:14:12.961450395Z [2024-06-27T23:14:12.961+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:13:00+00:00, map_index=-1, run_start_date=2024-06-27 23:14:09.737530+00:00, run_end_date=2024-06-27 23:14:12.347305+00:00, run_duration=2.609775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:14:01.290888+00:00, queued_by_job_id=2, pid=2951 2024-06-27T23:14:14.154366467Z [2024-06-27T23:14:14.153+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:14:14.154800219Z [2024-06-27T23:14:14.154+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:13:00+00:00, run_id=scheduled__2024-06-27T23:13:00+00:00, run_start_date=2024-06-27 23:14:01.207465+00:00, run_end_date=2024-06-27 23:14:14.154281+00:00, run_duration=12.946816, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:13:00+00:00, data_interval_end=2024-06-27 23:14:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:14:14.167127719Z [2024-06-27T23:14:14.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:14:00+00:00, run_after=2024-06-27T23:15:00+00:00 2024-06-27T23:14:14.199222637Z [2024-06-27T23:14:14.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:13:00+00:00 exited with status success for try_number 1 2024-06-27T23:14:14.205128951Z [2024-06-27T23:14:14.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:13:00+00:00, map_index=-1, run_start_date=2024-06-27 23:14:11.033556+00:00, run_end_date=2024-06-27 23:14:13.267370+00:00, run_duration=2.233814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=198, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:14:01.290888+00:00, queued_by_job_id=2, pid=2962 2024-06-27T23:15:01.067898195Z [2024-06-27T23:15:01.067+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:15:00+00:00, run_after=2024-06-27T23:16:00+00:00 2024-06-27T23:15:01.080718792Z [2024-06-27T23:15:01.080+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:15:00+00:00, run_after=2024-06-27T23:16:00+00:00 2024-06-27T23:15:01.088323336Z [2024-06-27T23:15:01.088+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:15:01.101854378Z [2024-06-27T23:15:01.101+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:15:00+00:00, run_after=2024-06-27T23:20:00+00:00 2024-06-27T23:15:01.201454290Z [2024-06-27T23:15:01.201+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:15:01.201469656Z 2024-06-27T23:15:01.201476209Z 2024-06-27T23:15:01.201479804Z 2024-06-27T23:15:01.201493507Z 2024-06-27T23:15:01.202773278Z [2024-06-27T23:15:01.202+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:15:01.202998894Z [2024-06-27T23:15:01.202+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:15:01.203359844Z [2024-06-27T23:15:01.203+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:15:01.203644353Z [2024-06-27T23:15:01.203+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:15:01.206449482Z [2024-06-27T23:15:01.206+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:15:01.206461428Z 2024-06-27T23:15:01.206467803Z 2024-06-27T23:15:01.206471242Z 2024-06-27T23:15:01.206491100Z 2024-06-27T23:15:01.211712970Z [2024-06-27T23:15:01.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T23:15:01.211870706Z [2024-06-27T23:15:01.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:15:01.212102156Z [2024-06-27T23:15:01.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:15:01.212207559Z [2024-06-27T23:15:01.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:15:01.212448751Z [2024-06-27T23:15:01.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:15:01.212527762Z [2024-06-27T23:15:01.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:15:01.212731218Z [2024-06-27T23:15:01.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:15:01.212983132Z [2024-06-27T23:15:01.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:15:01.644659293Z [2024-06-27T23:15:01.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:10:00+00:00 exited with status queued for try_number 1 2024-06-27T23:15:01.646732255Z [2024-06-27T23:15:01.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:14:00+00:00 exited with status queued for try_number 1 2024-06-27T23:15:01.646945953Z [2024-06-27T23:15:01.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:14:00+00:00 exited with status queued for try_number 1 2024-06-27T23:15:01.647047819Z [2024-06-27T23:15:01.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:14:00+00:00 exited with status queued for try_number 1 2024-06-27T23:15:01.656474746Z [2024-06-27T23:15:01.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3bf365c-7d0a-4586-90ad-770e3df82c2d 2024-06-27T23:15:01.656682441Z [2024-06-27T23:15:01.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c293b8c-9f51-4d80-9187-91927ea4f39e 2024-06-27T23:15:01.656854243Z [2024-06-27T23:15:01.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 627780e4-605a-4bd3-aaf4-8f966269f639 2024-06-27T23:15:01.657037486Z [2024-06-27T23:15:01.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a0c7d7b-10fd-4cd9-b845-99e120386597 2024-06-27T23:15:02.923470936Z [2024-06-27T23:15:02.922+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:15:02.923950257Z [2024-06-27T23:15:02.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:14:00+00:00, run_id=scheduled__2024-06-27T23:14:00+00:00, run_start_date=2024-06-27 23:15:01.116895+00:00, run_end_date=2024-06-27 23:15:02.923509+00:00, run_duration=1.806614, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:14:00+00:00, data_interval_end=2024-06-27 23:15:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:15:02.948370861Z [2024-06-27T23:15:02.948+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:15:00+00:00, run_after=2024-06-27T23:16:00+00:00 2024-06-27T23:15:03.034754643Z [2024-06-27T23:15:03.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:14:00+00:00 exited with status success for try_number 1 2024-06-27T23:15:03.039663623Z [2024-06-27T23:15:03.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:14:00+00:00, map_index=-1, run_start_date=2024-06-27 23:15:02.347114+00:00, run_end_date=2024-06-27 23:15:02.767245+00:00, run_duration=0.420131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=199, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:15:01.208201+00:00, queued_by_job_id=2, pid=2989 2024-06-27T23:15:05.336111015Z [2024-06-27T23:15:05.335+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:15:05.336547147Z [2024-06-27T23:15:05.336+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:14:00+00:00, run_id=scheduled__2024-06-27T23:14:00+00:00, run_start_date=2024-06-27 23:15:01.118756+00:00, run_end_date=2024-06-27 23:15:05.336015+00:00, run_duration=4.217259, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:14:00+00:00, data_interval_end=2024-06-27 23:15:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:15:05.345413168Z [2024-06-27T23:15:05.345+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:15:00+00:00, run_after=2024-06-27T23:16:00+00:00 2024-06-27T23:15:05.374806978Z [2024-06-27T23:15:05.374+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:15:05.374822996Z 2024-06-27T23:15:05.375052687Z [2024-06-27T23:15:05.374+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:15:05.376135475Z [2024-06-27T23:15:05.375+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:15:05.376144194Z 2024-06-27T23:15:05.379372532Z [2024-06-27T23:15:05.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-27T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T23:15:05.381379734Z [2024-06-27T23:15:05.381+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-27T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:15:05.525021464Z [2024-06-27T23:15:05.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:10:00+00:00 exited with status queued for try_number 1 2024-06-27T23:15:05.534873246Z [2024-06-27T23:15:05.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:10:00+00:00 exited with status success for try_number 1 2024-06-27T23:15:05.562555924Z [2024-06-27T23:15:05.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a8e1a8f-add3-4f76-8380-d192be50bb96 2024-06-27T23:15:05.562566602Z [2024-06-27T23:15:05.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T23:10:00+00:00, map_index=-1, run_start_date=2024-06-27 23:15:03.884489+00:00, run_end_date=2024-06-27 23:15:04.566430+00:00, run_duration=0.681941, state=success, executor_state=success, try_number=1, max_tries=1, job_id=202, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:15:01.208201+00:00, queued_by_job_id=2, pid=3015 2024-06-27T23:15:05.763516816Z [2024-06-27T23:15:05.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:14:00+00:00 exited with status success for try_number 1 2024-06-27T23:15:05.771470063Z [2024-06-27T23:15:05.771+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:14:00+00:00, map_index=-1, run_start_date=2024-06-27 23:15:03.542082+00:00, run_end_date=2024-06-27 23:15:05.299151+00:00, run_duration=1.757069, state=success, executor_state=success, try_number=1, max_tries=1, job_id=200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:15:01.208201+00:00, queued_by_job_id=2, pid=3013 2024-06-27T23:15:07.605509542Z [2024-06-27T23:15:07.605+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:15:07.606002007Z [2024-06-27T23:15:07.605+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:14:00+00:00, run_id=scheduled__2024-06-27T23:14:00+00:00, run_start_date=2024-06-27 23:15:01.120656+00:00, run_end_date=2024-06-27 23:15:07.605445+00:00, run_duration=6.484789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:14:00+00:00, data_interval_end=2024-06-27 23:15:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:15:07.624515707Z [2024-06-27T23:15:07.624+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:15:00+00:00, run_after=2024-06-27T23:16:00+00:00 2024-06-27T23:15:07.743498128Z [2024-06-27T23:15:07.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:14:00+00:00 exited with status success for try_number 1 2024-06-27T23:15:07.768821903Z [2024-06-27T23:15:07.768+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:14:00+00:00, map_index=-1, run_start_date=2024-06-27 23:15:03.672517+00:00, run_end_date=2024-06-27 23:15:07.237294+00:00, run_duration=3.564777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:15:01.208201+00:00, queued_by_job_id=2, pid=3014 2024-06-27T23:15:08.853437871Z [2024-06-27T23:15:08.853+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:15:08.853468167Z 2024-06-27T23:15:08.853642384Z [2024-06-27T23:15:08.853+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:15:08.854999811Z [2024-06-27T23:15:08.854+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:15:08.855016658Z 2024-06-27T23:15:08.857445923Z [2024-06-27T23:15:08.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-27T23:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T23:15:08.857657399Z [2024-06-27T23:15:08.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-27T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T23:15:08.926153774Z [2024-06-27T23:15:08.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:10:00+00:00 exited with status queued for try_number 1 2024-06-27T23:15:08.931131943Z [2024-06-27T23:15:08.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:10:00+00:00 exited with status success for try_number 1 2024-06-27T23:15:08.941482295Z [2024-06-27T23:15:08.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2322493-b0df-47ae-8adc-a0fc0403b910 2024-06-27T23:15:08.941801447Z [2024-06-27T23:15:08.941+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-27T23:10:00+00:00, map_index=-1, run_start_date=2024-06-27 23:15:07.717478+00:00, run_end_date=2024-06-27 23:15:08.184039+00:00, run_duration=0.466561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=203, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:15:05.376666+00:00, queued_by_job_id=2, pid=3038 2024-06-27T23:15:11.653744335Z [2024-06-27T23:15:11.653+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:15:11.653755790Z 2024-06-27T23:15:11.653789489Z [2024-06-27T23:15:11.653+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:15:11.654448974Z [2024-06-27T23:15:11.654+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:15:11.654474011Z 2024-06-27T23:15:11.656960391Z [2024-06-27T23:15:11.656+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-27T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:15:11.657173824Z [2024-06-27T23:15:11.656+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-27T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:15:11.704728424Z [2024-06-27T23:15:11.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:10:00+00:00 exited with status queued for try_number 1 2024-06-27T23:15:11.704754159Z [2024-06-27T23:15:11.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:10:00+00:00 exited with status success for try_number 1 2024-06-27T23:15:11.712378200Z [2024-06-27T23:15:11.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to c14c4539-4bdd-40f0-b09f-df12cb05e2ee 2024-06-27T23:15:11.712500969Z [2024-06-27T23:15:11.712+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-27T23:10:00+00:00, map_index=0, run_start_date=2024-06-27 23:15:10.645423+00:00, run_end_date=2024-06-27 23:15:11.011871+00:00, run_duration=0.366448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=204, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:15:08.855397+00:00, queued_by_job_id=2, pid=3046 2024-06-27T23:15:14.440042120Z [2024-06-27T23:15:14.439+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:15:14.440618849Z [2024-06-27T23:15:14.440+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:10:00+00:00, run_id=scheduled__2024-06-27T23:10:00+00:00, run_start_date=2024-06-27 23:15:01.115223+00:00, run_end_date=2024-06-27 23:15:14.440118+00:00, run_duration=13.324895, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:10:00+00:00, data_interval_end=2024-06-27 23:15:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-27T23:15:14.446998458Z [2024-06-27T23:15:14.446+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:15:00+00:00, run_after=2024-06-27T23:20:00+00:00 2024-06-27T23:15:14.490299783Z [2024-06-27T23:15:14.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:10:00+00:00 exited with status success for try_number 1 2024-06-27T23:15:14.498161039Z [2024-06-27T23:15:14.497+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-27T23:10:00+00:00, map_index=-1, run_start_date=2024-06-27 23:15:13.504273+00:00, run_end_date=2024-06-27 23:15:13.950517+00:00, run_duration=0.446244, state=success, executor_state=success, try_number=1, max_tries=1, job_id=205, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:15:11.654839+00:00, queued_by_job_id=2, pid=3054 2024-06-27T23:16:00.273039346Z [2024-06-27T23:16:00.272+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:16:00+00:00, run_after=2024-06-27T23:17:00+00:00 2024-06-27T23:16:00.281456327Z [2024-06-27T23:16:00.281+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:16:00.296024929Z [2024-06-27T23:16:00.295+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:16:00+00:00, run_after=2024-06-27T23:17:00+00:00 2024-06-27T23:16:00.303936045Z [2024-06-27T23:16:00.303+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:16:00.378805014Z [2024-06-27T23:16:00.378+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:16:00.378827419Z 2024-06-27T23:16:00.378831370Z 2024-06-27T23:16:00.378835304Z 2024-06-27T23:16:00.378838479Z 2024-06-27T23:16:00.378867285Z [2024-06-27T23:16:00.378+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:16:00.379019479Z [2024-06-27T23:16:00.378+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:16:00.379139666Z [2024-06-27T23:16:00.379+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:16:00.379325042Z [2024-06-27T23:16:00.379+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:16:00.379985931Z [2024-06-27T23:16:00.379+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:16:00.379998302Z 2024-06-27T23:16:00.380002245Z 2024-06-27T23:16:00.380005737Z 2024-06-27T23:16:00.380009337Z 2024-06-27T23:16:00.383490110Z [2024-06-27T23:16:00.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:16:00.383659996Z [2024-06-27T23:16:00.383+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:16:00.383905512Z [2024-06-27T23:16:00.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:16:00.384023686Z [2024-06-27T23:16:00.383+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:16:00.384240945Z [2024-06-27T23:16:00.384+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:16:00.384358433Z [2024-06-27T23:16:00.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:16:00.384551047Z [2024-06-27T23:16:00.384+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:16:00.384662106Z [2024-06-27T23:16:00.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:16:00.809221800Z [2024-06-27T23:16:00.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:14:00+00:00 exited with status queued for try_number 1 2024-06-27T23:16:00.809491586Z [2024-06-27T23:16:00.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:15:00+00:00 exited with status queued for try_number 1 2024-06-27T23:16:00.810646471Z [2024-06-27T23:16:00.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:15:00+00:00 exited with status queued for try_number 1 2024-06-27T23:16:00.810874946Z [2024-06-27T23:16:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:15:00+00:00 exited with status queued for try_number 1 2024-06-27T23:16:00.829719511Z [2024-06-27T23:16:00.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b8690a2-44c7-4631-882e-884fe655a592 2024-06-27T23:16:00.829949852Z [2024-06-27T23:16:00.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7653518-4fdf-4758-a742-e238737cebf2 2024-06-27T23:16:00.830154881Z [2024-06-27T23:16:00.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe9772ae-8226-4848-b01c-6e4e75f53884 2024-06-27T23:16:00.830327366Z [2024-06-27T23:16:00.830+0000] {scheduler_job.py:635} INFO - Setting external_id for to f32c9d99-c747-473f-91e8-e26e12ac0f4d 2024-06-27T23:16:03.335075626Z [2024-06-27T23:16:03.334+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:16:03.335410964Z [2024-06-27T23:16:03.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:14:00+00:00, run_id=scheduled__2024-06-27T23:14:00+00:00, run_start_date=2024-06-27 23:16:00.313944+00:00, run_end_date=2024-06-27 23:16:03.334981+00:00, run_duration=3.021037, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:14:00+00:00, data_interval_end=2024-06-27 23:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:16:03.344013004Z [2024-06-27T23:16:03.343+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:16:00+00:00, run_after=2024-06-27T23:18:00+00:00 2024-06-27T23:16:03.352999444Z [2024-06-27T23:16:03.351+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:16:03.353017585Z [2024-06-27T23:16:03.352+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:15:00+00:00, run_id=scheduled__2024-06-27T23:15:00+00:00, run_start_date=2024-06-27 23:16:00.315568+00:00, run_end_date=2024-06-27 23:16:03.352034+00:00, run_duration=3.036466, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:15:00+00:00, data_interval_end=2024-06-27 23:16:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:16:03.363419905Z [2024-06-27T23:16:03.363+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:16:00+00:00, run_after=2024-06-27T23:17:00+00:00 2024-06-27T23:16:03.460108336Z [2024-06-27T23:16:03.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:14:00+00:00 exited with status success for try_number 1 2024-06-27T23:16:03.460144135Z [2024-06-27T23:16:03.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:15:00+00:00 exited with status success for try_number 1 2024-06-27T23:16:03.468984120Z [2024-06-27T23:16:03.468+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:15:00+00:00, map_index=-1, run_start_date=2024-06-27 23:16:01.500310+00:00, run_end_date=2024-06-27 23:16:02.185079+00:00, run_duration=0.684769, state=success, executor_state=success, try_number=1, max_tries=1, job_id=206, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:16:00.380749+00:00, queued_by_job_id=2, pid=3077 2024-06-27T23:16:03.469506137Z [2024-06-27T23:16:03.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:14:00+00:00, map_index=-1, run_start_date=2024-06-27 23:16:01.879795+00:00, run_end_date=2024-06-27 23:16:02.551285+00:00, run_duration=0.67149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=207, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:16:00.380749+00:00, queued_by_job_id=2, pid=3083 2024-06-27T23:16:05.931926022Z [2024-06-27T23:16:05.931+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:16:05.932702992Z [2024-06-27T23:16:05.932+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:15:00+00:00, run_id=scheduled__2024-06-27T23:15:00+00:00, run_start_date=2024-06-27 23:16:00.318509+00:00, run_end_date=2024-06-27 23:16:05.931859+00:00, run_duration=5.61335, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:15:00+00:00, data_interval_end=2024-06-27 23:16:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:16:05.942706119Z [2024-06-27T23:16:05.942+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:16:00+00:00, run_after=2024-06-27T23:17:00+00:00 2024-06-27T23:16:05.953053255Z [2024-06-27T23:16:05.952+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:16:05.953205648Z [2024-06-27T23:16:05.953+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:15:00+00:00, run_id=scheduled__2024-06-27T23:15:00+00:00, run_start_date=2024-06-27 23:16:00.317291+00:00, run_end_date=2024-06-27 23:16:05.952978+00:00, run_duration=5.635687, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:15:00+00:00, data_interval_end=2024-06-27 23:16:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:16:05.964387485Z [2024-06-27T23:16:05.964+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:16:00+00:00, run_after=2024-06-27T23:17:00+00:00 2024-06-27T23:16:06.091663958Z [2024-06-27T23:16:06.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:15:00+00:00 exited with status success for try_number 1 2024-06-27T23:16:06.091735511Z [2024-06-27T23:16:06.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:15:00+00:00 exited with status success for try_number 1 2024-06-27T23:16:06.101616470Z [2024-06-27T23:16:06.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:15:00+00:00, map_index=-1, run_start_date=2024-06-27 23:16:03.524721+00:00, run_end_date=2024-06-27 23:16:05.890707+00:00, run_duration=2.365986, state=success, executor_state=success, try_number=1, max_tries=1, job_id=208, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:16:00.380749+00:00, queued_by_job_id=2, pid=3101 2024-06-27T23:16:06.101733505Z [2024-06-27T23:16:06.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:15:00+00:00, map_index=-1, run_start_date=2024-06-27 23:16:03.700800+00:00, run_end_date=2024-06-27 23:16:05.706054+00:00, run_duration=2.005254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=209, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:16:00.380749+00:00, queued_by_job_id=2, pid=3102 2024-06-27T23:16:44.492881190Z [2024-06-27T23:16:44.492+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T23:17:00.931673494Z [2024-06-27T23:17:00.931+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:17:00.946852142Z [2024-06-27T23:17:00.946+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:17:00+00:00, run_after=2024-06-27T23:18:00+00:00 2024-06-27T23:17:00.968720609Z [2024-06-27T23:17:00.968+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:17:00+00:00, run_after=2024-06-27T23:18:00+00:00 2024-06-27T23:17:01.063548670Z [2024-06-27T23:17:01.063+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:17:01.063564465Z 2024-06-27T23:17:01.063567993Z 2024-06-27T23:17:01.063571392Z 2024-06-27T23:17:01.063701645Z [2024-06-27T23:17:01.063+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:17:01.063867452Z [2024-06-27T23:17:01.063+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:17:01.063990308Z [2024-06-27T23:17:01.063+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:17:01.064577444Z [2024-06-27T23:17:01.064+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:17:01.064588789Z 2024-06-27T23:17:01.064592204Z 2024-06-27T23:17:01.064595429Z 2024-06-27T23:17:01.068208565Z [2024-06-27T23:17:01.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:17:01.068447721Z [2024-06-27T23:17:01.068+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:17:01.069980298Z [2024-06-27T23:17:01.069+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:17:01.070127257Z [2024-06-27T23:17:01.069+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:17:01.070385445Z [2024-06-27T23:17:01.070+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:17:01.070547938Z [2024-06-27T23:17:01.070+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:17:01.461523051Z [2024-06-27T23:17:01.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:16:00+00:00 exited with status queued for try_number 1 2024-06-27T23:17:01.461594447Z [2024-06-27T23:17:01.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:16:00+00:00 exited with status queued for try_number 1 2024-06-27T23:17:01.462202781Z [2024-06-27T23:17:01.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:16:00+00:00 exited with status queued for try_number 1 2024-06-27T23:17:01.473927086Z [2024-06-27T23:17:01.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79101a7e-b9d8-47b0-b7b6-4677350123d1 2024-06-27T23:17:01.473999405Z [2024-06-27T23:17:01.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cac603b-fd30-4520-bc22-5d1d12e397a6 2024-06-27T23:17:01.474138538Z [2024-06-27T23:17:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e0586a3-e132-4567-951a-b371ff165c07 2024-06-27T23:17:03.134012415Z [2024-06-27T23:17:03.133+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:17:03.134538412Z [2024-06-27T23:17:03.134+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:16:00+00:00, run_id=scheduled__2024-06-27T23:16:00+00:00, run_start_date=2024-06-27 23:17:00.981673+00:00, run_end_date=2024-06-27 23:17:03.134138+00:00, run_duration=2.152465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:16:00+00:00, data_interval_end=2024-06-27 23:17:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:17:03.154522973Z [2024-06-27T23:17:03.154+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:17:00+00:00, run_after=2024-06-27T23:18:00+00:00 2024-06-27T23:17:03.232329560Z [2024-06-27T23:17:03.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:16:00+00:00 exited with status success for try_number 1 2024-06-27T23:17:03.239435035Z [2024-06-27T23:17:03.238+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:16:00+00:00, map_index=-1, run_start_date=2024-06-27 23:17:02.208574+00:00, run_end_date=2024-06-27 23:17:02.676415+00:00, run_duration=0.467841, state=success, executor_state=success, try_number=1, max_tries=1, job_id=210, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:17:01.065266+00:00, queued_by_job_id=2, pid=3134 2024-06-27T23:17:05.406340428Z [2024-06-27T23:17:05.405+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:17:05.406516441Z [2024-06-27T23:17:05.406+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:16:00+00:00, run_id=scheduled__2024-06-27T23:16:00+00:00, run_start_date=2024-06-27 23:17:00.996300+00:00, run_end_date=2024-06-27 23:17:05.406273+00:00, run_duration=4.409973, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:16:00+00:00, data_interval_end=2024-06-27 23:17:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:17:05.424413822Z [2024-06-27T23:17:05.424+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:17:00+00:00, run_after=2024-06-27T23:18:00+00:00 2024-06-27T23:17:05.432722553Z [2024-06-27T23:17:05.432+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:17:05.432883761Z [2024-06-27T23:17:05.432+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:16:00+00:00, run_id=scheduled__2024-06-27T23:16:00+00:00, run_start_date=2024-06-27 23:17:01.001191+00:00, run_end_date=2024-06-27 23:17:05.432655+00:00, run_duration=4.431464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:16:00+00:00, data_interval_end=2024-06-27 23:17:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:17:05.442198963Z [2024-06-27T23:17:05.441+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:17:00+00:00, run_after=2024-06-27T23:18:00+00:00 2024-06-27T23:17:05.481622922Z [2024-06-27T23:17:05.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:16:00+00:00 exited with status success for try_number 1 2024-06-27T23:17:05.481884606Z [2024-06-27T23:17:05.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:16:00+00:00 exited with status success for try_number 1 2024-06-27T23:17:05.488487964Z [2024-06-27T23:17:05.488+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:16:00+00:00, map_index=-1, run_start_date=2024-06-27 23:17:03.453862+00:00, run_end_date=2024-06-27 23:17:04.814870+00:00, run_duration=1.361008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=212, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:17:01.065266+00:00, queued_by_job_id=2, pid=3153 2024-06-27T23:17:05.488872823Z [2024-06-27T23:17:05.488+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:16:00+00:00, map_index=-1, run_start_date=2024-06-27 23:17:03.386234+00:00, run_end_date=2024-06-27 23:17:04.894855+00:00, run_duration=1.508621, state=success, executor_state=success, try_number=1, max_tries=1, job_id=211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:17:01.065266+00:00, queued_by_job_id=2, pid=3152 2024-06-27T23:18:00.156886775Z [2024-06-27T23:18:00.156+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:18:00.178240892Z [2024-06-27T23:18:00.177+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:18:00+00:00, run_after=2024-06-27T23:19:00+00:00 2024-06-27T23:18:00.197022502Z [2024-06-27T23:18:00.194+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:18:00+00:00, run_after=2024-06-27T23:19:00+00:00 2024-06-27T23:18:00.206616945Z [2024-06-27T23:18:00.205+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:18:00.285581053Z [2024-06-27T23:18:00.285+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:18:00.285603569Z 2024-06-27T23:18:00.285607465Z 2024-06-27T23:18:00.285610488Z 2024-06-27T23:18:00.285613545Z 2024-06-27T23:18:00.285728673Z [2024-06-27T23:18:00.285+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:18:00.285832754Z [2024-06-27T23:18:00.285+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:18:00.285940888Z [2024-06-27T23:18:00.285+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:18:00.286013521Z [2024-06-27T23:18:00.285+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:18:00.286591886Z [2024-06-27T23:18:00.286+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:18:00.286598820Z 2024-06-27T23:18:00.286601969Z 2024-06-27T23:18:00.286604937Z 2024-06-27T23:18:00.286607913Z 2024-06-27T23:18:00.289997854Z [2024-06-27T23:18:00.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:18:00.290106581Z [2024-06-27T23:18:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:18:00.290458176Z [2024-06-27T23:18:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:18:00.290670226Z [2024-06-27T23:18:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:18:00.290999861Z [2024-06-27T23:18:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:18:00.291203469Z [2024-06-27T23:18:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:18:00.291429477Z [2024-06-27T23:18:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:18:00.291542758Z [2024-06-27T23:18:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:18:00.785214655Z [2024-06-27T23:18:00.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:16:00+00:00 exited with status queued for try_number 1 2024-06-27T23:18:00.787021403Z [2024-06-27T23:18:00.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:17:00+00:00 exited with status queued for try_number 1 2024-06-27T23:18:00.787194178Z [2024-06-27T23:18:00.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:17:00+00:00 exited with status queued for try_number 1 2024-06-27T23:18:00.787358856Z [2024-06-27T23:18:00.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:17:00+00:00 exited with status queued for try_number 1 2024-06-27T23:18:00.817667106Z [2024-06-27T23:18:00.817+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24f4da2e-7961-4dca-a774-8c932635efff 2024-06-27T23:18:00.821348569Z [2024-06-27T23:18:00.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 536c2886-ab47-4803-b1cf-78dd001c1426 2024-06-27T23:18:00.821823120Z [2024-06-27T23:18:00.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to b23b49c3-03b4-48b0-bd79-1413e0cc508d 2024-06-27T23:18:00.825704854Z [2024-06-27T23:18:00.822+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6fe26c3f-4a98-48b3-9d60-caff700dacf8 2024-06-27T23:18:02.226607774Z [2024-06-27T23:18:02.226+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:18:02.228013955Z [2024-06-27T23:18:02.227+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:16:00+00:00, run_id=scheduled__2024-06-27T23:16:00+00:00, run_start_date=2024-06-27 23:18:00.220614+00:00, run_end_date=2024-06-27 23:18:02.226543+00:00, run_duration=2.005929, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:16:00+00:00, data_interval_end=2024-06-27 23:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:18:02.280785018Z [2024-06-27T23:18:02.280+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:18:00+00:00, run_after=2024-06-27T23:20:00+00:00 2024-06-27T23:18:02.288901558Z [2024-06-27T23:18:02.288+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:18:02.289308692Z [2024-06-27T23:18:02.289+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:17:00+00:00, run_id=scheduled__2024-06-27T23:17:00+00:00, run_start_date=2024-06-27 23:18:00.222090+00:00, run_end_date=2024-06-27 23:18:02.288899+00:00, run_duration=2.066809, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:17:00+00:00, data_interval_end=2024-06-27 23:18:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:18:02.302844055Z [2024-06-27T23:18:02.302+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:18:00+00:00, run_after=2024-06-27T23:19:00+00:00 2024-06-27T23:18:02.366521060Z [2024-06-27T23:18:02.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:16:00+00:00 exited with status success for try_number 1 2024-06-27T23:18:02.366671203Z [2024-06-27T23:18:02.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:17:00+00:00 exited with status success for try_number 1 2024-06-27T23:18:02.376719569Z [2024-06-27T23:18:02.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:17:00+00:00, map_index=-1, run_start_date=2024-06-27 23:18:01.477498+00:00, run_end_date=2024-06-27 23:18:01.973302+00:00, run_duration=0.495804, state=success, executor_state=success, try_number=1, max_tries=1, job_id=213, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:18:00.287504+00:00, queued_by_job_id=2, pid=3186 2024-06-27T23:18:02.376826474Z [2024-06-27T23:18:02.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:16:00+00:00, map_index=-1, run_start_date=2024-06-27 23:18:01.518754+00:00, run_end_date=2024-06-27 23:18:01.908034+00:00, run_duration=0.38928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=214, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:18:00.287504+00:00, queued_by_job_id=2, pid=3187 2024-06-27T23:18:05.339978772Z [2024-06-27T23:18:05.339+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:18:05.340117646Z [2024-06-27T23:18:05.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:17:00+00:00, run_id=scheduled__2024-06-27T23:17:00+00:00, run_start_date=2024-06-27 23:18:00.223118+00:00, run_end_date=2024-06-27 23:18:05.339865+00:00, run_duration=5.116747, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:17:00+00:00, data_interval_end=2024-06-27 23:18:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:18:05.361589845Z [2024-06-27T23:18:05.361+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:18:00+00:00, run_after=2024-06-27T23:19:00+00:00 2024-06-27T23:18:05.421128978Z [2024-06-27T23:18:05.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:17:00+00:00 exited with status success for try_number 1 2024-06-27T23:18:05.427024989Z [2024-06-27T23:18:05.426+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:17:00+00:00, map_index=-1, run_start_date=2024-06-27 23:18:03.123157+00:00, run_end_date=2024-06-27 23:18:04.861294+00:00, run_duration=1.738137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=215, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:18:00.287504+00:00, queued_by_job_id=2, pid=3210 2024-06-27T23:18:06.472878603Z [2024-06-27T23:18:06.472+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:18:06.473230833Z [2024-06-27T23:18:06.473+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:17:00+00:00, run_id=scheduled__2024-06-27T23:17:00+00:00, run_start_date=2024-06-27 23:18:00.224021+00:00, run_end_date=2024-06-27 23:18:06.472790+00:00, run_duration=6.248769, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:17:00+00:00, data_interval_end=2024-06-27 23:18:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:18:06.484928441Z [2024-06-27T23:18:06.483+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:18:00+00:00, run_after=2024-06-27T23:19:00+00:00 2024-06-27T23:18:06.512694422Z [2024-06-27T23:18:06.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:17:00+00:00 exited with status success for try_number 1 2024-06-27T23:18:06.519432193Z [2024-06-27T23:18:06.519+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:17:00+00:00, map_index=-1, run_start_date=2024-06-27 23:18:03.155516+00:00, run_end_date=2024-06-27 23:18:05.413053+00:00, run_duration=2.257537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=216, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:18:00.287504+00:00, queued_by_job_id=2, pid=3211 2024-06-27T23:19:00.376804863Z [2024-06-27T23:19:00.376+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:19:00.394137820Z [2024-06-27T23:19:00.393+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:19:00+00:00, run_after=2024-06-27T23:20:00+00:00 2024-06-27T23:19:00.410760122Z [2024-06-27T23:19:00.410+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:19:00+00:00, run_after=2024-06-27T23:20:00+00:00 2024-06-27T23:19:00.532188233Z [2024-06-27T23:19:00.531+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:19:00.532223968Z 2024-06-27T23:19:00.532230667Z 2024-06-27T23:19:00.532236741Z 2024-06-27T23:19:00.539026056Z [2024-06-27T23:19:00.532+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:19:00.539329414Z [2024-06-27T23:19:00.539+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:19:00.539652292Z [2024-06-27T23:19:00.539+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:19:00.540465366Z [2024-06-27T23:19:00.540+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:19:00.540489933Z 2024-06-27T23:19:00.540499476Z 2024-06-27T23:19:00.540508278Z 2024-06-27T23:19:00.544773533Z [2024-06-27T23:19:00.544+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:19:00.544935550Z [2024-06-27T23:19:00.544+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:19:00.545486378Z [2024-06-27T23:19:00.545+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:19:00.545966422Z [2024-06-27T23:19:00.545+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:19:00.546401064Z [2024-06-27T23:19:00.546+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:19:00.546618956Z [2024-06-27T23:19:00.546+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:19:01.066368520Z [2024-06-27T23:19:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:18:00+00:00 exited with status queued for try_number 1 2024-06-27T23:19:01.066631780Z [2024-06-27T23:19:01.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:18:00+00:00 exited with status queued for try_number 1 2024-06-27T23:19:01.067242450Z [2024-06-27T23:19:01.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:18:00+00:00 exited with status queued for try_number 1 2024-06-27T23:19:01.077305754Z [2024-06-27T23:19:01.076+0000] {scheduler_job.py:635} INFO - Setting external_id for to c11c2fae-bf3a-4c35-adb4-d5aefde5b73b 2024-06-27T23:19:01.077744996Z [2024-06-27T23:19:01.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to d492bffb-8ce0-4319-80e0-477dbcb5bc05 2024-06-27T23:19:01.078030639Z [2024-06-27T23:19:01.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d5da04c-1330-4f60-b23b-c4ca91fa143b 2024-06-27T23:19:02.258519796Z [2024-06-27T23:19:02.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:19:02.258771257Z [2024-06-27T23:19:02.258+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:18:00+00:00, run_id=scheduled__2024-06-27T23:18:00+00:00, run_start_date=2024-06-27 23:19:00.435667+00:00, run_end_date=2024-06-27 23:19:02.258421+00:00, run_duration=1.822754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:18:00+00:00, data_interval_end=2024-06-27 23:19:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:19:02.268886153Z [2024-06-27T23:19:02.268+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:19:00+00:00, run_after=2024-06-27T23:20:00+00:00 2024-06-27T23:19:03.466089725Z [2024-06-27T23:19:03.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:18:00+00:00 exited with status success for try_number 1 2024-06-27T23:19:03.470626398Z [2024-06-27T23:19:03.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:18:00+00:00, map_index=-1, run_start_date=2024-06-27 23:19:01.749466+00:00, run_end_date=2024-06-27 23:19:02.229392+00:00, run_duration=0.479926, state=success, executor_state=success, try_number=1, max_tries=1, job_id=217, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:19:00.541129+00:00, queued_by_job_id=2, pid=3243 2024-06-27T23:19:05.152787009Z [2024-06-27T23:19:05.152+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:19:05.152953117Z [2024-06-27T23:19:05.152+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:18:00+00:00, run_id=scheduled__2024-06-27T23:18:00+00:00, run_start_date=2024-06-27 23:19:00.438130+00:00, run_end_date=2024-06-27 23:19:05.152702+00:00, run_duration=4.714572, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:18:00+00:00, data_interval_end=2024-06-27 23:19:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:19:05.163465014Z [2024-06-27T23:19:05.163+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:19:00+00:00, run_after=2024-06-27T23:20:00+00:00 2024-06-27T23:19:05.214902230Z [2024-06-27T23:19:05.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:18:00+00:00 exited with status success for try_number 1 2024-06-27T23:19:05.219540451Z [2024-06-27T23:19:05.219+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:18:00+00:00, map_index=-1, run_start_date=2024-06-27 23:19:03.133696+00:00, run_end_date=2024-06-27 23:19:04.602918+00:00, run_duration=1.469222, state=success, executor_state=success, try_number=1, max_tries=1, job_id=218, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:19:00.541129+00:00, queued_by_job_id=2, pid=3261 2024-06-27T23:19:06.271719990Z [2024-06-27T23:19:06.271+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:19:06.271896753Z [2024-06-27T23:19:06.271+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:18:00+00:00, run_id=scheduled__2024-06-27T23:18:00+00:00, run_start_date=2024-06-27 23:19:00.440021+00:00, run_end_date=2024-06-27 23:19:06.271612+00:00, run_duration=5.831591, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:18:00+00:00, data_interval_end=2024-06-27 23:19:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:19:06.280334838Z [2024-06-27T23:19:06.279+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:19:00+00:00, run_after=2024-06-27T23:20:00+00:00 2024-06-27T23:19:06.322746574Z [2024-06-27T23:19:06.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:18:00+00:00 exited with status success for try_number 1 2024-06-27T23:19:06.328851313Z [2024-06-27T23:19:06.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:18:00+00:00, map_index=-1, run_start_date=2024-06-27 23:19:03.259158+00:00, run_end_date=2024-06-27 23:19:05.748826+00:00, run_duration=2.489668, state=success, executor_state=success, try_number=1, max_tries=1, job_id=219, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:19:00.541129+00:00, queued_by_job_id=2, pid=3262 2024-06-27T23:20:00.976848329Z [2024-06-27T23:20:00.975+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:20:00.989503586Z [2024-06-27T23:20:00.989+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:20:01.017125428Z [2024-06-27T23:20:01.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:20:00+00:00, run_after=2024-06-27T23:25:00+00:00 2024-06-27T23:20:01.029564649Z [2024-06-27T23:20:01.029+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:20:00+00:00, run_after=2024-06-27T23:21:00+00:00 2024-06-27T23:20:01.046264206Z [2024-06-27T23:20:01.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:20:00+00:00, run_after=2024-06-27T23:21:00+00:00 2024-06-27T23:20:01.189539125Z [2024-06-27T23:20:01.188+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T23:20:01.189555522Z 2024-06-27T23:20:01.189558838Z 2024-06-27T23:20:01.189562676Z 2024-06-27T23:20:01.189565772Z 2024-06-27T23:20:01.189568867Z 2024-06-27T23:20:01.189745021Z [2024-06-27T23:20:01.189+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:20:01.189912703Z [2024-06-27T23:20:01.189+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:20:01.190593863Z [2024-06-27T23:20:01.189+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:20:01.190844737Z [2024-06-27T23:20:01.190+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:20:01.190995535Z [2024-06-27T23:20:01.190+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:20:01.192377807Z [2024-06-27T23:20:01.191+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:20:01.192388340Z 2024-06-27T23:20:01.192392348Z 2024-06-27T23:20:01.192395748Z 2024-06-27T23:20:01.192398877Z 2024-06-27T23:20:01.192402200Z 2024-06-27T23:20:01.200946339Z [2024-06-27T23:20:01.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T23:20:01.201066249Z [2024-06-27T23:20:01.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:20:01.201283780Z [2024-06-27T23:20:01.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:20:01.201398324Z [2024-06-27T23:20:01.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:20:01.201610187Z [2024-06-27T23:20:01.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:20:01.201724080Z [2024-06-27T23:20:01.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:20:01.201883049Z [2024-06-27T23:20:01.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:20:01.201978530Z [2024-06-27T23:20:01.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:20:01.202155201Z [2024-06-27T23:20:01.202+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:20:01.202255649Z [2024-06-27T23:20:01.202+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:20:01.754140426Z [2024-06-27T23:20:01.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:15:00+00:00 exited with status queued for try_number 1 2024-06-27T23:20:01.754256431Z [2024-06-27T23:20:01.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:18:00+00:00 exited with status queued for try_number 1 2024-06-27T23:20:01.754312145Z [2024-06-27T23:20:01.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:19:00+00:00 exited with status queued for try_number 1 2024-06-27T23:20:01.754387410Z [2024-06-27T23:20:01.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:19:00+00:00 exited with status queued for try_number 1 2024-06-27T23:20:01.754438200Z [2024-06-27T23:20:01.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:19:00+00:00 exited with status queued for try_number 1 2024-06-27T23:20:01.771951608Z [2024-06-27T23:20:01.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6393d8d-3076-47e0-889a-d25d7c8be670 2024-06-27T23:20:01.771978786Z [2024-06-27T23:20:01.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25964a3e-8c2b-409a-bc31-635d024708dd 2024-06-27T23:20:01.772140400Z [2024-06-27T23:20:01.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77807ba6-a555-4ca1-8d2b-06ae42a7926a 2024-06-27T23:20:01.772255834Z [2024-06-27T23:20:01.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22a8583a-c6ee-4748-8d29-cd44581dd5a4 2024-06-27T23:20:01.772348883Z [2024-06-27T23:20:01.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91c5d31a-979f-46b3-a168-88b6a89fd361 2024-06-27T23:20:04.222619972Z [2024-06-27T23:20:04.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:20:04.227382508Z [2024-06-27T23:20:04.227+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:18:00+00:00, run_id=scheduled__2024-06-27T23:18:00+00:00, run_start_date=2024-06-27 23:20:01.065261+00:00, run_end_date=2024-06-27 23:20:04.222531+00:00, run_duration=3.15727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:18:00+00:00, data_interval_end=2024-06-27 23:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:20:04.242021283Z [2024-06-27T23:20:04.241+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:20:00+00:00, run_after=2024-06-27T23:22:00+00:00 2024-06-27T23:20:04.280345674Z [2024-06-27T23:20:04.279+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:20:04.285086559Z [2024-06-27T23:20:04.284+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:19:00+00:00, run_id=scheduled__2024-06-27T23:19:00+00:00, run_start_date=2024-06-27 23:20:01.066963+00:00, run_end_date=2024-06-27 23:20:04.284582+00:00, run_duration=3.217619, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:19:00+00:00, data_interval_end=2024-06-27 23:20:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:20:04.327900611Z [2024-06-27T23:20:04.327+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:20:00+00:00, run_after=2024-06-27T23:21:00+00:00 2024-06-27T23:20:04.558655791Z [2024-06-27T23:20:04.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:18:00+00:00 exited with status success for try_number 1 2024-06-27T23:20:04.558917807Z [2024-06-27T23:20:04.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:19:00+00:00 exited with status success for try_number 1 2024-06-27T23:20:04.565217319Z [2024-06-27T23:20:04.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:19:00+00:00, map_index=-1, run_start_date=2024-06-27 23:20:02.481645+00:00, run_end_date=2024-06-27 23:20:03.061571+00:00, run_duration=0.579926, state=success, executor_state=success, try_number=1, max_tries=1, job_id=220, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:20:01.194867+00:00, queued_by_job_id=2, pid=3296 2024-06-27T23:20:04.565607307Z [2024-06-27T23:20:04.565+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:18:00+00:00, map_index=-1, run_start_date=2024-06-27 23:20:02.797906+00:00, run_end_date=2024-06-27 23:20:03.314522+00:00, run_duration=0.516616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=221, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:20:01.194867+00:00, queued_by_job_id=2, pid=3297 2024-06-27T23:20:06.244334004Z [2024-06-27T23:20:06.243+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:20:06.251244377Z [2024-06-27T23:20:06.250+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:19:00+00:00, run_id=scheduled__2024-06-27T23:19:00+00:00, run_start_date=2024-06-27 23:20:01.068537+00:00, run_end_date=2024-06-27 23:20:06.244229+00:00, run_duration=5.175692, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:19:00+00:00, data_interval_end=2024-06-27 23:20:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:20:06.260273569Z [2024-06-27T23:20:06.259+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:20:00+00:00, run_after=2024-06-27T23:21:00+00:00 2024-06-27T23:20:06.296601574Z [2024-06-27T23:20:06.296+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:20:06.296622008Z 2024-06-27T23:20:06.297220989Z [2024-06-27T23:20:06.296+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:20:06.297852242Z [2024-06-27T23:20:06.297+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:20:06.297863472Z 2024-06-27T23:20:06.300197692Z [2024-06-27T23:20:06.299+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-27T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T23:20:06.300437376Z [2024-06-27T23:20:06.300+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-27T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:20:06.377739089Z [2024-06-27T23:20:06.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:15:00+00:00 exited with status queued for try_number 1 2024-06-27T23:20:06.377767761Z [2024-06-27T23:20:06.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:15:00+00:00 exited with status success for try_number 1 2024-06-27T23:20:06.377799838Z [2024-06-27T23:20:06.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:19:00+00:00 exited with status success for try_number 1 2024-06-27T23:20:06.396442976Z [2024-06-27T23:20:06.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:19:00+00:00, map_index=-1, run_start_date=2024-06-27 23:20:04.019731+00:00, run_end_date=2024-06-27 23:20:05.977463+00:00, run_duration=1.957732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=222, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:20:01.194867+00:00, queued_by_job_id=2, pid=3326 2024-06-27T23:20:06.396458734Z [2024-06-27T23:20:06.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e779940-014d-49f3-ae20-16ca6832c364 2024-06-27T23:20:06.396462481Z [2024-06-27T23:20:06.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T23:15:00+00:00, map_index=-1, run_start_date=2024-06-27 23:20:04.185874+00:00, run_end_date=2024-06-27 23:20:05.191909+00:00, run_duration=1.006035, state=success, executor_state=success, try_number=1, max_tries=1, job_id=223, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:20:01.194867+00:00, queued_by_job_id=2, pid=3327 2024-06-27T23:20:07.678546529Z [2024-06-27T23:20:07.678+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:20:07.679026450Z [2024-06-27T23:20:07.678+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:19:00+00:00, run_id=scheduled__2024-06-27T23:19:00+00:00, run_start_date=2024-06-27 23:20:01.070044+00:00, run_end_date=2024-06-27 23:20:07.678680+00:00, run_duration=6.608636, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:19:00+00:00, data_interval_end=2024-06-27 23:20:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:20:07.734660587Z [2024-06-27T23:20:07.718+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:20:00+00:00, run_after=2024-06-27T23:21:00+00:00 2024-06-27T23:20:07.860614268Z [2024-06-27T23:20:07.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:19:00+00:00 exited with status success for try_number 1 2024-06-27T23:20:07.878882031Z [2024-06-27T23:20:07.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:19:00+00:00, map_index=-1, run_start_date=2024-06-27 23:20:04.452635+00:00, run_end_date=2024-06-27 23:20:06.603855+00:00, run_duration=2.15122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=224, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:20:01.194867+00:00, queued_by_job_id=2, pid=3328 2024-06-27T23:20:09.845054710Z [2024-06-27T23:20:09.844+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:20:09.845083185Z 2024-06-27T23:20:09.845217644Z [2024-06-27T23:20:09.844+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:20:09.845854885Z [2024-06-27T23:20:09.845+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:20:09.845868558Z 2024-06-27T23:20:09.848369983Z [2024-06-27T23:20:09.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-27T23:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T23:20:09.848614811Z [2024-06-27T23:20:09.848+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-27T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T23:20:09.923738269Z [2024-06-27T23:20:09.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:15:00+00:00 exited with status queued for try_number 1 2024-06-27T23:20:09.923841855Z [2024-06-27T23:20:09.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:15:00+00:00 exited with status success for try_number 1 2024-06-27T23:20:09.933503855Z [2024-06-27T23:20:09.933+0000] {scheduler_job.py:635} INFO - Setting external_id for to 726db41d-38db-4a45-88ba-cfb7554f7a5d 2024-06-27T23:20:09.933741239Z [2024-06-27T23:20:09.933+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-27T23:15:00+00:00, map_index=-1, run_start_date=2024-06-27 23:20:08.455810+00:00, run_end_date=2024-06-27 23:20:08.774055+00:00, run_duration=0.318245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=225, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:20:06.298225+00:00, queued_by_job_id=2, pid=3351 2024-06-27T23:20:12.490717026Z [2024-06-27T23:20:12.489+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:20:12.490735048Z 2024-06-27T23:20:12.490741240Z [2024-06-27T23:20:12.490+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:20:12.490746330Z [2024-06-27T23:20:12.490+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:20:12.490749484Z 2024-06-27T23:20:12.493657815Z [2024-06-27T23:20:12.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-27T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:20:12.493679138Z [2024-06-27T23:20:12.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-27T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:20:12.559953397Z [2024-06-27T23:20:12.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:15:00+00:00 exited with status queued for try_number 1 2024-06-27T23:20:12.560335660Z [2024-06-27T23:20:12.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:15:00+00:00 exited with status success for try_number 1 2024-06-27T23:20:12.565698281Z [2024-06-27T23:20:12.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a2d9810-cabc-4007-b7e3-a77e21945ef6 2024-06-27T23:20:12.566230220Z [2024-06-27T23:20:12.565+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-27T23:15:00+00:00, map_index=0, run_start_date=2024-06-27 23:20:11.473458+00:00, run_end_date=2024-06-27 23:20:11.833087+00:00, run_duration=0.359629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=226, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:20:09.846629+00:00, queued_by_job_id=2, pid=3359 2024-06-27T23:20:15.331224064Z [2024-06-27T23:20:15.330+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:20:15.331831885Z [2024-06-27T23:20:15.331+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:15:00+00:00, run_id=scheduled__2024-06-27T23:15:00+00:00, run_start_date=2024-06-27 23:20:01.063356+00:00, run_end_date=2024-06-27 23:20:15.331433+00:00, run_duration=14.268077, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:15:00+00:00, data_interval_end=2024-06-27 23:20:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-27T23:20:15.340159506Z [2024-06-27T23:20:15.339+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:20:00+00:00, run_after=2024-06-27T23:25:00+00:00 2024-06-27T23:20:15.372834390Z [2024-06-27T23:20:15.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:15:00+00:00 exited with status success for try_number 1 2024-06-27T23:20:15.379474341Z [2024-06-27T23:20:15.379+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-27T23:15:00+00:00, map_index=-1, run_start_date=2024-06-27 23:20:14.330637+00:00, run_end_date=2024-06-27 23:20:14.692285+00:00, run_duration=0.361648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=227, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:20:12.491177+00:00, queued_by_job_id=2, pid=3367 2024-06-27T23:21:00.255302119Z [2024-06-27T23:21:00.254+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:21:00+00:00, run_after=2024-06-27T23:22:00+00:00 2024-06-27T23:21:00.261775229Z [2024-06-27T23:21:00.261+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:21:00.274075087Z [2024-06-27T23:21:00.273+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:21:00+00:00, run_after=2024-06-27T23:22:00+00:00 2024-06-27T23:21:00.330614198Z [2024-06-27T23:21:00.330+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:21:00.330639989Z 2024-06-27T23:21:00.330643542Z 2024-06-27T23:21:00.330646623Z 2024-06-27T23:21:00.330801205Z [2024-06-27T23:21:00.330+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:21:00.330990327Z [2024-06-27T23:21:00.330+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:21:00.331131182Z [2024-06-27T23:21:00.330+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:21:00.331757790Z [2024-06-27T23:21:00.331+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:21:00.331769718Z 2024-06-27T23:21:00.331773183Z 2024-06-27T23:21:00.331781629Z 2024-06-27T23:21:00.334950617Z [2024-06-27T23:21:00.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:21:00.335124734Z [2024-06-27T23:21:00.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:21:00.335555252Z [2024-06-27T23:21:00.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:21:00.335702804Z [2024-06-27T23:21:00.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:21:00.335977011Z [2024-06-27T23:21:00.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:21:00.336161990Z [2024-06-27T23:21:00.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:21:01.155280211Z [2024-06-27T23:21:01.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:20:00+00:00 exited with status queued for try_number 1 2024-06-27T23:21:01.155388410Z [2024-06-27T23:21:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:20:00+00:00 exited with status queued for try_number 1 2024-06-27T23:21:01.155470936Z [2024-06-27T23:21:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:20:00+00:00 exited with status queued for try_number 1 2024-06-27T23:21:01.174535170Z [2024-06-27T23:21:01.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7974795c-302e-455a-a2ea-2c56962c7dc6 2024-06-27T23:21:01.174633689Z [2024-06-27T23:21:01.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdd16d01-e2af-4c91-a514-d57fb0d0aa09 2024-06-27T23:21:01.174782965Z [2024-06-27T23:21:01.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca63c611-2e83-4859-a020-fdaa217cacf1 2024-06-27T23:21:02.387181667Z [2024-06-27T23:21:02.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:21:02.387383611Z [2024-06-27T23:21:02.387+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:20:00+00:00, run_id=scheduled__2024-06-27T23:20:00+00:00, run_start_date=2024-06-27 23:21:00.283669+00:00, run_end_date=2024-06-27 23:21:02.387109+00:00, run_duration=2.10344, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:20:00+00:00, data_interval_end=2024-06-27 23:21:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:21:02.406612903Z [2024-06-27T23:21:02.406+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:21:00+00:00, run_after=2024-06-27T23:22:00+00:00 2024-06-27T23:21:02.492986732Z [2024-06-27T23:21:02.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:20:00+00:00 exited with status success for try_number 1 2024-06-27T23:21:02.498105876Z [2024-06-27T23:21:02.497+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:20:00+00:00, map_index=-1, run_start_date=2024-06-27 23:21:01.577142+00:00, run_end_date=2024-06-27 23:21:02.052470+00:00, run_duration=0.475328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=228, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:21:00.332547+00:00, queued_by_job_id=2, pid=3389 2024-06-27T23:21:04.646334733Z [2024-06-27T23:21:04.645+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:21:04.646643121Z [2024-06-27T23:21:04.646+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:20:00+00:00, run_id=scheduled__2024-06-27T23:20:00+00:00, run_start_date=2024-06-27 23:21:00.284836+00:00, run_end_date=2024-06-27 23:21:04.646164+00:00, run_duration=4.361328, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:20:00+00:00, data_interval_end=2024-06-27 23:21:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:21:04.655150005Z [2024-06-27T23:21:04.654+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:21:00+00:00, run_after=2024-06-27T23:22:00+00:00 2024-06-27T23:21:04.694248353Z [2024-06-27T23:21:04.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:20:00+00:00 exited with status success for try_number 1 2024-06-27T23:21:04.709270964Z [2024-06-27T23:21:04.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:20:00+00:00, map_index=-1, run_start_date=2024-06-27 23:21:02.614993+00:00, run_end_date=2024-06-27 23:21:03.922966+00:00, run_duration=1.307973, state=success, executor_state=success, try_number=1, max_tries=1, job_id=229, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:21:00.332547+00:00, queued_by_job_id=2, pid=3407 2024-06-27T23:21:05.836778986Z [2024-06-27T23:21:05.836+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:21:05.839630460Z [2024-06-27T23:21:05.839+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:20:00+00:00, run_id=scheduled__2024-06-27T23:20:00+00:00, run_start_date=2024-06-27 23:21:00.285820+00:00, run_end_date=2024-06-27 23:21:05.839243+00:00, run_duration=5.553423, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:20:00+00:00, data_interval_end=2024-06-27 23:21:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:21:05.866828504Z [2024-06-27T23:21:05.858+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:21:00+00:00, run_after=2024-06-27T23:22:00+00:00 2024-06-27T23:21:05.918879317Z [2024-06-27T23:21:05.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:20:00+00:00 exited with status success for try_number 1 2024-06-27T23:21:05.927737366Z [2024-06-27T23:21:05.927+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:20:00+00:00, map_index=-1, run_start_date=2024-06-27 23:21:02.755848+00:00, run_end_date=2024-06-27 23:21:04.651360+00:00, run_duration=1.895512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=230, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:21:00.332547+00:00, queued_by_job_id=2, pid=3408 2024-06-27T23:21:44.595934186Z [2024-06-27T23:21:44.594+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T23:22:00.141810032Z [2024-06-27T23:22:00.141+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:22:00.151987586Z [2024-06-27T23:22:00.151+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:22:00.167704459Z [2024-06-27T23:22:00.167+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:22:00+00:00, run_after=2024-06-27T23:23:00+00:00 2024-06-27T23:22:00.188574448Z [2024-06-27T23:22:00.188+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:22:00+00:00, run_after=2024-06-27T23:23:00+00:00 2024-06-27T23:22:00.273323117Z [2024-06-27T23:22:00.272+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:22:00.273336397Z 2024-06-27T23:22:00.273340597Z 2024-06-27T23:22:00.273359375Z 2024-06-27T23:22:00.273362709Z 2024-06-27T23:22:00.273372879Z [2024-06-27T23:22:00.273+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:22:00.273511501Z [2024-06-27T23:22:00.273+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:22:00.273592514Z [2024-06-27T23:22:00.273+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:22:00.273695122Z [2024-06-27T23:22:00.273+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:22:00.274362874Z [2024-06-27T23:22:00.274+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:22:00.274368151Z 2024-06-27T23:22:00.274371404Z 2024-06-27T23:22:00.274374424Z 2024-06-27T23:22:00.274377378Z 2024-06-27T23:22:00.279691148Z [2024-06-27T23:22:00.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:22:00.279807425Z [2024-06-27T23:22:00.279+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:22:00.280058850Z [2024-06-27T23:22:00.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:22:00.280194416Z [2024-06-27T23:22:00.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:22:00.280484715Z [2024-06-27T23:22:00.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:22:00.280653423Z [2024-06-27T23:22:00.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:22:00.280812319Z [2024-06-27T23:22:00.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:22:00.280943567Z [2024-06-27T23:22:00.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:22:00.715719536Z [2024-06-27T23:22:00.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:20:00+00:00 exited with status queued for try_number 1 2024-06-27T23:22:00.715957152Z [2024-06-27T23:22:00.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:21:00+00:00 exited with status queued for try_number 1 2024-06-27T23:22:00.717862705Z [2024-06-27T23:22:00.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:21:00+00:00 exited with status queued for try_number 1 2024-06-27T23:22:00.718064369Z [2024-06-27T23:22:00.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:21:00+00:00 exited with status queued for try_number 1 2024-06-27T23:22:00.731860979Z [2024-06-27T23:22:00.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8e1e2be-42ee-47f5-b23a-9f207451372e 2024-06-27T23:22:00.732095580Z [2024-06-27T23:22:00.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75355618-36fd-4344-ba7a-6e0d305b3ada 2024-06-27T23:22:00.732319963Z [2024-06-27T23:22:00.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c75d10a-b98b-4c61-993a-a29e75587d19 2024-06-27T23:22:00.732499885Z [2024-06-27T23:22:00.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ee9d81f-d8b1-4b70-845c-1accc9047b6e 2024-06-27T23:22:02.151545724Z [2024-06-27T23:22:02.150+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:22:02.151730198Z [2024-06-27T23:22:02.151+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:20:00+00:00, run_id=scheduled__2024-06-27T23:20:00+00:00, run_start_date=2024-06-27 23:22:00.202219+00:00, run_end_date=2024-06-27 23:22:02.151411+00:00, run_duration=1.949192, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:20:00+00:00, data_interval_end=2024-06-27 23:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:22:02.159725410Z [2024-06-27T23:22:02.159+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:22:00+00:00, run_after=2024-06-27T23:24:00+00:00 2024-06-27T23:22:02.166870041Z [2024-06-27T23:22:02.166+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:22:02.167358698Z [2024-06-27T23:22:02.167+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:21:00+00:00, run_id=scheduled__2024-06-27T23:21:00+00:00, run_start_date=2024-06-27 23:22:00.203495+00:00, run_end_date=2024-06-27 23:22:02.166712+00:00, run_duration=1.963217, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:21:00+00:00, data_interval_end=2024-06-27 23:22:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:22:02.178910184Z [2024-06-27T23:22:02.178+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:22:00+00:00, run_after=2024-06-27T23:23:00+00:00 2024-06-27T23:22:02.241258586Z [2024-06-27T23:22:02.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:20:00+00:00 exited with status success for try_number 1 2024-06-27T23:22:02.241283538Z [2024-06-27T23:22:02.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:21:00+00:00 exited with status success for try_number 1 2024-06-27T23:22:02.248595512Z [2024-06-27T23:22:02.248+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:20:00+00:00, map_index=-1, run_start_date=2024-06-27 23:22:01.269480+00:00, run_end_date=2024-06-27 23:22:01.689559+00:00, run_duration=0.420079, state=success, executor_state=success, try_number=1, max_tries=1, job_id=231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:22:00.275491+00:00, queued_by_job_id=2, pid=3441 2024-06-27T23:22:02.248707874Z [2024-06-27T23:22:02.248+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:21:00+00:00, map_index=-1, run_start_date=2024-06-27 23:22:01.377553+00:00, run_end_date=2024-06-27 23:22:01.933022+00:00, run_duration=0.555469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=232, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:22:00.275491+00:00, queued_by_job_id=2, pid=3442 2024-06-27T23:22:04.428859377Z [2024-06-27T23:22:04.428+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:22:04.429131485Z [2024-06-27T23:22:04.428+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:21:00+00:00, run_id=scheduled__2024-06-27T23:21:00+00:00, run_start_date=2024-06-27 23:22:00.204565+00:00, run_end_date=2024-06-27 23:22:04.428785+00:00, run_duration=4.22422, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:21:00+00:00, data_interval_end=2024-06-27 23:22:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:22:04.454760745Z [2024-06-27T23:22:04.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:22:00+00:00, run_after=2024-06-27T23:23:00+00:00 2024-06-27T23:22:04.533124901Z [2024-06-27T23:22:04.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:21:00+00:00 exited with status success for try_number 1 2024-06-27T23:22:04.563110502Z [2024-06-27T23:22:04.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:21:00+00:00, map_index=-1, run_start_date=2024-06-27 23:22:02.782117+00:00, run_end_date=2024-06-27 23:22:04.210261+00:00, run_duration=1.428144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:22:00.275491+00:00, queued_by_job_id=2, pid=3466 2024-06-27T23:22:05.618925966Z [2024-06-27T23:22:05.618+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:22:05.619419189Z [2024-06-27T23:22:05.619+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:21:00+00:00, run_id=scheduled__2024-06-27T23:21:00+00:00, run_start_date=2024-06-27 23:22:00.205565+00:00, run_end_date=2024-06-27 23:22:05.618814+00:00, run_duration=5.413249, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:21:00+00:00, data_interval_end=2024-06-27 23:22:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:22:05.628558310Z [2024-06-27T23:22:05.628+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:22:00+00:00, run_after=2024-06-27T23:23:00+00:00 2024-06-27T23:22:05.658748167Z [2024-06-27T23:22:05.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:21:00+00:00 exited with status success for try_number 1 2024-06-27T23:22:05.664074759Z [2024-06-27T23:22:05.663+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:21:00+00:00, map_index=-1, run_start_date=2024-06-27 23:22:02.710541+00:00, run_end_date=2024-06-27 23:22:04.489153+00:00, run_duration=1.778612, state=success, executor_state=success, try_number=1, max_tries=1, job_id=233, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:22:00.275491+00:00, queued_by_job_id=2, pid=3465 2024-06-27T23:23:00.150805946Z [2024-06-27T23:23:00.150+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:23:00+00:00, run_after=2024-06-27T23:24:00+00:00 2024-06-27T23:23:00.164407176Z [2024-06-27T23:23:00.163+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:23:00+00:00, run_after=2024-06-27T23:24:00+00:00 2024-06-27T23:23:00.171819500Z [2024-06-27T23:23:00.171+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:23:00.233119296Z [2024-06-27T23:23:00.232+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:23:00.233138219Z 2024-06-27T23:23:00.233142047Z 2024-06-27T23:23:00.233159416Z 2024-06-27T23:23:00.233740255Z [2024-06-27T23:23:00.233+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:23:00.234501274Z [2024-06-27T23:23:00.233+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:23:00.234977222Z [2024-06-27T23:23:00.234+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:23:00.235801348Z [2024-06-27T23:23:00.235+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:23:00.235813717Z 2024-06-27T23:23:00.235818224Z 2024-06-27T23:23:00.235822527Z 2024-06-27T23:23:00.240837765Z [2024-06-27T23:23:00.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:23:00.241133420Z [2024-06-27T23:23:00.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:23:00.241636207Z [2024-06-27T23:23:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:23:00.241805740Z [2024-06-27T23:23:00.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:23:00.242103966Z [2024-06-27T23:23:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:23:00.242235689Z [2024-06-27T23:23:00.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:23:00.565851297Z [2024-06-27T23:23:00.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:22:00+00:00 exited with status queued for try_number 1 2024-06-27T23:23:00.566182250Z [2024-06-27T23:23:00.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:22:00+00:00 exited with status queued for try_number 1 2024-06-27T23:23:00.566376823Z [2024-06-27T23:23:00.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:22:00+00:00 exited with status queued for try_number 1 2024-06-27T23:23:00.586122231Z [2024-06-27T23:23:00.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to 125bc615-5235-486c-8cab-e4e3360bb67d 2024-06-27T23:23:00.587677486Z [2024-06-27T23:23:00.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f5ccc8b-dca7-4324-b35e-6daedf2f0389 2024-06-27T23:23:00.589262207Z [2024-06-27T23:23:00.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5879b27-a6fb-4239-8f87-f94cfc29bd98 2024-06-27T23:23:02.070420704Z [2024-06-27T23:23:02.069+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:23:02.070991295Z [2024-06-27T23:23:02.070+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:22:00+00:00, run_id=scheduled__2024-06-27T23:22:00+00:00, run_start_date=2024-06-27 23:23:00.181263+00:00, run_end_date=2024-06-27 23:23:02.070341+00:00, run_duration=1.889078, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:22:00+00:00, data_interval_end=2024-06-27 23:23:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:23:02.082755144Z [2024-06-27T23:23:02.082+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:23:00+00:00, run_after=2024-06-27T23:24:00+00:00 2024-06-27T23:23:02.149833734Z [2024-06-27T23:23:02.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:22:00+00:00 exited with status success for try_number 1 2024-06-27T23:23:02.156612137Z [2024-06-27T23:23:02.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:22:00+00:00, map_index=-1, run_start_date=2024-06-27 23:23:01.408613+00:00, run_end_date=2024-06-27 23:23:01.893758+00:00, run_duration=0.485145, state=success, executor_state=success, try_number=1, max_tries=1, job_id=235, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:23:00.237468+00:00, queued_by_job_id=2, pid=3498 2024-06-27T23:23:04.185600742Z [2024-06-27T23:23:04.185+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:23:04.185752543Z [2024-06-27T23:23:04.185+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:22:00+00:00, run_id=scheduled__2024-06-27T23:22:00+00:00, run_start_date=2024-06-27 23:23:00.182587+00:00, run_end_date=2024-06-27 23:23:04.185505+00:00, run_duration=4.002918, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:22:00+00:00, data_interval_end=2024-06-27 23:23:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:23:04.197611725Z [2024-06-27T23:23:04.197+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:23:00+00:00, run_after=2024-06-27T23:24:00+00:00 2024-06-27T23:23:04.246902910Z [2024-06-27T23:23:04.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:22:00+00:00 exited with status success for try_number 1 2024-06-27T23:23:04.267720193Z [2024-06-27T23:23:04.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:22:00+00:00, map_index=-1, run_start_date=2024-06-27 23:23:02.593368+00:00, run_end_date=2024-06-27 23:23:03.945550+00:00, run_duration=1.352182, state=success, executor_state=success, try_number=1, max_tries=1, job_id=237, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:23:00.237468+00:00, queued_by_job_id=2, pid=3517 2024-06-27T23:23:05.349011520Z [2024-06-27T23:23:05.348+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:23:05.349475459Z [2024-06-27T23:23:05.349+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:22:00+00:00, run_id=scheduled__2024-06-27T23:22:00+00:00, run_start_date=2024-06-27 23:23:00.183591+00:00, run_end_date=2024-06-27 23:23:05.348942+00:00, run_duration=5.165351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:22:00+00:00, data_interval_end=2024-06-27 23:23:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:23:05.367428502Z [2024-06-27T23:23:05.367+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:23:00+00:00, run_after=2024-06-27T23:24:00+00:00 2024-06-27T23:23:05.404529473Z [2024-06-27T23:23:05.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:22:00+00:00 exited with status success for try_number 1 2024-06-27T23:23:05.410890095Z [2024-06-27T23:23:05.410+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:22:00+00:00, map_index=-1, run_start_date=2024-06-27 23:23:02.454978+00:00, run_end_date=2024-06-27 23:23:04.473607+00:00, run_duration=2.018629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=236, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:23:00.237468+00:00, queued_by_job_id=2, pid=3516 2024-06-27T23:24:01.002406823Z [2024-06-27T23:24:01.001+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:24:01.022513800Z [2024-06-27T23:24:01.022+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:24:00+00:00, run_after=2024-06-27T23:25:00+00:00 2024-06-27T23:24:01.037978455Z [2024-06-27T23:24:01.037+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:24:01.054505004Z [2024-06-27T23:24:01.053+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:24:00+00:00, run_after=2024-06-27T23:25:00+00:00 2024-06-27T23:24:01.165142321Z [2024-06-27T23:24:01.164+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:24:01.165167143Z 2024-06-27T23:24:01.165176918Z 2024-06-27T23:24:01.165185410Z 2024-06-27T23:24:01.165193991Z 2024-06-27T23:24:01.165233436Z [2024-06-27T23:24:01.165+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:24:01.165463149Z [2024-06-27T23:24:01.165+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:24:01.165595685Z [2024-06-27T23:24:01.165+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:24:01.165760409Z [2024-06-27T23:24:01.165+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:24:01.166463705Z [2024-06-27T23:24:01.166+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:24:01.166478182Z 2024-06-27T23:24:01.166484342Z 2024-06-27T23:24:01.166489685Z 2024-06-27T23:24:01.166495108Z 2024-06-27T23:24:01.171066593Z [2024-06-27T23:24:01.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:24:01.171205738Z [2024-06-27T23:24:01.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:24:01.171471055Z [2024-06-27T23:24:01.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:24:01.171561693Z [2024-06-27T23:24:01.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:24:01.171819097Z [2024-06-27T23:24:01.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:24:01.171940962Z [2024-06-27T23:24:01.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:24:01.172222344Z [2024-06-27T23:24:01.172+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:24:01.172278307Z [2024-06-27T23:24:01.172+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:24:01.618885311Z [2024-06-27T23:24:01.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:22:00+00:00 exited with status queued for try_number 1 2024-06-27T23:24:01.621873381Z [2024-06-27T23:24:01.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:23:00+00:00 exited with status queued for try_number 1 2024-06-27T23:24:01.622162823Z [2024-06-27T23:24:01.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:23:00+00:00 exited with status queued for try_number 1 2024-06-27T23:24:01.622745929Z [2024-06-27T23:24:01.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:23:00+00:00 exited with status queued for try_number 1 2024-06-27T23:24:01.633904895Z [2024-06-27T23:24:01.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to c67c23cc-9cd1-4662-9c30-214a87ffe069 2024-06-27T23:24:01.634640075Z [2024-06-27T23:24:01.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa7c843a-e229-4f73-ad31-d472e7d741ed 2024-06-27T23:24:01.634934184Z [2024-06-27T23:24:01.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4d4fe46-055b-450a-b89c-2efca90a59e5 2024-06-27T23:24:01.635251551Z [2024-06-27T23:24:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e002733-de9a-4fa1-a73e-a88a412f35a0 2024-06-27T23:24:03.899276898Z [2024-06-27T23:24:03.898+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:24:03.899663454Z [2024-06-27T23:24:03.899+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:22:00+00:00, run_id=scheduled__2024-06-27T23:22:00+00:00, run_start_date=2024-06-27 23:24:01.066197+00:00, run_end_date=2024-06-27 23:24:03.899193+00:00, run_duration=2.832996, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:22:00+00:00, data_interval_end=2024-06-27 23:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:24:03.926118940Z [2024-06-27T23:24:03.925+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:24:00+00:00, run_after=2024-06-27T23:26:00+00:00 2024-06-27T23:24:03.956698445Z [2024-06-27T23:24:03.956+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:24:03.959754795Z [2024-06-27T23:24:03.959+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:23:00+00:00, run_id=scheduled__2024-06-27T23:23:00+00:00, run_start_date=2024-06-27 23:24:01.067729+00:00, run_end_date=2024-06-27 23:24:03.956843+00:00, run_duration=2.889114, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:23:00+00:00, data_interval_end=2024-06-27 23:24:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:24:03.976937716Z [2024-06-27T23:24:03.976+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:24:00+00:00, run_after=2024-06-27T23:25:00+00:00 2024-06-27T23:24:04.170138714Z [2024-06-27T23:24:04.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:22:00+00:00 exited with status success for try_number 1 2024-06-27T23:24:04.170202346Z [2024-06-27T23:24:04.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:23:00+00:00 exited with status success for try_number 1 2024-06-27T23:24:04.248286162Z [2024-06-27T23:24:04.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:23:00+00:00, map_index=-1, run_start_date=2024-06-27 23:24:02.320986+00:00, run_end_date=2024-06-27 23:24:03.066378+00:00, run_duration=0.745392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=238, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:24:01.167493+00:00, queued_by_job_id=2, pid=3550 2024-06-27T23:24:04.262124482Z [2024-06-27T23:24:04.261+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:22:00+00:00, map_index=-1, run_start_date=2024-06-27 23:24:02.709586+00:00, run_end_date=2024-06-27 23:24:03.371498+00:00, run_duration=0.661912, state=success, executor_state=success, try_number=1, max_tries=1, job_id=239, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:24:01.167493+00:00, queued_by_job_id=2, pid=3552 2024-06-27T23:24:06.434795976Z [2024-06-27T23:24:06.433+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:24:06.434824435Z [2024-06-27T23:24:06.434+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:23:00+00:00, run_id=scheduled__2024-06-27T23:23:00+00:00, run_start_date=2024-06-27 23:24:01.069055+00:00, run_end_date=2024-06-27 23:24:06.434238+00:00, run_duration=5.365183, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:23:00+00:00, data_interval_end=2024-06-27 23:24:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:24:06.449968468Z [2024-06-27T23:24:06.448+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:24:00+00:00, run_after=2024-06-27T23:25:00+00:00 2024-06-27T23:24:06.455942079Z [2024-06-27T23:24:06.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:24:06.456252499Z [2024-06-27T23:24:06.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:23:00+00:00, run_id=scheduled__2024-06-27T23:23:00+00:00, run_start_date=2024-06-27 23:24:01.070247+00:00, run_end_date=2024-06-27 23:24:06.455911+00:00, run_duration=5.385664, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:23:00+00:00, data_interval_end=2024-06-27 23:24:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:24:06.467626694Z [2024-06-27T23:24:06.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:24:00+00:00, run_after=2024-06-27T23:25:00+00:00 2024-06-27T23:24:06.499141445Z [2024-06-27T23:24:06.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:23:00+00:00 exited with status success for try_number 1 2024-06-27T23:24:06.499294820Z [2024-06-27T23:24:06.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:23:00+00:00 exited with status success for try_number 1 2024-06-27T23:24:06.506236996Z [2024-06-27T23:24:06.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:23:00+00:00, map_index=-1, run_start_date=2024-06-27 23:24:04.079020+00:00, run_end_date=2024-06-27 23:24:05.740755+00:00, run_duration=1.661735, state=success, executor_state=success, try_number=1, max_tries=1, job_id=241, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:24:01.167493+00:00, queued_by_job_id=2, pid=3575 2024-06-27T23:24:06.506379674Z [2024-06-27T23:24:06.506+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:23:00+00:00, map_index=-1, run_start_date=2024-06-27 23:24:03.848527+00:00, run_end_date=2024-06-27 23:24:06.052759+00:00, run_duration=2.204232, state=success, executor_state=success, try_number=1, max_tries=1, job_id=240, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:24:01.167493+00:00, queued_by_job_id=2, pid=3574 2024-06-27T23:25:00.212797435Z [2024-06-27T23:25:00.212+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:25:00+00:00, run_after=2024-06-27T23:26:00+00:00 2024-06-27T23:25:00.224498825Z [2024-06-27T23:25:00.224+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:25:00.239015992Z [2024-06-27T23:25:00.238+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:25:00+00:00, run_after=2024-06-27T23:26:00+00:00 2024-06-27T23:25:00.256005357Z [2024-06-27T23:25:00.255+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:25:00+00:00, run_after=2024-06-27T23:30:00+00:00 2024-06-27T23:25:00.368359972Z [2024-06-27T23:25:00.367+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:25:00.368376504Z 2024-06-27T23:25:00.368382544Z 2024-06-27T23:25:00.368387504Z 2024-06-27T23:25:00.368392468Z 2024-06-27T23:25:00.368516087Z [2024-06-27T23:25:00.368+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:25:00.368652878Z [2024-06-27T23:25:00.368+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:25:00.368792415Z [2024-06-27T23:25:00.368+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:25:00.368940101Z [2024-06-27T23:25:00.368+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:25:00.369493507Z [2024-06-27T23:25:00.369+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:25:00.369502711Z 2024-06-27T23:25:00.369507827Z 2024-06-27T23:25:00.369512672Z 2024-06-27T23:25:00.369517763Z 2024-06-27T23:25:00.373122057Z [2024-06-27T23:25:00.372+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T23:25:00.373195326Z [2024-06-27T23:25:00.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:25:00.373478333Z [2024-06-27T23:25:00.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:25:00.373553294Z [2024-06-27T23:25:00.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:25:00.373831601Z [2024-06-27T23:25:00.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:25:00.373931005Z [2024-06-27T23:25:00.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:25:00.374152285Z [2024-06-27T23:25:00.374+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:25:00.374244500Z [2024-06-27T23:25:00.374+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:25:00.892150959Z [2024-06-27T23:25:00.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:20:00+00:00 exited with status queued for try_number 1 2024-06-27T23:25:00.892383895Z [2024-06-27T23:25:00.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:24:00+00:00 exited with status queued for try_number 1 2024-06-27T23:25:00.892562382Z [2024-06-27T23:25:00.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:24:00+00:00 exited with status queued for try_number 1 2024-06-27T23:25:00.892779421Z [2024-06-27T23:25:00.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:24:00+00:00 exited with status queued for try_number 1 2024-06-27T23:25:00.908751705Z [2024-06-27T23:25:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to a31ac894-4dba-459f-9410-47781bc9ae1e 2024-06-27T23:25:00.908956390Z [2024-06-27T23:25:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9d27686-c64e-45fc-8a73-dda3dbf3df3e 2024-06-27T23:25:00.909113328Z [2024-06-27T23:25:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5b720da-64fc-4e07-9f6f-536a9a6bc721 2024-06-27T23:25:00.909303133Z [2024-06-27T23:25:00.909+0000] {scheduler_job.py:635} INFO - Setting external_id for to 491ca538-a02e-46b4-8d51-4a02ad696f7a 2024-06-27T23:25:03.104397149Z [2024-06-27T23:25:03.102+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:25:03.104689915Z [2024-06-27T23:25:03.104+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:24:00+00:00, run_id=scheduled__2024-06-27T23:24:00+00:00, run_start_date=2024-06-27 23:25:00.271106+00:00, run_end_date=2024-06-27 23:25:03.104311+00:00, run_duration=2.833205, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:24:00+00:00, data_interval_end=2024-06-27 23:25:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:25:03.119132916Z [2024-06-27T23:25:03.118+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:25:00+00:00, run_after=2024-06-27T23:26:00+00:00 2024-06-27T23:25:03.235026567Z [2024-06-27T23:25:03.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:24:00+00:00 exited with status success for try_number 1 2024-06-27T23:25:03.249258487Z [2024-06-27T23:25:03.248+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:24:00+00:00, map_index=-1, run_start_date=2024-06-27 23:25:01.655852+00:00, run_end_date=2024-06-27 23:25:02.285758+00:00, run_duration=0.629906, state=success, executor_state=success, try_number=1, max_tries=1, job_id=242, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:25:00.370255+00:00, queued_by_job_id=2, pid=3608 2024-06-27T23:25:04.340697982Z [2024-06-27T23:25:04.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:25:04.340881463Z [2024-06-27T23:25:04.340+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:24:00+00:00, run_id=scheduled__2024-06-27T23:24:00+00:00, run_start_date=2024-06-27 23:25:00.272162+00:00, run_end_date=2024-06-27 23:25:04.340591+00:00, run_duration=4.068429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:24:00+00:00, data_interval_end=2024-06-27 23:25:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:25:04.368715026Z [2024-06-27T23:25:04.368+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:25:00+00:00, run_after=2024-06-27T23:26:00+00:00 2024-06-27T23:25:04.417583211Z [2024-06-27T23:25:04.417+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:25:04.417603088Z 2024-06-27T23:25:04.417609967Z [2024-06-27T23:25:04.417+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:25:04.418081831Z [2024-06-27T23:25:04.417+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:25:04.418092622Z 2024-06-27T23:25:04.428118362Z [2024-06-27T23:25:04.427+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-27T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T23:25:04.428147592Z [2024-06-27T23:25:04.427+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-27T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:25:04.532017126Z [2024-06-27T23:25:04.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:20:00+00:00 exited with status queued for try_number 1 2024-06-27T23:25:04.532228867Z [2024-06-27T23:25:04.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:20:00+00:00 exited with status success for try_number 1 2024-06-27T23:25:04.532339452Z [2024-06-27T23:25:04.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:24:00+00:00 exited with status success for try_number 1 2024-06-27T23:25:04.545724344Z [2024-06-27T23:25:04.545+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T23:20:00+00:00, map_index=-1, run_start_date=2024-06-27 23:25:03.014453+00:00, run_end_date=2024-06-27 23:25:03.487345+00:00, run_duration=0.472892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=245, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:25:00.370255+00:00, queued_by_job_id=2, pid=3633 2024-06-27T23:25:04.545966131Z [2024-06-27T23:25:04.545+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:24:00+00:00, map_index=-1, run_start_date=2024-06-27 23:25:02.924668+00:00, run_end_date=2024-06-27 23:25:04.239221+00:00, run_duration=1.314553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=243, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:25:00.370255+00:00, queued_by_job_id=2, pid=3632 2024-06-27T23:25:04.546278577Z [2024-06-27T23:25:04.546+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb86a52f-74f2-46ea-859c-174e97fa9e9f 2024-06-27T23:25:05.741846016Z [2024-06-27T23:25:05.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:25:05.742173581Z [2024-06-27T23:25:05.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:24:00+00:00, run_id=scheduled__2024-06-27T23:24:00+00:00, run_start_date=2024-06-27 23:25:00.273190+00:00, run_end_date=2024-06-27 23:25:05.741799+00:00, run_duration=5.468609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:24:00+00:00, data_interval_end=2024-06-27 23:25:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:25:05.752218944Z [2024-06-27T23:25:05.751+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:25:00+00:00, run_after=2024-06-27T23:26:00+00:00 2024-06-27T23:25:05.798111934Z [2024-06-27T23:25:05.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:24:00+00:00 exited with status success for try_number 1 2024-06-27T23:25:05.804088349Z [2024-06-27T23:25:05.803+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:24:00+00:00, map_index=-1, run_start_date=2024-06-27 23:25:03.018376+00:00, run_end_date=2024-06-27 23:25:04.859709+00:00, run_duration=1.841333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:25:00.370255+00:00, queued_by_job_id=2, pid=3634 2024-06-27T23:25:08.278565802Z [2024-06-27T23:25:08.278+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:25:08.278605342Z 2024-06-27T23:25:08.279148129Z [2024-06-27T23:25:08.278+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:25:08.279844392Z [2024-06-27T23:25:08.279+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:25:08.279859425Z 2024-06-27T23:25:08.282881497Z [2024-06-27T23:25:08.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-27T23:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T23:25:08.283102689Z [2024-06-27T23:25:08.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-27T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T23:25:08.389884966Z [2024-06-27T23:25:08.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:20:00+00:00 exited with status queued for try_number 1 2024-06-27T23:25:08.390166751Z [2024-06-27T23:25:08.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:20:00+00:00 exited with status success for try_number 1 2024-06-27T23:25:08.406867168Z [2024-06-27T23:25:08.406+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f19ece1-4ddd-4470-a1b0-69e6ee032e5e 2024-06-27T23:25:08.408076764Z [2024-06-27T23:25:08.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-27T23:20:00+00:00, map_index=-1, run_start_date=2024-06-27 23:25:06.642745+00:00, run_end_date=2024-06-27 23:25:07.039236+00:00, run_duration=0.396491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=246, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:25:04.418349+00:00, queued_by_job_id=2, pid=3657 2024-06-27T23:25:10.686785401Z [2024-06-27T23:25:10.686+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:25:10.686835329Z 2024-06-27T23:25:10.687201254Z [2024-06-27T23:25:10.686+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:25:10.688157135Z [2024-06-27T23:25:10.687+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:25:10.688170644Z 2024-06-27T23:25:10.690948579Z [2024-06-27T23:25:10.690+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-27T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:25:10.691446826Z [2024-06-27T23:25:10.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-27T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:25:10.752700116Z [2024-06-27T23:25:10.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:20:00+00:00 exited with status queued for try_number 1 2024-06-27T23:25:10.752968346Z [2024-06-27T23:25:10.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:20:00+00:00 exited with status success for try_number 1 2024-06-27T23:25:10.759456670Z [2024-06-27T23:25:10.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b256aa4-dfd2-4f0f-956a-94e5862c45e5 2024-06-27T23:25:10.760590080Z [2024-06-27T23:25:10.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-27T23:20:00+00:00, map_index=0, run_start_date=2024-06-27 23:25:10.082460+00:00, run_end_date=2024-06-27 23:25:10.410155+00:00, run_duration=0.327695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=247, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:25:08.280329+00:00, queued_by_job_id=2, pid=3665 2024-06-27T23:25:13.319307861Z [2024-06-27T23:25:13.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:25:13.319336054Z [2024-06-27T23:25:13.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:20:00+00:00, run_id=scheduled__2024-06-27T23:20:00+00:00, run_start_date=2024-06-27 23:25:00.269721+00:00, run_end_date=2024-06-27 23:25:13.317652+00:00, run_duration=13.047931, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:20:00+00:00, data_interval_end=2024-06-27 23:25:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-27T23:25:13.336364555Z [2024-06-27T23:25:13.335+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:25:00+00:00, run_after=2024-06-27T23:30:00+00:00 2024-06-27T23:25:13.373764224Z [2024-06-27T23:25:13.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:20:00+00:00 exited with status success for try_number 1 2024-06-27T23:25:13.381427903Z [2024-06-27T23:25:13.381+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-27T23:20:00+00:00, map_index=-1, run_start_date=2024-06-27 23:25:12.520581+00:00, run_end_date=2024-06-27 23:25:12.951082+00:00, run_duration=0.430501, state=success, executor_state=success, try_number=1, max_tries=1, job_id=248, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:25:10.688739+00:00, queued_by_job_id=2, pid=3673 2024-06-27T23:26:01.093779885Z [2024-06-27T23:26:01.092+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:26:00+00:00, run_after=2024-06-27T23:27:00+00:00 2024-06-27T23:26:01.106239610Z [2024-06-27T23:26:01.105+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:26:01.122546860Z [2024-06-27T23:26:01.121+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:26:01.143021625Z [2024-06-27T23:26:01.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:26:00+00:00, run_after=2024-06-27T23:27:00+00:00 2024-06-27T23:26:01.245948088Z [2024-06-27T23:26:01.245+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:26:01.245964324Z 2024-06-27T23:26:01.245970167Z 2024-06-27T23:26:01.245974824Z 2024-06-27T23:26:01.245979413Z 2024-06-27T23:26:01.246182250Z [2024-06-27T23:26:01.245+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:26:01.246401838Z [2024-06-27T23:26:01.246+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:26:01.246544262Z [2024-06-27T23:26:01.246+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:26:01.246647226Z [2024-06-27T23:26:01.246+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:26:01.247389936Z [2024-06-27T23:26:01.247+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:26:01.247398788Z 2024-06-27T23:26:01.247402290Z 2024-06-27T23:26:01.247405319Z 2024-06-27T23:26:01.247421342Z 2024-06-27T23:26:01.251357366Z [2024-06-27T23:26:01.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:26:01.251503246Z [2024-06-27T23:26:01.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:26:01.251734523Z [2024-06-27T23:26:01.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:26:01.251966262Z [2024-06-27T23:26:01.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:26:01.252202945Z [2024-06-27T23:26:01.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:26:01.252293272Z [2024-06-27T23:26:01.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:26:01.252483401Z [2024-06-27T23:26:01.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:26:01.252778827Z [2024-06-27T23:26:01.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:26:01.676140686Z [2024-06-27T23:26:01.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:24:00+00:00 exited with status queued for try_number 1 2024-06-27T23:26:01.677584217Z [2024-06-27T23:26:01.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:25:00+00:00 exited with status queued for try_number 1 2024-06-27T23:26:01.677765363Z [2024-06-27T23:26:01.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:25:00+00:00 exited with status queued for try_number 1 2024-06-27T23:26:01.677910018Z [2024-06-27T23:26:01.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:25:00+00:00 exited with status queued for try_number 1 2024-06-27T23:26:01.741477749Z [2024-06-27T23:26:01.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3207d892-af13-4add-b200-010625f1c119 2024-06-27T23:26:01.746216778Z [2024-06-27T23:26:01.745+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5febd13-8d00-4883-a667-55178fec9916 2024-06-27T23:26:01.748772542Z [2024-06-27T23:26:01.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37c48ecb-f074-4342-bd91-02cb11850662 2024-06-27T23:26:01.749446552Z [2024-06-27T23:26:01.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68f62dfe-8c39-4db9-b685-ad6124c4fffc 2024-06-27T23:26:03.449634730Z [2024-06-27T23:26:03.449+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:26:03.450130778Z [2024-06-27T23:26:03.449+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:25:00+00:00, run_id=scheduled__2024-06-27T23:25:00+00:00, run_start_date=2024-06-27 23:26:01.165995+00:00, run_end_date=2024-06-27 23:26:03.449782+00:00, run_duration=2.283787, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:25:00+00:00, data_interval_end=2024-06-27 23:26:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:26:03.460711409Z [2024-06-27T23:26:03.460+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:26:00+00:00, run_after=2024-06-27T23:27:00+00:00 2024-06-27T23:26:03.467258341Z [2024-06-27T23:26:03.466+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:26:03.467734972Z [2024-06-27T23:26:03.467+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:24:00+00:00, run_id=scheduled__2024-06-27T23:24:00+00:00, run_start_date=2024-06-27 23:26:01.163839+00:00, run_end_date=2024-06-27 23:26:03.467403+00:00, run_duration=2.303564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:24:00+00:00, data_interval_end=2024-06-27 23:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:26:03.477046782Z [2024-06-27T23:26:03.476+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:26:00+00:00, run_after=2024-06-27T23:28:00+00:00 2024-06-27T23:26:03.536877856Z [2024-06-27T23:26:03.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:24:00+00:00 exited with status success for try_number 1 2024-06-27T23:26:03.537957663Z [2024-06-27T23:26:03.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:25:00+00:00 exited with status success for try_number 1 2024-06-27T23:26:03.549634396Z [2024-06-27T23:26:03.549+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:25:00+00:00, map_index=-1, run_start_date=2024-06-27 23:26:02.333547+00:00, run_end_date=2024-06-27 23:26:02.847111+00:00, run_duration=0.513564, state=success, executor_state=success, try_number=1, max_tries=1, job_id=249, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:26:01.248369+00:00, queued_by_job_id=2, pid=3697 2024-06-27T23:26:03.554343233Z [2024-06-27T23:26:03.550+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:24:00+00:00, map_index=-1, run_start_date=2024-06-27 23:26:02.784393+00:00, run_end_date=2024-06-27 23:26:03.187393+00:00, run_duration=0.403, state=success, executor_state=success, try_number=1, max_tries=1, job_id=250, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:26:01.248369+00:00, queued_by_job_id=2, pid=3703 2024-06-27T23:26:05.959228275Z [2024-06-27T23:26:05.958+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:26:05.959459073Z [2024-06-27T23:26:05.959+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:25:00+00:00, run_id=scheduled__2024-06-27T23:25:00+00:00, run_start_date=2024-06-27 23:26:01.168458+00:00, run_end_date=2024-06-27 23:26:05.959180+00:00, run_duration=4.790722, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:25:00+00:00, data_interval_end=2024-06-27 23:26:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:26:05.969203549Z [2024-06-27T23:26:05.968+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:26:00+00:00, run_after=2024-06-27T23:27:00+00:00 2024-06-27T23:26:05.975644070Z [2024-06-27T23:26:05.975+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:26:05.975929434Z [2024-06-27T23:26:05.975+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:25:00+00:00, run_id=scheduled__2024-06-27T23:25:00+00:00, run_start_date=2024-06-27 23:26:01.171084+00:00, run_end_date=2024-06-27 23:26:05.975676+00:00, run_duration=4.804592, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:25:00+00:00, data_interval_end=2024-06-27 23:26:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:26:05.986264279Z [2024-06-27T23:26:05.985+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:26:00+00:00, run_after=2024-06-27T23:27:00+00:00 2024-06-27T23:26:06.033361886Z [2024-06-27T23:26:06.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:25:00+00:00 exited with status success for try_number 1 2024-06-27T23:26:06.051675002Z [2024-06-27T23:26:06.050+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:25:00+00:00, map_index=-1, run_start_date=2024-06-27 23:26:03.705541+00:00, run_end_date=2024-06-27 23:26:05.357823+00:00, run_duration=1.652282, state=success, executor_state=success, try_number=1, max_tries=1, job_id=251, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:26:01.248369+00:00, queued_by_job_id=2, pid=3721 2024-06-27T23:26:07.101940408Z [2024-06-27T23:26:07.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:25:00+00:00 exited with status success for try_number 1 2024-06-27T23:26:07.107389968Z [2024-06-27T23:26:07.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:25:00+00:00, map_index=-1, run_start_date=2024-06-27 23:26:03.980610+00:00, run_end_date=2024-06-27 23:26:05.878296+00:00, run_duration=1.897686, state=success, executor_state=success, try_number=1, max_tries=1, job_id=252, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:26:01.248369+00:00, queued_by_job_id=2, pid=3722 2024-06-27T23:26:44.684211459Z [2024-06-27T23:26:44.683+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T23:27:00.052462814Z [2024-06-27T23:27:00.052+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:27:00+00:00, run_after=2024-06-27T23:28:00+00:00 2024-06-27T23:27:00.061899632Z [2024-06-27T23:27:00.061+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:27:00.074896747Z [2024-06-27T23:27:00.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:27:00+00:00, run_after=2024-06-27T23:28:00+00:00 2024-06-27T23:27:00.135831622Z [2024-06-27T23:27:00.135+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:27:00.135880438Z 2024-06-27T23:27:00.135884321Z 2024-06-27T23:27:00.135887321Z 2024-06-27T23:27:00.136570965Z [2024-06-27T23:27:00.135+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:27:00.136581587Z [2024-06-27T23:27:00.136+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:27:00.136822661Z [2024-06-27T23:27:00.136+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:27:00.137616806Z [2024-06-27T23:27:00.137+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:27:00.137628364Z 2024-06-27T23:27:00.137632015Z 2024-06-27T23:27:00.137635168Z 2024-06-27T23:27:00.140962583Z [2024-06-27T23:27:00.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:27:00.141339098Z [2024-06-27T23:27:00.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:27:00.141798359Z [2024-06-27T23:27:00.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:27:00.141999532Z [2024-06-27T23:27:00.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:27:00.142319130Z [2024-06-27T23:27:00.142+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:27:00.142532647Z [2024-06-27T23:27:00.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:27:00.404536297Z [2024-06-27T23:27:00.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:26:00+00:00 exited with status queued for try_number 1 2024-06-27T23:27:00.406800163Z [2024-06-27T23:27:00.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:26:00+00:00 exited with status queued for try_number 1 2024-06-27T23:27:00.407026115Z [2024-06-27T23:27:00.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:26:00+00:00 exited with status queued for try_number 1 2024-06-27T23:27:00.414420767Z [2024-06-27T23:27:00.414+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2bb0ae77-5bfb-4425-907d-d9069cb76d6e 2024-06-27T23:27:00.414795234Z [2024-06-27T23:27:00.414+0000] {scheduler_job.py:635} INFO - Setting external_id for to be5569f1-a815-4625-8ee3-8c1fe0f926ec 2024-06-27T23:27:00.415161804Z [2024-06-27T23:27:00.414+0000] {scheduler_job.py:635} INFO - Setting external_id for to 026edbe7-09c1-47c0-a5e5-397a6d82259e 2024-06-27T23:27:01.543324106Z [2024-06-27T23:27:01.542+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:27:01.543798068Z [2024-06-27T23:27:01.543+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:26:00+00:00, run_id=scheduled__2024-06-27T23:26:00+00:00, run_start_date=2024-06-27 23:27:00.085450+00:00, run_end_date=2024-06-27 23:27:01.543394+00:00, run_duration=1.457944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:26:00+00:00, data_interval_end=2024-06-27 23:27:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:27:01.560131719Z [2024-06-27T23:27:01.559+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:27:00+00:00, run_after=2024-06-27T23:28:00+00:00 2024-06-27T23:27:01.632750922Z [2024-06-27T23:27:01.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:26:00+00:00 exited with status success for try_number 1 2024-06-27T23:27:01.651507431Z [2024-06-27T23:27:01.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:26:00+00:00, map_index=-1, run_start_date=2024-06-27 23:27:00.928803+00:00, run_end_date=2024-06-27 23:27:01.417505+00:00, run_duration=0.488702, state=success, executor_state=success, try_number=1, max_tries=1, job_id=253, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:27:00.138419+00:00, queued_by_job_id=2, pid=3754 2024-06-27T23:27:04.071161619Z [2024-06-27T23:27:04.069+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:27:04.072497315Z [2024-06-27T23:27:04.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:26:00+00:00, run_id=scheduled__2024-06-27T23:26:00+00:00, run_start_date=2024-06-27 23:27:00.086945+00:00, run_end_date=2024-06-27 23:27:04.070819+00:00, run_duration=3.983874, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:26:00+00:00, data_interval_end=2024-06-27 23:27:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:27:04.104112712Z [2024-06-27T23:27:04.099+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:27:00+00:00, run_after=2024-06-27T23:28:00+00:00 2024-06-27T23:27:04.215935388Z [2024-06-27T23:27:04.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:26:00+00:00 exited with status success for try_number 1 2024-06-27T23:27:04.222856952Z [2024-06-27T23:27:04.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:26:00+00:00, map_index=-1, run_start_date=2024-06-27 23:27:02.281283+00:00, run_end_date=2024-06-27 23:27:03.798913+00:00, run_duration=1.51763, state=success, executor_state=success, try_number=1, max_tries=1, job_id=254, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:27:00.138419+00:00, queued_by_job_id=2, pid=3772 2024-06-27T23:27:05.280863243Z [2024-06-27T23:27:05.280+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:27:05.281228855Z [2024-06-27T23:27:05.280+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:26:00+00:00, run_id=scheduled__2024-06-27T23:26:00+00:00, run_start_date=2024-06-27 23:27:00.088407+00:00, run_end_date=2024-06-27 23:27:05.280760+00:00, run_duration=5.192353, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:26:00+00:00, data_interval_end=2024-06-27 23:27:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:27:05.296900051Z [2024-06-27T23:27:05.296+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:27:00+00:00, run_after=2024-06-27T23:28:00+00:00 2024-06-27T23:27:05.351418922Z [2024-06-27T23:27:05.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:26:00+00:00 exited with status success for try_number 1 2024-06-27T23:27:05.357253768Z [2024-06-27T23:27:05.356+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:26:00+00:00, map_index=-1, run_start_date=2024-06-27 23:27:02.293915+00:00, run_end_date=2024-06-27 23:27:04.147143+00:00, run_duration=1.853228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=255, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:27:00.138419+00:00, queued_by_job_id=2, pid=3773 2024-06-27T23:28:00.925718193Z [2024-06-27T23:28:00.925+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:28:00.944589390Z [2024-06-27T23:28:00.944+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:28:00+00:00, run_after=2024-06-27T23:29:00+00:00 2024-06-27T23:28:00.952205582Z [2024-06-27T23:28:00.951+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:28:00.969107532Z [2024-06-27T23:28:00.968+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:28:00+00:00, run_after=2024-06-27T23:29:00+00:00 2024-06-27T23:28:01.079695028Z [2024-06-27T23:28:01.079+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:28:01.079702894Z 2024-06-27T23:28:01.079711197Z 2024-06-27T23:28:01.079714680Z 2024-06-27T23:28:01.079718109Z 2024-06-27T23:28:01.079973603Z [2024-06-27T23:28:01.079+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:28:01.080323086Z [2024-06-27T23:28:01.080+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:28:01.080654362Z [2024-06-27T23:28:01.080+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:28:01.080904186Z [2024-06-27T23:28:01.080+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:28:01.082038860Z [2024-06-27T23:28:01.081+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:28:01.082052125Z 2024-06-27T23:28:01.082056005Z 2024-06-27T23:28:01.082059157Z 2024-06-27T23:28:01.082062270Z 2024-06-27T23:28:01.087760048Z [2024-06-27T23:28:01.087+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:28:01.088043292Z [2024-06-27T23:28:01.087+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:28:01.088491966Z [2024-06-27T23:28:01.088+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:28:01.088705978Z [2024-06-27T23:28:01.088+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:28:01.089055516Z [2024-06-27T23:28:01.088+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:28:01.089329056Z [2024-06-27T23:28:01.089+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:28:01.089778992Z [2024-06-27T23:28:01.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:28:01.090153604Z [2024-06-27T23:28:01.089+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:28:01.486250632Z [2024-06-27T23:28:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:26:00+00:00 exited with status queued for try_number 1 2024-06-27T23:28:01.486327824Z [2024-06-27T23:28:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:27:00+00:00 exited with status queued for try_number 1 2024-06-27T23:28:01.488640733Z [2024-06-27T23:28:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:27:00+00:00 exited with status queued for try_number 1 2024-06-27T23:28:01.488806170Z [2024-06-27T23:28:01.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:27:00+00:00 exited with status queued for try_number 1 2024-06-27T23:28:01.498649272Z [2024-06-27T23:28:01.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31e23bd6-39ee-4e6e-8b41-57867a2b84f9 2024-06-27T23:28:01.498938551Z [2024-06-27T23:28:01.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to 356464de-f6d2-476f-98d5-28f5b6fd2309 2024-06-27T23:28:01.499181965Z [2024-06-27T23:28:01.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66e526c0-9008-46df-bce0-db88d8f6eafc 2024-06-27T23:28:01.499380413Z [2024-06-27T23:28:01.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34f8910b-0e2f-4efa-bd86-75bf8bae0cea 2024-06-27T23:28:02.757701080Z [2024-06-27T23:28:02.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:28:02.758155997Z [2024-06-27T23:28:02.757+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:26:00+00:00, run_id=scheduled__2024-06-27T23:26:00+00:00, run_start_date=2024-06-27 23:28:00.982674+00:00, run_end_date=2024-06-27 23:28:02.757620+00:00, run_duration=1.774946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:26:00+00:00, data_interval_end=2024-06-27 23:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:28:02.772475243Z [2024-06-27T23:28:02.772+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:28:00+00:00, run_after=2024-06-27T23:30:00+00:00 2024-06-27T23:28:02.838150996Z [2024-06-27T23:28:02.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:26:00+00:00 exited with status success for try_number 1 2024-06-27T23:28:02.845757359Z [2024-06-27T23:28:02.845+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:26:00+00:00, map_index=-1, run_start_date=2024-06-27 23:28:02.105905+00:00, run_end_date=2024-06-27 23:28:02.599242+00:00, run_duration=0.493337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=256, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:28:01.084011+00:00, queued_by_job_id=2, pid=3806 2024-06-27T23:28:02.922761364Z [2024-06-27T23:28:02.922+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:28:02.923004342Z [2024-06-27T23:28:02.922+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:27:00+00:00, run_id=scheduled__2024-06-27T23:27:00+00:00, run_start_date=2024-06-27 23:28:00.984376+00:00, run_end_date=2024-06-27 23:28:02.922700+00:00, run_duration=1.938324, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:27:00+00:00, data_interval_end=2024-06-27 23:28:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:28:02.932045708Z [2024-06-27T23:28:02.931+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:28:00+00:00, run_after=2024-06-27T23:29:00+00:00 2024-06-27T23:28:02.977086789Z [2024-06-27T23:28:02.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:27:00+00:00 exited with status success for try_number 1 2024-06-27T23:28:02.982168469Z [2024-06-27T23:28:02.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:27:00+00:00, map_index=-1, run_start_date=2024-06-27 23:28:02.265334+00:00, run_end_date=2024-06-27 23:28:02.778970+00:00, run_duration=0.513636, state=success, executor_state=success, try_number=1, max_tries=1, job_id=257, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:28:01.084011+00:00, queued_by_job_id=2, pid=3807 2024-06-27T23:28:05.785289019Z [2024-06-27T23:28:05.784+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:28:05.785454369Z [2024-06-27T23:28:05.785+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:27:00+00:00, run_id=scheduled__2024-06-27T23:27:00+00:00, run_start_date=2024-06-27 23:28:00.985605+00:00, run_end_date=2024-06-27 23:28:05.785204+00:00, run_duration=4.799599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:27:00+00:00, data_interval_end=2024-06-27 23:28:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:28:05.811836963Z [2024-06-27T23:28:05.811+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:28:00+00:00, run_after=2024-06-27T23:29:00+00:00 2024-06-27T23:28:05.872144524Z [2024-06-27T23:28:05.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:27:00+00:00 exited with status success for try_number 1 2024-06-27T23:28:05.880092202Z [2024-06-27T23:28:05.879+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:27:00+00:00, map_index=-1, run_start_date=2024-06-27 23:28:03.628880+00:00, run_end_date=2024-06-27 23:28:05.499569+00:00, run_duration=1.870689, state=success, executor_state=success, try_number=1, max_tries=1, job_id=258, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:28:01.084011+00:00, queued_by_job_id=2, pid=3830 2024-06-27T23:28:06.917294266Z [2024-06-27T23:28:06.916+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:28:06.917599914Z [2024-06-27T23:28:06.917+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:27:00+00:00, run_id=scheduled__2024-06-27T23:27:00+00:00, run_start_date=2024-06-27 23:28:00.986718+00:00, run_end_date=2024-06-27 23:28:06.917205+00:00, run_duration=5.930487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:27:00+00:00, data_interval_end=2024-06-27 23:28:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:28:06.927327434Z [2024-06-27T23:28:06.927+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:28:00+00:00, run_after=2024-06-27T23:29:00+00:00 2024-06-27T23:28:06.967614590Z [2024-06-27T23:28:06.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:27:00+00:00 exited with status success for try_number 1 2024-06-27T23:28:06.974659405Z [2024-06-27T23:28:06.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:27:00+00:00, map_index=-1, run_start_date=2024-06-27 23:28:03.743995+00:00, run_end_date=2024-06-27 23:28:05.798745+00:00, run_duration=2.05475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=259, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:28:01.084011+00:00, queued_by_job_id=2, pid=3831 2024-06-27T23:29:00.982897019Z [2024-06-27T23:29:00.982+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:29:00+00:00, run_after=2024-06-27T23:30:00+00:00 2024-06-27T23:29:00.999776375Z [2024-06-27T23:29:00.998+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:29:01.030583408Z [2024-06-27T23:29:01.030+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:29:00+00:00, run_after=2024-06-27T23:30:00+00:00 2024-06-27T23:29:01.133886255Z [2024-06-27T23:29:01.133+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:29:01.133901054Z 2024-06-27T23:29:01.133904763Z 2024-06-27T23:29:01.133907898Z 2024-06-27T23:29:01.133955871Z [2024-06-27T23:29:01.133+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:29:01.134068130Z [2024-06-27T23:29:01.133+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:29:01.134218156Z [2024-06-27T23:29:01.134+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:29:01.135078002Z [2024-06-27T23:29:01.134+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:29:01.135090810Z 2024-06-27T23:29:01.135106294Z 2024-06-27T23:29:01.135109609Z 2024-06-27T23:29:01.139457254Z [2024-06-27T23:29:01.139+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:29:01.139576392Z [2024-06-27T23:29:01.139+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:29:01.140431410Z [2024-06-27T23:29:01.139+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:29:01.140952944Z [2024-06-27T23:29:01.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:29:01.141164092Z [2024-06-27T23:29:01.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:29:01.141263778Z [2024-06-27T23:29:01.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:29:01.448416835Z [2024-06-27T23:29:01.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:28:00+00:00 exited with status queued for try_number 1 2024-06-27T23:29:01.448582656Z [2024-06-27T23:29:01.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:28:00+00:00 exited with status queued for try_number 1 2024-06-27T23:29:01.448700479Z [2024-06-27T23:29:01.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:28:00+00:00 exited with status queued for try_number 1 2024-06-27T23:29:01.463378085Z [2024-06-27T23:29:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6668ce29-97a6-4eb9-95b9-7058257cdb0e 2024-06-27T23:29:01.463532214Z [2024-06-27T23:29:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to e82de557-b3e7-4ac3-aef8-2feea4689b0b 2024-06-27T23:29:01.463694159Z [2024-06-27T23:29:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5905eb61-a5e8-40be-9b39-ecdfcf56b202 2024-06-27T23:29:02.673398168Z [2024-06-27T23:29:02.672+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:29:02.673703472Z [2024-06-27T23:29:02.673+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:28:00+00:00, run_id=scheduled__2024-06-27T23:28:00+00:00, run_start_date=2024-06-27 23:29:01.063349+00:00, run_end_date=2024-06-27 23:29:02.673332+00:00, run_duration=1.609983, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:28:00+00:00, data_interval_end=2024-06-27 23:29:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:29:02.684030261Z [2024-06-27T23:29:02.683+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:29:00+00:00, run_after=2024-06-27T23:30:00+00:00 2024-06-27T23:29:02.750555735Z [2024-06-27T23:29:02.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:28:00+00:00 exited with status success for try_number 1 2024-06-27T23:29:02.764635205Z [2024-06-27T23:29:02.764+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:28:00+00:00, map_index=-1, run_start_date=2024-06-27 23:29:02.148163+00:00, run_end_date=2024-06-27 23:29:02.530286+00:00, run_duration=0.382123, state=success, executor_state=success, try_number=1, max_tries=1, job_id=260, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:29:01.136126+00:00, queued_by_job_id=2, pid=3863 2024-06-27T23:29:05.034166908Z [2024-06-27T23:29:05.033+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:29:05.035057197Z [2024-06-27T23:29:05.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:28:00+00:00, run_id=scheduled__2024-06-27T23:28:00+00:00, run_start_date=2024-06-27 23:29:01.065208+00:00, run_end_date=2024-06-27 23:29:05.034084+00:00, run_duration=3.968876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:28:00+00:00, data_interval_end=2024-06-27 23:29:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:29:05.058318551Z [2024-06-27T23:29:05.058+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:29:00+00:00, run_after=2024-06-27T23:30:00+00:00 2024-06-27T23:29:05.108637785Z [2024-06-27T23:29:05.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:28:00+00:00 exited with status success for try_number 1 2024-06-27T23:29:05.120004394Z [2024-06-27T23:29:05.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:28:00+00:00, map_index=-1, run_start_date=2024-06-27 23:29:03.375973+00:00, run_end_date=2024-06-27 23:29:04.802237+00:00, run_duration=1.426264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=261, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:29:01.136126+00:00, queued_by_job_id=2, pid=3881 2024-06-27T23:29:06.241760951Z [2024-06-27T23:29:06.241+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:29:06.242190286Z [2024-06-27T23:29:06.241+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:28:00+00:00, run_id=scheduled__2024-06-27T23:28:00+00:00, run_start_date=2024-06-27 23:29:01.068011+00:00, run_end_date=2024-06-27 23:29:06.241691+00:00, run_duration=5.17368, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:28:00+00:00, data_interval_end=2024-06-27 23:29:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:29:06.254044228Z [2024-06-27T23:29:06.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:29:00+00:00, run_after=2024-06-27T23:30:00+00:00 2024-06-27T23:29:06.334617566Z [2024-06-27T23:29:06.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:28:00+00:00 exited with status success for try_number 1 2024-06-27T23:29:06.342434339Z [2024-06-27T23:29:06.341+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:28:00+00:00, map_index=-1, run_start_date=2024-06-27 23:29:03.445219+00:00, run_end_date=2024-06-27 23:29:05.250618+00:00, run_duration=1.805399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=262, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:29:01.136126+00:00, queued_by_job_id=2, pid=3882 2024-06-27T23:30:00.864796914Z [2024-06-27T23:30:00.864+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:30:00+00:00, run_after=2024-06-27T23:35:00+00:00 2024-06-27T23:30:00.883284734Z [2024-06-27T23:30:00.883+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:30:00+00:00, run_after=2024-06-27T23:31:00+00:00 2024-06-27T23:30:00.898465533Z [2024-06-27T23:30:00.898+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:30:00+00:00, run_after=2024-06-27T23:31:00+00:00 2024-06-27T23:30:00.911387559Z [2024-06-27T23:30:00.910+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:30:00.932500649Z [2024-06-27T23:30:00.932+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:30:01.085177902Z [2024-06-27T23:30:01.084+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T23:30:01.085207129Z 2024-06-27T23:30:01.085211357Z 2024-06-27T23:30:01.085216623Z 2024-06-27T23:30:01.085247728Z 2024-06-27T23:30:01.085251415Z 2024-06-27T23:30:01.086049521Z [2024-06-27T23:30:01.085+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:30:01.086287114Z [2024-06-27T23:30:01.086+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:30:01.086558024Z [2024-06-27T23:30:01.086+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:30:01.086894261Z [2024-06-27T23:30:01.086+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:30:01.087188963Z [2024-06-27T23:30:01.086+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:30:01.089011249Z [2024-06-27T23:30:01.088+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:30:01.089047131Z 2024-06-27T23:30:01.089087209Z 2024-06-27T23:30:01.089097472Z 2024-06-27T23:30:01.089105921Z 2024-06-27T23:30:01.089121005Z 2024-06-27T23:30:01.097953243Z [2024-06-27T23:30:01.097+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T23:30:01.098298340Z [2024-06-27T23:30:01.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:30:01.099375380Z [2024-06-27T23:30:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:30:01.099988386Z [2024-06-27T23:30:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:30:01.100508222Z [2024-06-27T23:30:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:30:01.101193900Z [2024-06-27T23:30:01.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:30:01.101636744Z [2024-06-27T23:30:01.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:30:01.101872711Z [2024-06-27T23:30:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:30:01.102525757Z [2024-06-27T23:30:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:30:01.102772998Z [2024-06-27T23:30:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:30:01.508537702Z [2024-06-27T23:30:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:25:00+00:00 exited with status queued for try_number 1 2024-06-27T23:30:01.508848819Z [2024-06-27T23:30:01.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:28:00+00:00 exited with status queued for try_number 1 2024-06-27T23:30:01.509066536Z [2024-06-27T23:30:01.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:29:00+00:00 exited with status queued for try_number 1 2024-06-27T23:30:01.509244399Z [2024-06-27T23:30:01.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:29:00+00:00 exited with status queued for try_number 1 2024-06-27T23:30:01.509428355Z [2024-06-27T23:30:01.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:29:00+00:00 exited with status queued for try_number 1 2024-06-27T23:30:01.520131134Z [2024-06-27T23:30:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6fb4a436-3528-4d22-a227-0f611f318e8a 2024-06-27T23:30:01.520466072Z [2024-06-27T23:30:01.520+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b14ef66-c480-49cd-b791-8b686b316ef5 2024-06-27T23:30:01.520714869Z [2024-06-27T23:30:01.520+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31449fe5-51d7-4f13-a85a-cd64493fb674 2024-06-27T23:30:01.520959582Z [2024-06-27T23:30:01.520+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92fb6e16-a144-4c10-bd2e-5c774e5fa81d 2024-06-27T23:30:01.521212086Z [2024-06-27T23:30:01.521+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93542b6a-1ac9-4eff-8935-472c25b3b7e0 2024-06-27T23:30:03.600445888Z [2024-06-27T23:30:03.599+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:30:03.600809204Z [2024-06-27T23:30:03.600+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:29:00+00:00, run_id=scheduled__2024-06-27T23:29:00+00:00, run_start_date=2024-06-27 23:30:00.951849+00:00, run_end_date=2024-06-27 23:30:03.600401+00:00, run_duration=2.648552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:29:00+00:00, data_interval_end=2024-06-27 23:30:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:30:03.616229641Z [2024-06-27T23:30:03.615+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:30:00+00:00, run_after=2024-06-27T23:31:00+00:00 2024-06-27T23:30:03.658976182Z [2024-06-27T23:30:03.658+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:30:03.659780819Z [2024-06-27T23:30:03.659+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:28:00+00:00, run_id=scheduled__2024-06-27T23:28:00+00:00, run_start_date=2024-06-27 23:30:00.950798+00:00, run_end_date=2024-06-27 23:30:03.658780+00:00, run_duration=2.707982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:28:00+00:00, data_interval_end=2024-06-27 23:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:30:03.674364997Z [2024-06-27T23:30:03.674+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:30:00+00:00, run_after=2024-06-27T23:32:00+00:00 2024-06-27T23:30:03.808127937Z [2024-06-27T23:30:03.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:28:00+00:00 exited with status success for try_number 1 2024-06-27T23:30:03.808151618Z [2024-06-27T23:30:03.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:29:00+00:00 exited with status success for try_number 1 2024-06-27T23:30:03.879139430Z [2024-06-27T23:30:03.876+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:28:00+00:00, map_index=-1, run_start_date=2024-06-27 23:30:02.155770+00:00, run_end_date=2024-06-27 23:30:02.793597+00:00, run_duration=0.637827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=263, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:30:01.090534+00:00, queued_by_job_id=2, pid=3912 2024-06-27T23:30:03.885213495Z [2024-06-27T23:30:03.878+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:29:00+00:00, map_index=-1, run_start_date=2024-06-27 23:30:02.543319+00:00, run_end_date=2024-06-27 23:30:03.161377+00:00, run_duration=0.618058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=264, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:30:01.090534+00:00, queued_by_job_id=2, pid=3917 2024-06-27T23:30:05.075394763Z [2024-06-27T23:30:05.075+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:30:05.075411571Z 2024-06-27T23:30:05.075563026Z [2024-06-27T23:30:05.075+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:30:05.076290261Z [2024-06-27T23:30:05.076+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:30:05.076301257Z 2024-06-27T23:30:05.079030822Z [2024-06-27T23:30:05.078+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-27T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T23:30:05.079184907Z [2024-06-27T23:30:05.079+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-27T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:30:05.241745550Z [2024-06-27T23:30:05.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:25:00+00:00 exited with status queued for try_number 1 2024-06-27T23:30:05.246986106Z [2024-06-27T23:30:05.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:25:00+00:00 exited with status success for try_number 1 2024-06-27T23:30:05.262883021Z [2024-06-27T23:30:05.262+0000] {scheduler_job.py:635} INFO - Setting external_id for to a75fb5b5-f23c-4980-a38a-56fbb1fb5753 2024-06-27T23:30:05.264711411Z [2024-06-27T23:30:05.264+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T23:25:00+00:00, map_index=-1, run_start_date=2024-06-27 23:30:03.857673+00:00, run_end_date=2024-06-27 23:30:04.754635+00:00, run_duration=0.896962, state=success, executor_state=success, try_number=1, max_tries=1, job_id=265, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:30:01.090534+00:00, queued_by_job_id=2, pid=3942 2024-06-27T23:30:06.610772342Z [2024-06-27T23:30:06.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:30:06.611161808Z [2024-06-27T23:30:06.610+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:29:00+00:00, run_id=scheduled__2024-06-27T23:29:00+00:00, run_start_date=2024-06-27 23:30:00.953822+00:00, run_end_date=2024-06-27 23:30:06.610758+00:00, run_duration=5.656936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:29:00+00:00, data_interval_end=2024-06-27 23:30:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:30:06.619905859Z [2024-06-27T23:30:06.619+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:30:00+00:00, run_after=2024-06-27T23:31:00+00:00 2024-06-27T23:30:06.627801555Z [2024-06-27T23:30:06.627+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:30:06.628035286Z [2024-06-27T23:30:06.627+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:29:00+00:00, run_id=scheduled__2024-06-27T23:29:00+00:00, run_start_date=2024-06-27 23:30:00.952902+00:00, run_end_date=2024-06-27 23:30:06.627719+00:00, run_duration=5.674817, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:29:00+00:00, data_interval_end=2024-06-27 23:30:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:30:06.639421699Z [2024-06-27T23:30:06.638+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:30:00+00:00, run_after=2024-06-27T23:31:00+00:00 2024-06-27T23:30:06.684656861Z [2024-06-27T23:30:06.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:29:00+00:00 exited with status success for try_number 1 2024-06-27T23:30:06.684739723Z [2024-06-27T23:30:06.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:29:00+00:00 exited with status success for try_number 1 2024-06-27T23:30:06.691303839Z [2024-06-27T23:30:06.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:29:00+00:00, map_index=-1, run_start_date=2024-06-27 23:30:03.905883+00:00, run_end_date=2024-06-27 23:30:05.921183+00:00, run_duration=2.0153, state=success, executor_state=success, try_number=1, max_tries=1, job_id=266, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:30:01.090534+00:00, queued_by_job_id=2, pid=3941 2024-06-27T23:30:06.691640258Z [2024-06-27T23:30:06.691+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:29:00+00:00, map_index=-1, run_start_date=2024-06-27 23:30:04.489802+00:00, run_end_date=2024-06-27 23:30:06.030493+00:00, run_duration=1.540691, state=success, executor_state=success, try_number=1, max_tries=1, job_id=267, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:30:01.090534+00:00, queued_by_job_id=2, pid=3953 2024-06-27T23:30:08.884324220Z [2024-06-27T23:30:08.883+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:30:08.884342690Z 2024-06-27T23:30:08.884535160Z [2024-06-27T23:30:08.884+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:30:08.885153707Z [2024-06-27T23:30:08.884+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:30:08.885175374Z 2024-06-27T23:30:08.893204994Z [2024-06-27T23:30:08.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-27T23:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T23:30:08.893331935Z [2024-06-27T23:30:08.893+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-27T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T23:30:08.956061705Z [2024-06-27T23:30:08.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:25:00+00:00 exited with status queued for try_number 1 2024-06-27T23:30:08.956090922Z [2024-06-27T23:30:08.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:25:00+00:00 exited with status success for try_number 1 2024-06-27T23:30:08.968477298Z [2024-06-27T23:30:08.968+0000] {scheduler_job.py:635} INFO - Setting external_id for to 221ff7dc-e88e-480a-8ef6-e5f52c0456ed 2024-06-27T23:30:08.968568045Z [2024-06-27T23:30:08.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-27T23:25:00+00:00, map_index=-1, run_start_date=2024-06-27 23:30:07.511776+00:00, run_end_date=2024-06-27 23:30:07.863993+00:00, run_duration=0.352217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=268, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:30:05.077009+00:00, queued_by_job_id=2, pid=3971 2024-06-27T23:30:12.955575651Z [2024-06-27T23:30:12.955+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:30:12.955644374Z 2024-06-27T23:30:12.955663063Z [2024-06-27T23:30:12.955+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:30:12.956292227Z [2024-06-27T23:30:12.956+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:30:12.956304410Z 2024-06-27T23:30:12.958617207Z [2024-06-27T23:30:12.958+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-27T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:30:12.958777080Z [2024-06-27T23:30:12.958+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-27T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:30:13.042858850Z [2024-06-27T23:30:13.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:25:00+00:00 exited with status queued for try_number 1 2024-06-27T23:30:13.048853514Z [2024-06-27T23:30:13.048+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89ce0bf3-0db1-4ee1-964e-a891e0c73e93 2024-06-27T23:30:13.155945001Z [2024-06-27T23:30:13.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:25:00+00:00 exited with status success for try_number 1 2024-06-27T23:30:13.167324930Z [2024-06-27T23:30:13.166+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-27T23:25:00+00:00, map_index=0, run_start_date=2024-06-27 23:30:10.691813+00:00, run_end_date=2024-06-27 23:30:12.850269+00:00, run_duration=2.158456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=269, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:30:08.886400+00:00, queued_by_job_id=2, pid=3979 2024-06-27T23:30:15.766941835Z [2024-06-27T23:30:15.766+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:30:15.767282209Z [2024-06-27T23:30:15.766+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:25:00+00:00, run_id=scheduled__2024-06-27T23:25:00+00:00, run_start_date=2024-06-27 23:30:00.949583+00:00, run_end_date=2024-06-27 23:30:15.766785+00:00, run_duration=14.817202, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:25:00+00:00, data_interval_end=2024-06-27 23:30:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-27T23:30:15.775327355Z [2024-06-27T23:30:15.775+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:30:00+00:00, run_after=2024-06-27T23:35:00+00:00 2024-06-27T23:30:15.826792324Z [2024-06-27T23:30:15.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:25:00+00:00 exited with status success for try_number 1 2024-06-27T23:30:15.834241627Z [2024-06-27T23:30:15.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-27T23:25:00+00:00, map_index=-1, run_start_date=2024-06-27 23:30:14.834282+00:00, run_end_date=2024-06-27 23:30:15.219038+00:00, run_duration=0.384756, state=success, executor_state=success, try_number=1, max_tries=1, job_id=270, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:30:12.956675+00:00, queued_by_job_id=2, pid=3992 2024-06-27T23:31:00.646042095Z [2024-06-27T23:31:00.645+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:31:00.660165047Z [2024-06-27T23:31:00.659+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:31:00+00:00, run_after=2024-06-27T23:32:00+00:00 2024-06-27T23:31:00.673154115Z [2024-06-27T23:31:00.672+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:31:00+00:00, run_after=2024-06-27T23:32:00+00:00 2024-06-27T23:31:00.740477791Z [2024-06-27T23:31:00.740+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:31:00.740540342Z 2024-06-27T23:31:00.740546612Z 2024-06-27T23:31:00.740551890Z 2024-06-27T23:31:00.740742640Z [2024-06-27T23:31:00.740+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:31:00.740915875Z [2024-06-27T23:31:00.740+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:31:00.741101809Z [2024-06-27T23:31:00.740+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:31:00.741742357Z [2024-06-27T23:31:00.741+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:31:00.741758721Z 2024-06-27T23:31:00.741763582Z 2024-06-27T23:31:00.741768104Z 2024-06-27T23:31:00.744663001Z [2024-06-27T23:31:00.744+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:31:00.745238384Z [2024-06-27T23:31:00.745+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:31:00.745533484Z [2024-06-27T23:31:00.745+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:31:00.745683815Z [2024-06-27T23:31:00.745+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:31:00.745982909Z [2024-06-27T23:31:00.745+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:31:00.746158087Z [2024-06-27T23:31:00.746+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:31:00.990569069Z [2024-06-27T23:31:00.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:30:00+00:00 exited with status queued for try_number 1 2024-06-27T23:31:00.992794725Z [2024-06-27T23:31:00.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:30:00+00:00 exited with status queued for try_number 1 2024-06-27T23:31:00.992935500Z [2024-06-27T23:31:00.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:30:00+00:00 exited with status queued for try_number 1 2024-06-27T23:31:01.000261909Z [2024-06-27T23:31:00.999+0000] {scheduler_job.py:635} INFO - Setting external_id for to 294ab09e-4dc7-4de3-afa4-414a877099f0 2024-06-27T23:31:01.007220777Z [2024-06-27T23:31:01.006+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4951e86f-ee5f-426b-9f3a-63c36b978c3f 2024-06-27T23:31:01.009591741Z [2024-06-27T23:31:01.009+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6460622c-8e4e-4609-849b-03fe169c81b9 2024-06-27T23:31:02.188481993Z [2024-06-27T23:31:02.188+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:31:02.188904709Z [2024-06-27T23:31:02.188+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:30:00+00:00, run_id=scheduled__2024-06-27T23:30:00+00:00, run_start_date=2024-06-27 23:31:00.685495+00:00, run_end_date=2024-06-27 23:31:02.188514+00:00, run_duration=1.503019, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:30:00+00:00, data_interval_end=2024-06-27 23:31:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:31:02.198411176Z [2024-06-27T23:31:02.198+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:31:00+00:00, run_after=2024-06-27T23:32:00+00:00 2024-06-27T23:31:02.609897879Z [2024-06-27T23:31:02.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:30:00+00:00 exited with status success for try_number 1 2024-06-27T23:31:02.617554109Z [2024-06-27T23:31:02.617+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:30:00+00:00, map_index=-1, run_start_date=2024-06-27 23:31:01.733810+00:00, run_end_date=2024-06-27 23:31:02.171302+00:00, run_duration=0.437492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=271, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:31:00.742393+00:00, queued_by_job_id=2, pid=4014 2024-06-27T23:31:05.287554150Z [2024-06-27T23:31:05.287+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:31:05.287867351Z [2024-06-27T23:31:05.287+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:30:00+00:00, run_id=scheduled__2024-06-27T23:30:00+00:00, run_start_date=2024-06-27 23:31:00.686967+00:00, run_end_date=2024-06-27 23:31:05.287490+00:00, run_duration=4.600523, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:30:00+00:00, data_interval_end=2024-06-27 23:31:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:31:05.300902064Z [2024-06-27T23:31:05.300+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:31:00+00:00, run_after=2024-06-27T23:32:00+00:00 2024-06-27T23:31:05.368612872Z [2024-06-27T23:31:05.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:30:00+00:00 exited with status success for try_number 1 2024-06-27T23:31:05.374402016Z [2024-06-27T23:31:05.373+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:30:00+00:00, map_index=-1, run_start_date=2024-06-27 23:31:02.812949+00:00, run_end_date=2024-06-27 23:31:04.284524+00:00, run_duration=1.471575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=272, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:31:00.742393+00:00, queued_by_job_id=2, pid=4032 2024-06-27T23:31:07.331851717Z [2024-06-27T23:31:07.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:31:07.332027650Z [2024-06-27T23:31:07.331+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:30:00+00:00, run_id=scheduled__2024-06-27T23:30:00+00:00, run_start_date=2024-06-27 23:31:00.688159+00:00, run_end_date=2024-06-27 23:31:07.331769+00:00, run_duration=6.64361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:30:00+00:00, data_interval_end=2024-06-27 23:31:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:31:07.342794479Z [2024-06-27T23:31:07.342+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:31:00+00:00, run_after=2024-06-27T23:32:00+00:00 2024-06-27T23:31:07.409252885Z [2024-06-27T23:31:07.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:30:00+00:00 exited with status success for try_number 1 2024-06-27T23:31:07.414508913Z [2024-06-27T23:31:07.414+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:30:00+00:00, map_index=-1, run_start_date=2024-06-27 23:31:02.966194+00:00, run_end_date=2024-06-27 23:31:06.468154+00:00, run_duration=3.50196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=273, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:31:00.742393+00:00, queued_by_job_id=2, pid=4033 2024-06-27T23:31:44.777309885Z [2024-06-27T23:31:44.776+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T23:32:00.701519539Z [2024-06-27T23:32:00.701+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:32:00.730475521Z [2024-06-27T23:32:00.730+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:32:00+00:00, run_after=2024-06-27T23:33:00+00:00 2024-06-27T23:32:00.741973427Z [2024-06-27T23:32:00.741+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:32:00.759115376Z [2024-06-27T23:32:00.758+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:32:00+00:00, run_after=2024-06-27T23:33:00+00:00 2024-06-27T23:32:00.869610759Z [2024-06-27T23:32:00.869+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:32:00.869637194Z 2024-06-27T23:32:00.869643943Z 2024-06-27T23:32:00.869647098Z 2024-06-27T23:32:00.869650289Z 2024-06-27T23:32:00.869693851Z [2024-06-27T23:32:00.869+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:32:00.869866115Z [2024-06-27T23:32:00.869+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:32:00.869976690Z [2024-06-27T23:32:00.869+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:32:00.870112704Z [2024-06-27T23:32:00.869+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:32:00.870741208Z [2024-06-27T23:32:00.870+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:32:00.870752608Z 2024-06-27T23:32:00.870756616Z 2024-06-27T23:32:00.870759978Z 2024-06-27T23:32:00.870763093Z 2024-06-27T23:32:00.874335721Z [2024-06-27T23:32:00.874+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:32:00.874482389Z [2024-06-27T23:32:00.874+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:32:00.874764337Z [2024-06-27T23:32:00.874+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:32:00.874996887Z [2024-06-27T23:32:00.874+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:32:00.875241102Z [2024-06-27T23:32:00.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:32:00.875377433Z [2024-06-27T23:32:00.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:32:00.875604512Z [2024-06-27T23:32:00.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:32:00.875740876Z [2024-06-27T23:32:00.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:32:01.223849271Z [2024-06-27T23:32:01.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:30:00+00:00 exited with status queued for try_number 1 2024-06-27T23:32:01.226296690Z [2024-06-27T23:32:01.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:31:00+00:00 exited with status queued for try_number 1 2024-06-27T23:32:01.226580465Z [2024-06-27T23:32:01.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:31:00+00:00 exited with status queued for try_number 1 2024-06-27T23:32:01.226820376Z [2024-06-27T23:32:01.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:31:00+00:00 exited with status queued for try_number 1 2024-06-27T23:32:01.249965493Z [2024-06-27T23:32:01.249+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4487116d-1052-4df6-8c3b-fb6eb5ab6bd3 2024-06-27T23:32:01.251088039Z [2024-06-27T23:32:01.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88b8a976-94ad-4472-b8d2-faaf4c9c0411 2024-06-27T23:32:01.251287090Z [2024-06-27T23:32:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to 729ce314-5853-4eb2-a9c9-e8983d1ce0b4 2024-06-27T23:32:01.251947230Z [2024-06-27T23:32:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5142c42a-0115-4a96-97ed-e7f7adba7fe9 2024-06-27T23:32:03.673569784Z [2024-06-27T23:32:03.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:32:03.674310156Z [2024-06-27T23:32:03.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:30:00+00:00, run_id=scheduled__2024-06-27T23:30:00+00:00, run_start_date=2024-06-27 23:32:00.775733+00:00, run_end_date=2024-06-27 23:32:03.673512+00:00, run_duration=2.897779, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:30:00+00:00, data_interval_end=2024-06-27 23:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:32:03.682276697Z [2024-06-27T23:32:03.681+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:32:00+00:00, run_after=2024-06-27T23:34:00+00:00 2024-06-27T23:32:03.698841647Z [2024-06-27T23:32:03.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:32:03.699214707Z [2024-06-27T23:32:03.699+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:31:00+00:00, run_id=scheduled__2024-06-27T23:31:00+00:00, run_start_date=2024-06-27 23:32:00.777878+00:00, run_end_date=2024-06-27 23:32:03.698767+00:00, run_duration=2.920889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:31:00+00:00, data_interval_end=2024-06-27 23:32:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:32:03.711824875Z [2024-06-27T23:32:03.711+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:32:00+00:00, run_after=2024-06-27T23:33:00+00:00 2024-06-27T23:32:03.779772664Z [2024-06-27T23:32:03.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:30:00+00:00 exited with status success for try_number 1 2024-06-27T23:32:03.782402394Z [2024-06-27T23:32:03.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:31:00+00:00 exited with status success for try_number 1 2024-06-27T23:32:03.818891130Z [2024-06-27T23:32:03.813+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:30:00+00:00, map_index=-1, run_start_date=2024-06-27 23:32:02.390665+00:00, run_end_date=2024-06-27 23:32:02.882796+00:00, run_duration=0.492131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=275, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:32:00.871582+00:00, queued_by_job_id=2, pid=4067 2024-06-27T23:32:03.818912006Z [2024-06-27T23:32:03.813+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:31:00+00:00, map_index=-1, run_start_date=2024-06-27 23:32:02.227609+00:00, run_end_date=2024-06-27 23:32:03.147591+00:00, run_duration=0.919982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=274, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:32:00.871582+00:00, queued_by_job_id=2, pid=4066 2024-06-27T23:32:05.791856850Z [2024-06-27T23:32:05.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:31:00+00:00 exited with status success for try_number 1 2024-06-27T23:32:05.799740351Z [2024-06-27T23:32:05.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:31:00+00:00, map_index=-1, run_start_date=2024-06-27 23:32:04.200706+00:00, run_end_date=2024-06-27 23:32:05.596055+00:00, run_duration=1.395349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=277, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:32:00.871582+00:00, queued_by_job_id=2, pid=4090 2024-06-27T23:32:06.674197769Z [2024-06-27T23:32:06.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:32:06.674786549Z [2024-06-27T23:32:06.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:31:00+00:00, run_id=scheduled__2024-06-27T23:31:00+00:00, run_start_date=2024-06-27 23:32:00.781548+00:00, run_end_date=2024-06-27 23:32:06.674417+00:00, run_duration=5.892869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:31:00+00:00, data_interval_end=2024-06-27 23:32:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:32:06.686918926Z [2024-06-27T23:32:06.686+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:32:00+00:00, run_after=2024-06-27T23:33:00+00:00 2024-06-27T23:32:06.696914450Z [2024-06-27T23:32:06.696+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:32:06.697606119Z [2024-06-27T23:32:06.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:31:00+00:00, run_id=scheduled__2024-06-27T23:31:00+00:00, run_start_date=2024-06-27 23:32:00.779859+00:00, run_end_date=2024-06-27 23:32:06.697058+00:00, run_duration=5.917199, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:31:00+00:00, data_interval_end=2024-06-27 23:32:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:32:06.710840776Z [2024-06-27T23:32:06.710+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:32:00+00:00, run_after=2024-06-27T23:33:00+00:00 2024-06-27T23:32:06.767199670Z [2024-06-27T23:32:06.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:31:00+00:00 exited with status success for try_number 1 2024-06-27T23:32:06.784704571Z [2024-06-27T23:32:06.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:31:00+00:00, map_index=-1, run_start_date=2024-06-27 23:32:04.172140+00:00, run_end_date=2024-06-27 23:32:06.022364+00:00, run_duration=1.850224, state=success, executor_state=success, try_number=1, max_tries=1, job_id=276, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:32:00.871582+00:00, queued_by_job_id=2, pid=4091 2024-06-27T23:33:00.801548064Z [2024-06-27T23:33:00.801+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:33:00+00:00, run_after=2024-06-27T23:34:00+00:00 2024-06-27T23:33:00.810349494Z [2024-06-27T23:33:00.810+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:33:00.826791103Z [2024-06-27T23:33:00.826+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:33:00+00:00, run_after=2024-06-27T23:34:00+00:00 2024-06-27T23:33:00.912960950Z [2024-06-27T23:33:00.912+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:33:00.913000178Z 2024-06-27T23:33:00.913009079Z 2024-06-27T23:33:00.913016905Z 2024-06-27T23:33:00.913618345Z [2024-06-27T23:33:00.913+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:33:00.914075141Z [2024-06-27T23:33:00.913+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:33:00.914501938Z [2024-06-27T23:33:00.914+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:33:00.916244053Z [2024-06-27T23:33:00.915+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:33:00.916287386Z 2024-06-27T23:33:00.916295411Z 2024-06-27T23:33:00.916302394Z 2024-06-27T23:33:00.925272742Z [2024-06-27T23:33:00.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:33:00.925632839Z [2024-06-27T23:33:00.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:33:00.926113483Z [2024-06-27T23:33:00.925+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:33:00.926491948Z [2024-06-27T23:33:00.926+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:33:00.926854151Z [2024-06-27T23:33:00.926+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:33:00.927103824Z [2024-06-27T23:33:00.926+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:33:01.275857854Z [2024-06-27T23:33:01.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:32:00+00:00 exited with status queued for try_number 1 2024-06-27T23:33:01.275900342Z [2024-06-27T23:33:01.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:32:00+00:00 exited with status queued for try_number 1 2024-06-27T23:33:01.275924896Z [2024-06-27T23:33:01.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:32:00+00:00 exited with status queued for try_number 1 2024-06-27T23:33:01.283834180Z [2024-06-27T23:33:01.283+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9f7951f-2ca2-4d1b-87c1-c8951e0559b7 2024-06-27T23:33:01.283883588Z [2024-06-27T23:33:01.283+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04c6006e-cba4-48c2-8609-d9ce823e19bb 2024-06-27T23:33:01.283979707Z [2024-06-27T23:33:01.283+0000] {scheduler_job.py:635} INFO - Setting external_id for to 642ffb35-349d-4e54-80f9-9f6a7385283b 2024-06-27T23:33:02.471208083Z [2024-06-27T23:33:02.470+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:33:02.471737215Z [2024-06-27T23:33:02.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:32:00+00:00, run_id=scheduled__2024-06-27T23:32:00+00:00, run_start_date=2024-06-27 23:33:00.838436+00:00, run_end_date=2024-06-27 23:33:02.471348+00:00, run_duration=1.632912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:32:00+00:00, data_interval_end=2024-06-27 23:33:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:33:02.482085147Z [2024-06-27T23:33:02.481+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:33:00+00:00, run_after=2024-06-27T23:34:00+00:00 2024-06-27T23:33:02.543166280Z [2024-06-27T23:33:02.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:32:00+00:00 exited with status success for try_number 1 2024-06-27T23:33:02.550641190Z [2024-06-27T23:33:02.550+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:32:00+00:00, map_index=-1, run_start_date=2024-06-27 23:33:01.800247+00:00, run_end_date=2024-06-27 23:33:02.200793+00:00, run_duration=0.400546, state=success, executor_state=success, try_number=1, max_tries=1, job_id=278, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:33:00.917853+00:00, queued_by_job_id=2, pid=4123 2024-06-27T23:33:06.038548976Z [2024-06-27T23:33:06.038+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:33:06.039118300Z [2024-06-27T23:33:06.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:32:00+00:00, run_id=scheduled__2024-06-27T23:32:00+00:00, run_start_date=2024-06-27 23:33:00.841442+00:00, run_end_date=2024-06-27 23:33:06.038470+00:00, run_duration=5.197028, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:32:00+00:00, data_interval_end=2024-06-27 23:33:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:33:06.051156033Z [2024-06-27T23:33:06.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:33:00+00:00, run_after=2024-06-27T23:34:00+00:00 2024-06-27T23:33:06.115368165Z [2024-06-27T23:33:06.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:32:00+00:00 exited with status success for try_number 1 2024-06-27T23:33:06.123146315Z [2024-06-27T23:33:06.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:32:00+00:00, map_index=-1, run_start_date=2024-06-27 23:33:03.156720+00:00, run_end_date=2024-06-27 23:33:04.943750+00:00, run_duration=1.78703, state=success, executor_state=success, try_number=1, max_tries=1, job_id=280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:33:00.917853+00:00, queued_by_job_id=2, pid=4142 2024-06-27T23:33:07.162334161Z [2024-06-27T23:33:07.161+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:33:07.162720666Z [2024-06-27T23:33:07.162+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:32:00+00:00, run_id=scheduled__2024-06-27T23:32:00+00:00, run_start_date=2024-06-27 23:33:00.839762+00:00, run_end_date=2024-06-27 23:33:07.162403+00:00, run_duration=6.322641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:32:00+00:00, data_interval_end=2024-06-27 23:33:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:33:07.172708264Z [2024-06-27T23:33:07.172+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:33:00+00:00, run_after=2024-06-27T23:34:00+00:00 2024-06-27T23:33:07.235720073Z [2024-06-27T23:33:07.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:32:00+00:00 exited with status success for try_number 1 2024-06-27T23:33:07.248393698Z [2024-06-27T23:33:07.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:32:00+00:00, map_index=-1, run_start_date=2024-06-27 23:33:03.009130+00:00, run_end_date=2024-06-27 23:33:06.174621+00:00, run_duration=3.165491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=279, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:33:00.917853+00:00, queued_by_job_id=2, pid=4141 2024-06-27T23:34:00.751940801Z [2024-06-27T23:34:00.751+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:34:00.764595559Z [2024-06-27T23:34:00.764+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:34:00+00:00, run_after=2024-06-27T23:35:00+00:00 2024-06-27T23:34:00.771984650Z [2024-06-27T23:34:00.771+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:34:00.783716066Z [2024-06-27T23:34:00.783+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:34:00+00:00, run_after=2024-06-27T23:35:00+00:00 2024-06-27T23:34:00.878901613Z [2024-06-27T23:34:00.878+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:34:00.878917101Z 2024-06-27T23:34:00.878921405Z 2024-06-27T23:34:00.878924770Z 2024-06-27T23:34:00.878928090Z 2024-06-27T23:34:00.880725564Z [2024-06-27T23:34:00.880+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:34:00.881498497Z [2024-06-27T23:34:00.880+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:34:00.881779915Z [2024-06-27T23:34:00.881+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:34:00.883038722Z [2024-06-27T23:34:00.881+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:34:00.883966644Z [2024-06-27T23:34:00.883+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:34:00.883978413Z 2024-06-27T23:34:00.883982589Z 2024-06-27T23:34:00.883993905Z 2024-06-27T23:34:00.883997311Z 2024-06-27T23:34:00.889728256Z [2024-06-27T23:34:00.889+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:34:00.890047322Z [2024-06-27T23:34:00.889+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:34:00.890441022Z [2024-06-27T23:34:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:34:00.891100546Z [2024-06-27T23:34:00.890+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:34:00.891540992Z [2024-06-27T23:34:00.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:34:00.891767267Z [2024-06-27T23:34:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:34:00.892130815Z [2024-06-27T23:34:00.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:34:00.892404637Z [2024-06-27T23:34:00.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:34:01.589462793Z [2024-06-27T23:34:01.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:32:00+00:00 exited with status queued for try_number 1 2024-06-27T23:34:01.589613875Z [2024-06-27T23:34:01.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:33:00+00:00 exited with status queued for try_number 1 2024-06-27T23:34:01.589736269Z [2024-06-27T23:34:01.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:33:00+00:00 exited with status queued for try_number 1 2024-06-27T23:34:01.589837195Z [2024-06-27T23:34:01.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:33:00+00:00 exited with status queued for try_number 1 2024-06-27T23:34:01.613795468Z [2024-06-27T23:34:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75f070d4-97c0-45d1-9e33-59c97e6c4309 2024-06-27T23:34:01.614079759Z [2024-06-27T23:34:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f340f44-e394-4308-a05b-c940f63b6b3d 2024-06-27T23:34:01.614461108Z [2024-06-27T23:34:01.614+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a2ef3cf-2976-4b5c-9ec7-919bfbc925e7 2024-06-27T23:34:01.614823098Z [2024-06-27T23:34:01.614+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b3f0520-2e35-4cbb-8d13-5e580dd33c67 2024-06-27T23:34:02.839784162Z [2024-06-27T23:34:02.839+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:34:02.840279911Z [2024-06-27T23:34:02.839+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:32:00+00:00, run_id=scheduled__2024-06-27T23:32:00+00:00, run_start_date=2024-06-27 23:34:00.796710+00:00, run_end_date=2024-06-27 23:34:02.839708+00:00, run_duration=2.042998, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:32:00+00:00, data_interval_end=2024-06-27 23:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:34:02.857594506Z [2024-06-27T23:34:02.857+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:34:00+00:00, run_after=2024-06-27T23:36:00+00:00 2024-06-27T23:34:04.052076416Z [2024-06-27T23:34:04.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:34:04.052225534Z [2024-06-27T23:34:04.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:33:00+00:00, run_id=scheduled__2024-06-27T23:33:00+00:00, run_start_date=2024-06-27 23:34:00.798141+00:00, run_end_date=2024-06-27 23:34:04.051977+00:00, run_duration=3.253836, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:33:00+00:00, data_interval_end=2024-06-27 23:34:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:34:04.071476863Z [2024-06-27T23:34:04.069+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:34:00+00:00, run_after=2024-06-27T23:35:00+00:00 2024-06-27T23:34:04.168925089Z [2024-06-27T23:34:04.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:32:00+00:00 exited with status success for try_number 1 2024-06-27T23:34:04.171204617Z [2024-06-27T23:34:04.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:33:00+00:00 exited with status success for try_number 1 2024-06-27T23:34:04.183293646Z [2024-06-27T23:34:04.182+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:32:00+00:00, map_index=-1, run_start_date=2024-06-27 23:34:02.291871+00:00, run_end_date=2024-06-27 23:34:02.773242+00:00, run_duration=0.481371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=281, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:34:00.885283+00:00, queued_by_job_id=2, pid=4176 2024-06-27T23:34:04.183598647Z [2024-06-27T23:34:04.183+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:33:00+00:00, map_index=-1, run_start_date=2024-06-27 23:34:02.395214+00:00, run_end_date=2024-06-27 23:34:02.897379+00:00, run_duration=0.502165, state=success, executor_state=success, try_number=1, max_tries=1, job_id=282, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:34:00.885283+00:00, queued_by_job_id=2, pid=4177 2024-06-27T23:34:06.288375473Z [2024-06-27T23:34:06.287+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:34:06.290008129Z [2024-06-27T23:34:06.289+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:33:00+00:00, run_id=scheduled__2024-06-27T23:33:00+00:00, run_start_date=2024-06-27 23:34:00.799397+00:00, run_end_date=2024-06-27 23:34:06.288273+00:00, run_duration=5.488876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:33:00+00:00, data_interval_end=2024-06-27 23:34:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:34:06.305431115Z [2024-06-27T23:34:06.305+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:34:00+00:00, run_after=2024-06-27T23:35:00+00:00 2024-06-27T23:34:06.319361711Z [2024-06-27T23:34:06.318+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:34:06.319732393Z [2024-06-27T23:34:06.319+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:33:00+00:00, run_id=scheduled__2024-06-27T23:33:00+00:00, run_start_date=2024-06-27 23:34:00.800454+00:00, run_end_date=2024-06-27 23:34:06.319290+00:00, run_duration=5.518836, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:33:00+00:00, data_interval_end=2024-06-27 23:34:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:34:06.341050283Z [2024-06-27T23:34:06.340+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:34:00+00:00, run_after=2024-06-27T23:35:00+00:00 2024-06-27T23:34:06.383676165Z [2024-06-27T23:34:06.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:33:00+00:00 exited with status success for try_number 1 2024-06-27T23:34:06.385335499Z [2024-06-27T23:34:06.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:33:00+00:00 exited with status success for try_number 1 2024-06-27T23:34:06.402149477Z [2024-06-27T23:34:06.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:33:00+00:00, map_index=-1, run_start_date=2024-06-27 23:34:03.640565+00:00, run_end_date=2024-06-27 23:34:05.248046+00:00, run_duration=1.607481, state=success, executor_state=success, try_number=1, max_tries=1, job_id=283, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:34:00.885283+00:00, queued_by_job_id=2, pid=4200 2024-06-27T23:34:06.402169767Z [2024-06-27T23:34:06.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:33:00+00:00, map_index=-1, run_start_date=2024-06-27 23:34:03.660462+00:00, run_end_date=2024-06-27 23:34:05.636372+00:00, run_duration=1.97591, state=success, executor_state=success, try_number=1, max_tries=1, job_id=284, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:34:00.885283+00:00, queued_by_job_id=2, pid=4201 2024-06-27T23:35:00.246606593Z [2024-06-27T23:35:00.246+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:35:00+00:00, run_after=2024-06-27T23:40:00+00:00 2024-06-27T23:35:00.286344466Z [2024-06-27T23:35:00.285+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:35:00+00:00, run_after=2024-06-27T23:36:00+00:00 2024-06-27T23:35:00.298463446Z [2024-06-27T23:35:00.298+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:35:00.311802377Z [2024-06-27T23:35:00.311+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:35:00+00:00, run_after=2024-06-27T23:36:00+00:00 2024-06-27T23:35:00.390459596Z [2024-06-27T23:35:00.390+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:35:00.390506163Z 2024-06-27T23:35:00.390511801Z 2024-06-27T23:35:00.390515283Z 2024-06-27T23:35:00.390518523Z 2024-06-27T23:35:00.390585254Z [2024-06-27T23:35:00.390+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:35:00.390798571Z [2024-06-27T23:35:00.390+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:35:00.390965942Z [2024-06-27T23:35:00.390+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:35:00.391078193Z [2024-06-27T23:35:00.390+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:35:00.392431465Z [2024-06-27T23:35:00.392+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:35:00.392442910Z 2024-06-27T23:35:00.392446909Z 2024-06-27T23:35:00.392450225Z 2024-06-27T23:35:00.392454163Z 2024-06-27T23:35:00.397602581Z [2024-06-27T23:35:00.397+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T23:35:00.398034008Z [2024-06-27T23:35:00.397+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:35:00.399449673Z [2024-06-27T23:35:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:35:00.399462784Z [2024-06-27T23:35:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:35:00.399546526Z [2024-06-27T23:35:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:35:00.399657739Z [2024-06-27T23:35:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:35:00.399970447Z [2024-06-27T23:35:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:35:00.399983430Z [2024-06-27T23:35:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:35:00.917525264Z [2024-06-27T23:35:00.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:30:00+00:00 exited with status queued for try_number 1 2024-06-27T23:35:00.917831053Z [2024-06-27T23:35:00.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:34:00+00:00 exited with status queued for try_number 1 2024-06-27T23:35:00.918042222Z [2024-06-27T23:35:00.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:34:00+00:00 exited with status queued for try_number 1 2024-06-27T23:35:00.918194138Z [2024-06-27T23:35:00.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:34:00+00:00 exited with status queued for try_number 1 2024-06-27T23:35:00.932829980Z [2024-06-27T23:35:00.932+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68c8224a-97ff-45c0-984a-52f70adebe9f 2024-06-27T23:35:00.933316869Z [2024-06-27T23:35:00.932+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0af3a1a4-d3e5-4e69-96e2-85f75bb0e000 2024-06-27T23:35:00.933667484Z [2024-06-27T23:35:00.933+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0af4155d-2420-4ae1-92a5-e80c880a8926 2024-06-27T23:35:00.933973304Z [2024-06-27T23:35:00.933+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15871f7d-3477-4cdc-a316-fcc9401ef4b9 2024-06-27T23:35:02.580267107Z [2024-06-27T23:35:02.579+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:35:02.580750714Z [2024-06-27T23:35:02.580+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:34:00+00:00, run_id=scheduled__2024-06-27T23:34:00+00:00, run_start_date=2024-06-27 23:35:00.325549+00:00, run_end_date=2024-06-27 23:35:02.580202+00:00, run_duration=2.254653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:34:00+00:00, data_interval_end=2024-06-27 23:35:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:35:02.594592239Z [2024-06-27T23:35:02.594+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:35:00+00:00, run_after=2024-06-27T23:36:00+00:00 2024-06-27T23:35:02.701731550Z [2024-06-27T23:35:02.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:34:00+00:00 exited with status success for try_number 1 2024-06-27T23:35:02.715846752Z [2024-06-27T23:35:02.715+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:34:00+00:00, map_index=-1, run_start_date=2024-06-27 23:35:01.910753+00:00, run_end_date=2024-06-27 23:35:02.389334+00:00, run_duration=0.478581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=285, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:35:00.393670+00:00, queued_by_job_id=2, pid=4235 2024-06-27T23:35:05.042670821Z [2024-06-27T23:35:05.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:35:05.042921011Z [2024-06-27T23:35:05.042+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:34:00+00:00, run_id=scheduled__2024-06-27T23:34:00+00:00, run_start_date=2024-06-27 23:35:00.326966+00:00, run_end_date=2024-06-27 23:35:05.042618+00:00, run_duration=4.715652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:34:00+00:00, data_interval_end=2024-06-27 23:35:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:35:05.055210885Z [2024-06-27T23:35:05.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:35:00+00:00, run_after=2024-06-27T23:36:00+00:00 2024-06-27T23:35:05.097867927Z [2024-06-27T23:35:05.097+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:35:05.097892161Z 2024-06-27T23:35:05.097914929Z [2024-06-27T23:35:05.097+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:35:05.098475071Z [2024-06-27T23:35:05.098+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:35:05.098484919Z 2024-06-27T23:35:05.108843916Z [2024-06-27T23:35:05.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-27T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T23:35:05.108864723Z [2024-06-27T23:35:05.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-27T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:35:05.268133690Z [2024-06-27T23:35:05.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:30:00+00:00 exited with status queued for try_number 1 2024-06-27T23:35:05.268150853Z [2024-06-27T23:35:05.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:30:00+00:00 exited with status success for try_number 1 2024-06-27T23:35:05.268233646Z [2024-06-27T23:35:05.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:34:00+00:00 exited with status success for try_number 1 2024-06-27T23:35:05.287618502Z [2024-06-27T23:35:05.287+0000] {scheduler_job.py:635} INFO - Setting external_id for to eed19484-0945-49cd-b5e1-271c8516d03e 2024-06-27T23:35:05.287713027Z [2024-06-27T23:35:05.287+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T23:30:00+00:00, map_index=-1, run_start_date=2024-06-27 23:35:03.737199+00:00, run_end_date=2024-06-27 23:35:04.552046+00:00, run_duration=0.814847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=288, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:35:00.393670+00:00, queued_by_job_id=2, pid=4271 2024-06-27T23:35:05.288085393Z [2024-06-27T23:35:05.287+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:34:00+00:00, map_index=-1, run_start_date=2024-06-27 23:35:03.289076+00:00, run_end_date=2024-06-27 23:35:04.835485+00:00, run_duration=1.546409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=286, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:35:00.393670+00:00, queued_by_job_id=2, pid=4254 2024-06-27T23:35:05.346249262Z [2024-06-27T23:35:05.345+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:35:05.346628053Z [2024-06-27T23:35:05.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:34:00+00:00, run_id=scheduled__2024-06-27T23:34:00+00:00, run_start_date=2024-06-27 23:35:00.328095+00:00, run_end_date=2024-06-27 23:35:05.346155+00:00, run_duration=5.01806, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:34:00+00:00, data_interval_end=2024-06-27 23:35:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:35:05.355214721Z [2024-06-27T23:35:05.354+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:35:00+00:00, run_after=2024-06-27T23:36:00+00:00 2024-06-27T23:35:05.457654915Z [2024-06-27T23:35:05.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:34:00+00:00 exited with status success for try_number 1 2024-06-27T23:35:05.464665549Z [2024-06-27T23:35:05.464+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:34:00+00:00, map_index=-1, run_start_date=2024-06-27 23:35:03.359930+00:00, run_end_date=2024-06-27 23:35:05.245700+00:00, run_duration=1.88577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=287, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:35:00.393670+00:00, queued_by_job_id=2, pid=4255 2024-06-27T23:35:08.200437718Z [2024-06-27T23:35:08.200+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:35:08.200456508Z 2024-06-27T23:35:08.200761927Z [2024-06-27T23:35:08.200+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:35:08.201643310Z [2024-06-27T23:35:08.201+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:35:08.201653647Z 2024-06-27T23:35:08.204123813Z [2024-06-27T23:35:08.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-27T23:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T23:35:08.204375519Z [2024-06-27T23:35:08.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-27T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T23:35:08.264233573Z [2024-06-27T23:35:08.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:30:00+00:00 exited with status queued for try_number 1 2024-06-27T23:35:08.264272327Z [2024-06-27T23:35:08.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:30:00+00:00 exited with status success for try_number 1 2024-06-27T23:35:08.270336025Z [2024-06-27T23:35:08.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to 581f60c9-5830-4bde-8db6-7f724661dd05 2024-06-27T23:35:08.270421491Z [2024-06-27T23:35:08.270+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-27T23:30:00+00:00, map_index=-1, run_start_date=2024-06-27 23:35:07.441247+00:00, run_end_date=2024-06-27 23:35:07.866843+00:00, run_duration=0.425596, state=success, executor_state=success, try_number=1, max_tries=1, job_id=289, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:35:05.099074+00:00, queued_by_job_id=2, pid=4284 2024-06-27T23:35:10.577855126Z [2024-06-27T23:35:10.577+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:35:10.577868372Z 2024-06-27T23:35:10.578337504Z [2024-06-27T23:35:10.578+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:35:10.579182079Z [2024-06-27T23:35:10.578+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:35:10.579195723Z 2024-06-27T23:35:10.581975800Z [2024-06-27T23:35:10.581+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-27T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:35:10.582467101Z [2024-06-27T23:35:10.582+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-27T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:35:10.655826469Z [2024-06-27T23:35:10.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:30:00+00:00 exited with status queued for try_number 1 2024-06-27T23:35:10.655886828Z [2024-06-27T23:35:10.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:30:00+00:00 exited with status success for try_number 1 2024-06-27T23:35:10.665284373Z [2024-06-27T23:35:10.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4413f041-fe50-4f60-8239-faef3a3ea86e 2024-06-27T23:35:10.665413662Z [2024-06-27T23:35:10.665+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-27T23:30:00+00:00, map_index=0, run_start_date=2024-06-27 23:35:10.023874+00:00, run_end_date=2024-06-27 23:35:10.441324+00:00, run_duration=0.41745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=290, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:35:08.202145+00:00, queued_by_job_id=2, pid=4292 2024-06-27T23:35:13.982778807Z [2024-06-27T23:35:13.982+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:35:13.983130992Z [2024-06-27T23:35:13.982+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:30:00+00:00, run_id=scheduled__2024-06-27T23:30:00+00:00, run_start_date=2024-06-27 23:35:00.323990+00:00, run_end_date=2024-06-27 23:35:13.982567+00:00, run_duration=13.658577, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:30:00+00:00, data_interval_end=2024-06-27 23:35:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-27T23:35:13.995867896Z [2024-06-27T23:35:13.995+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:35:00+00:00, run_after=2024-06-27T23:40:00+00:00 2024-06-27T23:35:14.049960806Z [2024-06-27T23:35:14.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:30:00+00:00 exited with status success for try_number 1 2024-06-27T23:35:14.059457684Z [2024-06-27T23:35:14.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-27T23:30:00+00:00, map_index=-1, run_start_date=2024-06-27 23:35:12.362015+00:00, run_end_date=2024-06-27 23:35:12.898671+00:00, run_duration=0.536656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=291, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:35:10.579676+00:00, queued_by_job_id=2, pid=4300 2024-06-27T23:36:00.761575394Z [2024-06-27T23:36:00.761+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:36:00+00:00, run_after=2024-06-27T23:37:00+00:00 2024-06-27T23:36:00.772786365Z [2024-06-27T23:36:00.772+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:36:00.781952330Z [2024-06-27T23:36:00.781+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:36:00.795532513Z [2024-06-27T23:36:00.795+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:36:00+00:00, run_after=2024-06-27T23:37:00+00:00 2024-06-27T23:36:00.883038250Z [2024-06-27T23:36:00.882+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:36:00.883064406Z 2024-06-27T23:36:00.883069277Z 2024-06-27T23:36:00.883072985Z 2024-06-27T23:36:00.883076532Z 2024-06-27T23:36:00.883113398Z [2024-06-27T23:36:00.882+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:36:00.883122244Z [2024-06-27T23:36:00.883+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:36:00.883223616Z [2024-06-27T23:36:00.883+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:36:00.883284669Z [2024-06-27T23:36:00.883+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:36:00.883834098Z [2024-06-27T23:36:00.883+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:36:00.883854617Z 2024-06-27T23:36:00.883860978Z 2024-06-27T23:36:00.883866099Z 2024-06-27T23:36:00.883870975Z 2024-06-27T23:36:00.887782495Z [2024-06-27T23:36:00.887+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:36:00.887835967Z [2024-06-27T23:36:00.887+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:36:00.888056655Z [2024-06-27T23:36:00.887+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:36:00.888131758Z [2024-06-27T23:36:00.888+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:36:00.888290027Z [2024-06-27T23:36:00.888+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:36:00.888387189Z [2024-06-27T23:36:00.888+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:36:00.888569888Z [2024-06-27T23:36:00.888+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:36:00.888646279Z [2024-06-27T23:36:00.888+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:36:01.259264104Z [2024-06-27T23:36:01.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:34:00+00:00 exited with status queued for try_number 1 2024-06-27T23:36:01.259431688Z [2024-06-27T23:36:01.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:35:00+00:00 exited with status queued for try_number 1 2024-06-27T23:36:01.259628066Z [2024-06-27T23:36:01.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:35:00+00:00 exited with status queued for try_number 1 2024-06-27T23:36:01.259765650Z [2024-06-27T23:36:01.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:35:00+00:00 exited with status queued for try_number 1 2024-06-27T23:36:01.276008973Z [2024-06-27T23:36:01.275+0000] {scheduler_job.py:635} INFO - Setting external_id for to 191dd012-eedc-40cd-a63e-edff6de6b859 2024-06-27T23:36:01.276094719Z [2024-06-27T23:36:01.275+0000] {scheduler_job.py:635} INFO - Setting external_id for to deeeda79-831c-43f9-aa41-aae0f77f4890 2024-06-27T23:36:01.276213122Z [2024-06-27T23:36:01.276+0000] {scheduler_job.py:635} INFO - Setting external_id for to 785004bf-3f16-421c-8029-f6289747e546 2024-06-27T23:36:01.276300962Z [2024-06-27T23:36:01.276+0000] {scheduler_job.py:635} INFO - Setting external_id for to cea87dcf-b335-477d-98a1-0d1fdfb98464 2024-06-27T23:36:02.506134773Z [2024-06-27T23:36:02.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:36:02.506532474Z [2024-06-27T23:36:02.506+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:34:00+00:00, run_id=scheduled__2024-06-27T23:34:00+00:00, run_start_date=2024-06-27 23:36:00.806468+00:00, run_end_date=2024-06-27 23:36:02.506049+00:00, run_duration=1.699581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:34:00+00:00, data_interval_end=2024-06-27 23:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:36:02.515186802Z [2024-06-27T23:36:02.514+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:36:00+00:00, run_after=2024-06-27T23:38:00+00:00 2024-06-27T23:36:02.580545997Z [2024-06-27T23:36:02.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:34:00+00:00 exited with status success for try_number 1 2024-06-27T23:36:02.593103929Z [2024-06-27T23:36:02.592+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:34:00+00:00, map_index=-1, run_start_date=2024-06-27 23:36:01.722026+00:00, run_end_date=2024-06-27 23:36:02.354990+00:00, run_duration=0.632964, state=success, executor_state=success, try_number=1, max_tries=1, job_id=292, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:36:00.884631+00:00, queued_by_job_id=2, pid=4318 2024-06-27T23:36:03.672224929Z [2024-06-27T23:36:03.671+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:36:03.672894132Z [2024-06-27T23:36:03.672+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:35:00+00:00, run_id=scheduled__2024-06-27T23:35:00+00:00, run_start_date=2024-06-27 23:36:00.807852+00:00, run_end_date=2024-06-27 23:36:03.672140+00:00, run_duration=2.864288, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:35:00+00:00, data_interval_end=2024-06-27 23:36:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:36:03.684090176Z [2024-06-27T23:36:03.683+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:36:00+00:00, run_after=2024-06-27T23:37:00+00:00 2024-06-27T23:36:03.776478411Z [2024-06-27T23:36:03.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:35:00+00:00 exited with status success for try_number 1 2024-06-27T23:36:03.785475368Z [2024-06-27T23:36:03.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:35:00+00:00, map_index=-1, run_start_date=2024-06-27 23:36:02.194459+00:00, run_end_date=2024-06-27 23:36:02.716016+00:00, run_duration=0.521557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=293, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:36:00.884631+00:00, queued_by_job_id=2, pid=4327 2024-06-27T23:36:04.860249981Z [2024-06-27T23:36:04.859+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:36:04.860556851Z [2024-06-27T23:36:04.860+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:35:00+00:00, run_id=scheduled__2024-06-27T23:35:00+00:00, run_start_date=2024-06-27 23:36:00.809109+00:00, run_end_date=2024-06-27 23:36:04.860146+00:00, run_duration=4.051037, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:35:00+00:00, data_interval_end=2024-06-27 23:36:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:36:04.869640294Z [2024-06-27T23:36:04.869+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:36:00+00:00, run_after=2024-06-27T23:37:00+00:00 2024-06-27T23:36:04.911992282Z [2024-06-27T23:36:04.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:35:00+00:00 exited with status success for try_number 1 2024-06-27T23:36:04.916757998Z [2024-06-27T23:36:04.916+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:35:00+00:00, map_index=-1, run_start_date=2024-06-27 23:36:03.392669+00:00, run_end_date=2024-06-27 23:36:04.672249+00:00, run_duration=1.27958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=294, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:36:00.884631+00:00, queued_by_job_id=2, pid=4347 2024-06-27T23:36:05.713085216Z [2024-06-27T23:36:05.712+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:36:05.713473902Z [2024-06-27T23:36:05.712+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:35:00+00:00, run_id=scheduled__2024-06-27T23:35:00+00:00, run_start_date=2024-06-27 23:36:00.810502+00:00, run_end_date=2024-06-27 23:36:05.712878+00:00, run_duration=4.902376, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:35:00+00:00, data_interval_end=2024-06-27 23:36:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:36:05.722334938Z [2024-06-27T23:36:05.722+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:36:00+00:00, run_after=2024-06-27T23:37:00+00:00 2024-06-27T23:36:05.756625605Z [2024-06-27T23:36:05.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:35:00+00:00 exited with status success for try_number 1 2024-06-27T23:36:05.761771425Z [2024-06-27T23:36:05.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:35:00+00:00, map_index=-1, run_start_date=2024-06-27 23:36:03.427843+00:00, run_end_date=2024-06-27 23:36:05.262219+00:00, run_duration=1.834376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:36:00.884631+00:00, queued_by_job_id=2, pid=4348 2024-06-27T23:36:44.833869739Z [2024-06-27T23:36:44.833+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T23:37:00.738865679Z [2024-06-27T23:37:00.738+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:37:00.755332022Z [2024-06-27T23:37:00.754+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:37:00+00:00, run_after=2024-06-27T23:38:00+00:00 2024-06-27T23:37:00.773278664Z [2024-06-27T23:37:00.772+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:37:00+00:00, run_after=2024-06-27T23:38:00+00:00 2024-06-27T23:37:00.862334398Z [2024-06-27T23:37:00.861+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:37:00.862371642Z 2024-06-27T23:37:00.862377813Z 2024-06-27T23:37:00.862383190Z 2024-06-27T23:37:00.862767167Z [2024-06-27T23:37:00.862+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:37:00.863156689Z [2024-06-27T23:37:00.862+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:37:00.863444487Z [2024-06-27T23:37:00.863+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:37:00.864104010Z [2024-06-27T23:37:00.863+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:37:00.864117196Z 2024-06-27T23:37:00.864121111Z 2024-06-27T23:37:00.864124349Z 2024-06-27T23:37:00.868606188Z [2024-06-27T23:37:00.868+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:37:00.868789528Z [2024-06-27T23:37:00.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:37:00.869078722Z [2024-06-27T23:37:00.868+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:37:00.869340031Z [2024-06-27T23:37:00.869+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:37:00.869709376Z [2024-06-27T23:37:00.869+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:37:00.869925600Z [2024-06-27T23:37:00.869+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:37:01.117028438Z [2024-06-27T23:37:01.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:36:00+00:00 exited with status queued for try_number 1 2024-06-27T23:37:01.117137850Z [2024-06-27T23:37:01.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:36:00+00:00 exited with status queued for try_number 1 2024-06-27T23:37:01.117260529Z [2024-06-27T23:37:01.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:36:00+00:00 exited with status queued for try_number 1 2024-06-27T23:37:01.135511989Z [2024-06-27T23:37:01.135+0000] {scheduler_job.py:635} INFO - Setting external_id for to 331433a5-f980-41fa-9453-4c79b6c1c191 2024-06-27T23:37:01.137971991Z [2024-06-27T23:37:01.137+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7765e63-5da9-4cc7-b341-b70990c9a2a2 2024-06-27T23:37:01.138124491Z [2024-06-27T23:37:01.137+0000] {scheduler_job.py:635} INFO - Setting external_id for to af8e95ca-f07b-4d6a-9b15-3ea3ac51bcda 2024-06-27T23:37:02.487218553Z [2024-06-27T23:37:02.486+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:37:02.487598327Z [2024-06-27T23:37:02.487+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:36:00+00:00, run_id=scheduled__2024-06-27T23:36:00+00:00, run_start_date=2024-06-27 23:37:00.786831+00:00, run_end_date=2024-06-27 23:37:02.487172+00:00, run_duration=1.700341, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:36:00+00:00, data_interval_end=2024-06-27 23:37:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:37:02.499368759Z [2024-06-27T23:37:02.499+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:37:00+00:00, run_after=2024-06-27T23:38:00+00:00 2024-06-27T23:37:02.537029455Z [2024-06-27T23:37:02.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:36:00+00:00 exited with status success for try_number 1 2024-06-27T23:37:02.543416451Z [2024-06-27T23:37:02.543+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:36:00+00:00, map_index=-1, run_start_date=2024-06-27 23:37:01.778329+00:00, run_end_date=2024-06-27 23:37:02.165507+00:00, run_duration=0.387178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=296, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:37:00.865358+00:00, queued_by_job_id=2, pid=4380 2024-06-27T23:37:04.768166299Z [2024-06-27T23:37:04.767+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:37:04.768529800Z [2024-06-27T23:37:04.768+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:36:00+00:00, run_id=scheduled__2024-06-27T23:36:00+00:00, run_start_date=2024-06-27 23:37:00.788289+00:00, run_end_date=2024-06-27 23:37:04.768107+00:00, run_duration=3.979818, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:36:00+00:00, data_interval_end=2024-06-27 23:37:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:37:04.846141501Z [2024-06-27T23:37:04.845+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:37:00+00:00, run_after=2024-06-27T23:38:00+00:00 2024-06-27T23:37:04.916565667Z [2024-06-27T23:37:04.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:36:00+00:00 exited with status success for try_number 1 2024-06-27T23:37:04.948213135Z [2024-06-27T23:37:04.947+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:36:00+00:00, map_index=-1, run_start_date=2024-06-27 23:37:02.919080+00:00, run_end_date=2024-06-27 23:37:04.272322+00:00, run_duration=1.353242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=297, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:37:00.865358+00:00, queued_by_job_id=2, pid=4398 2024-06-27T23:37:07.125692177Z [2024-06-27T23:37:07.125+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:37:07.126564019Z [2024-06-27T23:37:07.126+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:36:00+00:00, run_id=scheduled__2024-06-27T23:36:00+00:00, run_start_date=2024-06-27 23:37:00.789500+00:00, run_end_date=2024-06-27 23:37:07.125590+00:00, run_duration=6.33609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:36:00+00:00, data_interval_end=2024-06-27 23:37:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:37:07.146796866Z [2024-06-27T23:37:07.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:37:00+00:00, run_after=2024-06-27T23:38:00+00:00 2024-06-27T23:37:07.187763424Z [2024-06-27T23:37:07.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:36:00+00:00 exited with status success for try_number 1 2024-06-27T23:37:07.193093433Z [2024-06-27T23:37:07.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:36:00+00:00, map_index=-1, run_start_date=2024-06-27 23:37:03.017147+00:00, run_end_date=2024-06-27 23:37:06.267047+00:00, run_duration=3.2499, state=success, executor_state=success, try_number=1, max_tries=1, job_id=298, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:37:00.865358+00:00, queued_by_job_id=2, pid=4399 2024-06-27T23:38:00.570395914Z [2024-06-27T23:38:00.569+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:38:00+00:00, run_after=2024-06-27T23:39:00+00:00 2024-06-27T23:38:00.584399777Z [2024-06-27T23:38:00.583+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:38:00.605595652Z [2024-06-27T23:38:00.605+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:38:00+00:00, run_after=2024-06-27T23:39:00+00:00 2024-06-27T23:38:00.621783615Z [2024-06-27T23:38:00.621+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:38:00.733606145Z [2024-06-27T23:38:00.733+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:38:00.733628523Z 2024-06-27T23:38:00.733648601Z 2024-06-27T23:38:00.733652173Z 2024-06-27T23:38:00.733655821Z 2024-06-27T23:38:00.733853748Z [2024-06-27T23:38:00.733+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:38:00.734078606Z [2024-06-27T23:38:00.733+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:38:00.734341184Z [2024-06-27T23:38:00.734+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:38:00.734660590Z [2024-06-27T23:38:00.734+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:38:00.735738446Z [2024-06-27T23:38:00.735+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:38:00.735750170Z 2024-06-27T23:38:00.735754083Z 2024-06-27T23:38:00.735757423Z 2024-06-27T23:38:00.735760723Z 2024-06-27T23:38:00.739684923Z [2024-06-27T23:38:00.739+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:38:00.739842264Z [2024-06-27T23:38:00.739+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:38:00.740058771Z [2024-06-27T23:38:00.739+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:38:00.740222979Z [2024-06-27T23:38:00.739+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:38:00.740499546Z [2024-06-27T23:38:00.740+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:38:00.740723203Z [2024-06-27T23:38:00.740+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:38:00.741089000Z [2024-06-27T23:38:00.740+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:38:00.741234115Z [2024-06-27T23:38:00.741+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:38:01.309104887Z [2024-06-27T23:38:01.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:36:00+00:00 exited with status queued for try_number 1 2024-06-27T23:38:01.311079439Z [2024-06-27T23:38:01.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:37:00+00:00 exited with status queued for try_number 1 2024-06-27T23:38:01.311341694Z [2024-06-27T23:38:01.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:37:00+00:00 exited with status queued for try_number 1 2024-06-27T23:38:01.311519943Z [2024-06-27T23:38:01.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:37:00+00:00 exited with status queued for try_number 1 2024-06-27T23:38:01.324215963Z [2024-06-27T23:38:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26d36be2-2ff2-4294-ac1a-8decb746343c 2024-06-27T23:38:01.324995391Z [2024-06-27T23:38:01.324+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3d2729d-76b3-4501-84f6-8309429a1d12 2024-06-27T23:38:01.325354654Z [2024-06-27T23:38:01.325+0000] {scheduler_job.py:635} INFO - Setting external_id for to 215666df-151c-41dc-8152-3b8f014fbc64 2024-06-27T23:38:01.325549566Z [2024-06-27T23:38:01.325+0000] {scheduler_job.py:635} INFO - Setting external_id for to d587422f-f5da-4a53-8389-ece0b429d7f8 2024-06-27T23:38:02.645606407Z [2024-06-27T23:38:02.645+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:38:02.646002635Z [2024-06-27T23:38:02.645+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:36:00+00:00, run_id=scheduled__2024-06-27T23:36:00+00:00, run_start_date=2024-06-27 23:38:00.637732+00:00, run_end_date=2024-06-27 23:38:02.645474+00:00, run_duration=2.007742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:36:00+00:00, data_interval_end=2024-06-27 23:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:38:02.655622594Z [2024-06-27T23:38:02.655+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:38:00+00:00, run_after=2024-06-27T23:40:00+00:00 2024-06-27T23:38:02.664858719Z [2024-06-27T23:38:02.664+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:38:02.665406363Z [2024-06-27T23:38:02.665+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:37:00+00:00, run_id=scheduled__2024-06-27T23:37:00+00:00, run_start_date=2024-06-27 23:38:00.639640+00:00, run_end_date=2024-06-27 23:38:02.665077+00:00, run_duration=2.025437, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:37:00+00:00, data_interval_end=2024-06-27 23:38:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:38:02.674645785Z [2024-06-27T23:38:02.674+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:38:00+00:00, run_after=2024-06-27T23:39:00+00:00 2024-06-27T23:38:02.740528138Z [2024-06-27T23:38:02.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:36:00+00:00 exited with status success for try_number 1 2024-06-27T23:38:02.740617738Z [2024-06-27T23:38:02.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:37:00+00:00 exited with status success for try_number 1 2024-06-27T23:38:02.747500824Z [2024-06-27T23:38:02.747+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:36:00+00:00, map_index=-1, run_start_date=2024-06-27 23:38:01.882393+00:00, run_end_date=2024-06-27 23:38:02.437990+00:00, run_duration=0.555597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=299, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:38:00.736900+00:00, queued_by_job_id=2, pid=4432 2024-06-27T23:38:02.747732707Z [2024-06-27T23:38:02.747+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:37:00+00:00, map_index=-1, run_start_date=2024-06-27 23:38:01.990725+00:00, run_end_date=2024-06-27 23:38:02.452774+00:00, run_duration=0.462049, state=success, executor_state=success, try_number=1, max_tries=1, job_id=300, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:38:00.736900+00:00, queued_by_job_id=2, pid=4433 2024-06-27T23:38:06.064019701Z [2024-06-27T23:38:06.063+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:38:06.064367444Z [2024-06-27T23:38:06.064+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:37:00+00:00, run_id=scheduled__2024-06-27T23:37:00+00:00, run_start_date=2024-06-27 23:38:00.642658+00:00, run_end_date=2024-06-27 23:38:06.064067+00:00, run_duration=5.421409, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:37:00+00:00, data_interval_end=2024-06-27 23:38:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:38:06.092024719Z [2024-06-27T23:38:06.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:38:00+00:00, run_after=2024-06-27T23:39:00+00:00 2024-06-27T23:38:06.119658807Z [2024-06-27T23:38:06.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:38:06.119986244Z [2024-06-27T23:38:06.119+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:37:00+00:00, run_id=scheduled__2024-06-27T23:37:00+00:00, run_start_date=2024-06-27 23:38:00.641223+00:00, run_end_date=2024-06-27 23:38:06.119687+00:00, run_duration=5.478464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:37:00+00:00, data_interval_end=2024-06-27 23:38:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:38:06.146190262Z [2024-06-27T23:38:06.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:38:00+00:00, run_after=2024-06-27T23:39:00+00:00 2024-06-27T23:38:06.198866746Z [2024-06-27T23:38:06.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:37:00+00:00 exited with status success for try_number 1 2024-06-27T23:38:06.198894674Z [2024-06-27T23:38:06.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:37:00+00:00 exited with status success for try_number 1 2024-06-27T23:38:06.208642475Z [2024-06-27T23:38:06.208+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:37:00+00:00, map_index=-1, run_start_date=2024-06-27 23:38:03.304709+00:00, run_end_date=2024-06-27 23:38:05.103759+00:00, run_duration=1.79905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=301, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:38:00.736900+00:00, queued_by_job_id=2, pid=4456 2024-06-27T23:38:06.208853008Z [2024-06-27T23:38:06.208+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:37:00+00:00, map_index=-1, run_start_date=2024-06-27 23:38:03.472670+00:00, run_end_date=2024-06-27 23:38:04.782285+00:00, run_duration=1.309615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=302, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:38:00.736900+00:00, queued_by_job_id=2, pid=4457 2024-06-27T23:39:01.034903965Z [2024-06-27T23:39:01.034+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:39:00+00:00, run_after=2024-06-27T23:40:00+00:00 2024-06-27T23:39:01.049341623Z [2024-06-27T23:39:01.048+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:39:00+00:00, run_after=2024-06-27T23:40:00+00:00 2024-06-27T23:39:01.057187335Z [2024-06-27T23:39:01.056+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:39:01.146065269Z [2024-06-27T23:39:01.145+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:39:01.146089299Z 2024-06-27T23:39:01.146092740Z 2024-06-27T23:39:01.146114793Z 2024-06-27T23:39:01.146127104Z [2024-06-27T23:39:01.145+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:39:01.146192702Z [2024-06-27T23:39:01.145+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:39:01.146235292Z [2024-06-27T23:39:01.146+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:39:01.146809154Z [2024-06-27T23:39:01.146+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:39:01.146827803Z 2024-06-27T23:39:01.146831642Z 2024-06-27T23:39:01.146835106Z 2024-06-27T23:39:01.150793693Z [2024-06-27T23:39:01.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:39:01.150806706Z [2024-06-27T23:39:01.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:39:01.150810001Z [2024-06-27T23:39:01.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:39:01.150813373Z [2024-06-27T23:39:01.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:39:01.150816411Z [2024-06-27T23:39:01.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:39:01.150819481Z [2024-06-27T23:39:01.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:39:01.449938964Z [2024-06-27T23:39:01.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:38:00+00:00 exited with status queued for try_number 1 2024-06-27T23:39:01.452169854Z [2024-06-27T23:39:01.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:38:00+00:00 exited with status queued for try_number 1 2024-06-27T23:39:01.452387680Z [2024-06-27T23:39:01.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:38:00+00:00 exited with status queued for try_number 1 2024-06-27T23:39:01.463226126Z [2024-06-27T23:39:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfa355b7-f2c2-472d-ad49-2298266b5982 2024-06-27T23:39:01.463466547Z [2024-06-27T23:39:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to df8195ee-310f-4b8d-8cdf-a614ffb93e52 2024-06-27T23:39:01.463676814Z [2024-06-27T23:39:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0efbc2f-e3ca-498b-855e-3d3b50bf59e6 2024-06-27T23:39:03.404103940Z [2024-06-27T23:39:03.403+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:39:03.404312458Z [2024-06-27T23:39:03.404+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:38:00+00:00, run_id=scheduled__2024-06-27T23:38:00+00:00, run_start_date=2024-06-27 23:39:01.068068+00:00, run_end_date=2024-06-27 23:39:03.403939+00:00, run_duration=2.335871, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:38:00+00:00, data_interval_end=2024-06-27 23:39:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:39:03.416828818Z [2024-06-27T23:39:03.416+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:39:00+00:00, run_after=2024-06-27T23:40:00+00:00 2024-06-27T23:39:03.475770264Z [2024-06-27T23:39:03.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:38:00+00:00 exited with status success for try_number 1 2024-06-27T23:39:03.485121723Z [2024-06-27T23:39:03.484+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:38:00+00:00, map_index=-1, run_start_date=2024-06-27 23:39:02.077966+00:00, run_end_date=2024-06-27 23:39:02.659401+00:00, run_duration=0.581435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=303, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:39:01.147501+00:00, queued_by_job_id=2, pid=4489 2024-06-27T23:39:05.706491415Z [2024-06-27T23:39:05.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:39:05.706948207Z [2024-06-27T23:39:05.706+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:38:00+00:00, run_id=scheduled__2024-06-27T23:38:00+00:00, run_start_date=2024-06-27 23:39:01.069776+00:00, run_end_date=2024-06-27 23:39:05.706396+00:00, run_duration=4.63662, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:38:00+00:00, data_interval_end=2024-06-27 23:39:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:39:05.726120068Z [2024-06-27T23:39:05.725+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:39:00+00:00, run_after=2024-06-27T23:40:00+00:00 2024-06-27T23:39:05.741830983Z [2024-06-27T23:39:05.740+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:39:05.742438576Z [2024-06-27T23:39:05.742+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:38:00+00:00, run_id=scheduled__2024-06-27T23:38:00+00:00, run_start_date=2024-06-27 23:39:01.071176+00:00, run_end_date=2024-06-27 23:39:05.741905+00:00, run_duration=4.670729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:38:00+00:00, data_interval_end=2024-06-27 23:39:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:39:05.761488894Z [2024-06-27T23:39:05.761+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:39:00+00:00, run_after=2024-06-27T23:40:00+00:00 2024-06-27T23:39:05.797996519Z [2024-06-27T23:39:05.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:38:00+00:00 exited with status success for try_number 1 2024-06-27T23:39:05.798176956Z [2024-06-27T23:39:05.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:38:00+00:00 exited with status success for try_number 1 2024-06-27T23:39:05.808503793Z [2024-06-27T23:39:05.808+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:38:00+00:00, map_index=-1, run_start_date=2024-06-27 23:39:03.374423+00:00, run_end_date=2024-06-27 23:39:05.111186+00:00, run_duration=1.736763, state=success, executor_state=success, try_number=1, max_tries=1, job_id=305, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:39:01.147501+00:00, queued_by_job_id=2, pid=4508 2024-06-27T23:39:05.809068578Z [2024-06-27T23:39:05.808+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:38:00+00:00, map_index=-1, run_start_date=2024-06-27 23:39:03.328054+00:00, run_end_date=2024-06-27 23:39:05.133965+00:00, run_duration=1.805911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=304, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:39:01.147501+00:00, queued_by_job_id=2, pid=4507 2024-06-27T23:40:00.355933560Z [2024-06-27T23:40:00.354+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:40:00+00:00, run_after=2024-06-27T23:41:00+00:00 2024-06-27T23:40:00.363477997Z [2024-06-27T23:40:00.363+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:40:00.370128294Z [2024-06-27T23:40:00.369+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:40:00.381943217Z [2024-06-27T23:40:00.381+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:40:00+00:00, run_after=2024-06-27T23:45:00+00:00 2024-06-27T23:40:00.395894105Z [2024-06-27T23:40:00.395+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:40:00+00:00, run_after=2024-06-27T23:41:00+00:00 2024-06-27T23:40:00.536936948Z [2024-06-27T23:40:00.536+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T23:40:00.536964513Z 2024-06-27T23:40:00.536968298Z 2024-06-27T23:40:00.536972007Z 2024-06-27T23:40:00.536975592Z 2024-06-27T23:40:00.536979236Z 2024-06-27T23:40:00.537204999Z [2024-06-27T23:40:00.537+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:40:00.537645990Z [2024-06-27T23:40:00.537+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:40:00.537863335Z [2024-06-27T23:40:00.537+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:40:00.538054025Z [2024-06-27T23:40:00.537+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:40:00.538241151Z [2024-06-27T23:40:00.538+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:40:00.538998750Z [2024-06-27T23:40:00.538+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:40:00.539012171Z 2024-06-27T23:40:00.539016181Z 2024-06-27T23:40:00.539019962Z 2024-06-27T23:40:00.539023368Z 2024-06-27T23:40:00.539042362Z 2024-06-27T23:40:00.544779802Z [2024-06-27T23:40:00.544+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T23:40:00.545027190Z [2024-06-27T23:40:00.544+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:40:00.545486602Z [2024-06-27T23:40:00.545+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:40:00.545717279Z [2024-06-27T23:40:00.545+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:40:00.545989423Z [2024-06-27T23:40:00.545+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:40:00.546163192Z [2024-06-27T23:40:00.545+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:40:00.546410852Z [2024-06-27T23:40:00.546+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:40:00.546595950Z [2024-06-27T23:40:00.546+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:40:00.546966909Z [2024-06-27T23:40:00.546+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:40:00.547160285Z [2024-06-27T23:40:00.546+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:40:01.094873028Z [2024-06-27T23:40:01.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:35:00+00:00 exited with status queued for try_number 1 2024-06-27T23:40:01.097011953Z [2024-06-27T23:40:01.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:38:00+00:00 exited with status queued for try_number 1 2024-06-27T23:40:01.097184160Z [2024-06-27T23:40:01.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:39:00+00:00 exited with status queued for try_number 1 2024-06-27T23:40:01.097292831Z [2024-06-27T23:40:01.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:39:00+00:00 exited with status queued for try_number 1 2024-06-27T23:40:01.097418709Z [2024-06-27T23:40:01.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:39:00+00:00 exited with status queued for try_number 1 2024-06-27T23:40:01.106519047Z [2024-06-27T23:40:01.106+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6d85623-a168-46b4-87f9-9c148a7de13e 2024-06-27T23:40:01.106700801Z [2024-06-27T23:40:01.106+0000] {scheduler_job.py:635} INFO - Setting external_id for to d60bdb71-c1c7-4649-8814-6e5d0c3da166 2024-06-27T23:40:01.106917729Z [2024-06-27T23:40:01.106+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55e60b49-f902-426b-b4fa-eb0fcba11328 2024-06-27T23:40:01.107068653Z [2024-06-27T23:40:01.106+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40466468-62fb-4636-ae02-f9e7667fc1c7 2024-06-27T23:40:01.107237587Z [2024-06-27T23:40:01.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08354820-f906-4158-879d-40e1e59f5c8f 2024-06-27T23:40:03.408015635Z [2024-06-27T23:40:03.407+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:40:03.408558842Z [2024-06-27T23:40:03.408+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:39:00+00:00, run_id=scheduled__2024-06-27T23:39:00+00:00, run_start_date=2024-06-27 23:40:00.414456+00:00, run_end_date=2024-06-27 23:40:03.408147+00:00, run_duration=2.993691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:39:00+00:00, data_interval_end=2024-06-27 23:40:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:40:03.440728337Z [2024-06-27T23:40:03.440+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:40:00+00:00, run_after=2024-06-27T23:41:00+00:00 2024-06-27T23:40:03.583055034Z [2024-06-27T23:40:03.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:39:00+00:00 exited with status success for try_number 1 2024-06-27T23:40:03.595065175Z [2024-06-27T23:40:03.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:39:00+00:00, map_index=-1, run_start_date=2024-06-27 23:40:02.228268+00:00, run_end_date=2024-06-27 23:40:03.087665+00:00, run_duration=0.859397, state=success, executor_state=success, try_number=1, max_tries=1, job_id=306, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:40:00.540230+00:00, queued_by_job_id=2, pid=4541 2024-06-27T23:40:04.732001995Z [2024-06-27T23:40:04.731+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:40:04.733245227Z [2024-06-27T23:40:04.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:38:00+00:00, run_id=scheduled__2024-06-27T23:38:00+00:00, run_start_date=2024-06-27 23:40:00.412787+00:00, run_end_date=2024-06-27 23:40:04.731907+00:00, run_duration=4.31912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:38:00+00:00, data_interval_end=2024-06-27 23:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:40:04.753371306Z [2024-06-27T23:40:04.753+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:40:00+00:00, run_after=2024-06-27T23:42:00+00:00 2024-06-27T23:40:04.942468416Z [2024-06-27T23:40:04.942+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:40:04.942491350Z 2024-06-27T23:40:04.942888556Z [2024-06-27T23:40:04.942+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:40:04.944011703Z [2024-06-27T23:40:04.943+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:40:04.944025048Z 2024-06-27T23:40:04.952801737Z [2024-06-27T23:40:04.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-27T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T23:40:04.953095150Z [2024-06-27T23:40:04.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-27T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:40:05.121751500Z [2024-06-27T23:40:05.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:35:00+00:00 exited with status queued for try_number 1 2024-06-27T23:40:05.121775685Z [2024-06-27T23:40:05.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:38:00+00:00 exited with status success for try_number 1 2024-06-27T23:40:05.161973078Z [2024-06-27T23:40:05.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:38:00+00:00, map_index=-1, run_start_date=2024-06-27 23:40:03.041326+00:00, run_end_date=2024-06-27 23:40:03.519149+00:00, run_duration=0.477823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=307, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:40:00.540230+00:00, queued_by_job_id=2, pid=4549 2024-06-27T23:40:05.162909515Z [2024-06-27T23:40:05.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96a10f21-ec8b-45d0-b621-81396307e274 2024-06-27T23:40:05.444460398Z [2024-06-27T23:40:05.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:35:00+00:00 exited with status success for try_number 1 2024-06-27T23:40:05.458752031Z [2024-06-27T23:40:05.458+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T23:35:00+00:00, map_index=-1, run_start_date=2024-06-27 23:40:03.987806+00:00, run_end_date=2024-06-27 23:40:04.728459+00:00, run_duration=0.740653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=309, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:40:00.540230+00:00, queued_by_job_id=2, pid=4567 2024-06-27T23:40:08.085277702Z [2024-06-27T23:40:08.084+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:40:08.085474435Z [2024-06-27T23:40:08.085+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:39:00+00:00, run_id=scheduled__2024-06-27T23:39:00+00:00, run_start_date=2024-06-27 23:40:00.417779+00:00, run_end_date=2024-06-27 23:40:08.085236+00:00, run_duration=7.667457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:39:00+00:00, data_interval_end=2024-06-27 23:40:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:40:08.122288547Z [2024-06-27T23:40:08.118+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:40:00+00:00, run_after=2024-06-27T23:41:00+00:00 2024-06-27T23:40:08.137031529Z [2024-06-27T23:40:08.136+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:40:08.137319213Z [2024-06-27T23:40:08.137+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:39:00+00:00, run_id=scheduled__2024-06-27T23:39:00+00:00, run_start_date=2024-06-27 23:40:00.416209+00:00, run_end_date=2024-06-27 23:40:08.136980+00:00, run_duration=7.720771, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:39:00+00:00, data_interval_end=2024-06-27 23:40:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:40:08.166569959Z [2024-06-27T23:40:08.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:40:00+00:00, run_after=2024-06-27T23:41:00+00:00 2024-06-27T23:40:08.223983992Z [2024-06-27T23:40:08.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:39:00+00:00 exited with status success for try_number 1 2024-06-27T23:40:08.225964696Z [2024-06-27T23:40:08.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:39:00+00:00 exited with status success for try_number 1 2024-06-27T23:40:08.233778859Z [2024-06-27T23:40:08.233+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:39:00+00:00, map_index=-1, run_start_date=2024-06-27 23:40:03.841489+00:00, run_end_date=2024-06-27 23:40:06.977882+00:00, run_duration=3.136393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=308, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:40:00.540230+00:00, queued_by_job_id=2, pid=4566 2024-06-27T23:40:08.233946120Z [2024-06-27T23:40:08.233+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:39:00+00:00, map_index=-1, run_start_date=2024-06-27 23:40:05.316734+00:00, run_end_date=2024-06-27 23:40:07.230494+00:00, run_duration=1.91376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=310, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:40:00.540230+00:00, queued_by_job_id=2, pid=4584 2024-06-27T23:40:08.677386928Z [2024-06-27T23:40:08.676+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:40:08.677411232Z 2024-06-27T23:40:08.678831453Z [2024-06-27T23:40:08.678+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:40:08.679423726Z [2024-06-27T23:40:08.679+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:40:08.679442058Z 2024-06-27T23:40:08.682324159Z [2024-06-27T23:40:08.681+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-27T23:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T23:40:08.682381919Z [2024-06-27T23:40:08.682+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-27T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T23:40:08.748039250Z [2024-06-27T23:40:08.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:35:00+00:00 exited with status queued for try_number 1 2024-06-27T23:40:08.748086649Z [2024-06-27T23:40:08.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:35:00+00:00 exited with status success for try_number 1 2024-06-27T23:40:08.755540719Z [2024-06-27T23:40:08.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7f6cdff-9fa6-4bb4-8ad4-5b1b0e20bb6e 2024-06-27T23:40:08.755670155Z [2024-06-27T23:40:08.755+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-27T23:35:00+00:00, map_index=-1, run_start_date=2024-06-27 23:40:07.690374+00:00, run_end_date=2024-06-27 23:40:08.246522+00:00, run_duration=0.556148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=311, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:40:04.944725+00:00, queued_by_job_id=2, pid=4596 2024-06-27T23:40:11.054916274Z [2024-06-27T23:40:11.054+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:40:11.054960356Z 2024-06-27T23:40:11.055023553Z [2024-06-27T23:40:11.054+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:40:11.055815888Z [2024-06-27T23:40:11.055+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:40:11.055855615Z 2024-06-27T23:40:11.059311887Z [2024-06-27T23:40:11.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-27T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:40:11.059533014Z [2024-06-27T23:40:11.059+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-27T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:40:11.178838069Z [2024-06-27T23:40:11.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:35:00+00:00 exited with status queued for try_number 1 2024-06-27T23:40:11.183928106Z [2024-06-27T23:40:11.183+0000] {scheduler_job.py:635} INFO - Setting external_id for to e84fee48-0e2b-4aa4-b8ec-9ac69fb5c152 2024-06-27T23:40:11.292222200Z [2024-06-27T23:40:11.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:35:00+00:00 exited with status success for try_number 1 2024-06-27T23:40:11.299122944Z [2024-06-27T23:40:11.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-27T23:35:00+00:00, map_index=0, run_start_date=2024-06-27 23:40:10.534162+00:00, run_end_date=2024-06-27 23:40:11.009055+00:00, run_duration=0.474893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=312, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:40:08.679643+00:00, queued_by_job_id=2, pid=4604 2024-06-27T23:40:13.847237076Z [2024-06-27T23:40:13.845+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:40:13.847271319Z [2024-06-27T23:40:13.846+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:35:00+00:00, run_id=scheduled__2024-06-27T23:35:00+00:00, run_start_date=2024-06-27 23:40:00.409505+00:00, run_end_date=2024-06-27 23:40:13.846508+00:00, run_duration=13.437003, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:35:00+00:00, data_interval_end=2024-06-27 23:40:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-27T23:40:13.861664147Z [2024-06-27T23:40:13.861+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:40:00+00:00, run_after=2024-06-27T23:45:00+00:00 2024-06-27T23:40:13.895688336Z [2024-06-27T23:40:13.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:35:00+00:00 exited with status success for try_number 1 2024-06-27T23:40:13.904794280Z [2024-06-27T23:40:13.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-27T23:35:00+00:00, map_index=-1, run_start_date=2024-06-27 23:40:13.078913+00:00, run_end_date=2024-06-27 23:40:13.507690+00:00, run_duration=0.428777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=313, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:40:11.056169+00:00, queued_by_job_id=2, pid=4612 2024-06-27T23:41:00.648936676Z [2024-06-27T23:41:00.648+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:41:00+00:00, run_after=2024-06-27T23:42:00+00:00 2024-06-27T23:41:00.655894666Z [2024-06-27T23:41:00.655+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:41:00.667557207Z [2024-06-27T23:41:00.667+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:41:00+00:00, run_after=2024-06-27T23:42:00+00:00 2024-06-27T23:41:00.724376046Z [2024-06-27T23:41:00.723+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:41:00.724424130Z 2024-06-27T23:41:00.724433260Z 2024-06-27T23:41:00.724440564Z 2024-06-27T23:41:00.724447708Z [2024-06-27T23:41:00.724+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:41:00.724513665Z [2024-06-27T23:41:00.724+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:41:00.724548874Z [2024-06-27T23:41:00.724+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:41:00.724951222Z [2024-06-27T23:41:00.724+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:41:00.725000283Z 2024-06-27T23:41:00.725009481Z 2024-06-27T23:41:00.725016852Z 2024-06-27T23:41:00.727762572Z [2024-06-27T23:41:00.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:41:00.727791901Z [2024-06-27T23:41:00.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:41:00.728000793Z [2024-06-27T23:41:00.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:41:00.728036300Z [2024-06-27T23:41:00.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:41:00.728214504Z [2024-06-27T23:41:00.728+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:41:00.728323429Z [2024-06-27T23:41:00.728+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:41:01.079641691Z [2024-06-27T23:41:01.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:40:00+00:00 exited with status queued for try_number 1 2024-06-27T23:41:01.080785825Z [2024-06-27T23:41:01.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:40:00+00:00 exited with status queued for try_number 1 2024-06-27T23:41:01.081949224Z [2024-06-27T23:41:01.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:40:00+00:00 exited with status queued for try_number 1 2024-06-27T23:41:01.092654931Z [2024-06-27T23:41:01.092+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2bc1c4d1-e7f0-421f-8695-046a5df0c94b 2024-06-27T23:41:01.092881142Z [2024-06-27T23:41:01.092+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31682bfe-5699-4178-9010-2de525de9ca0 2024-06-27T23:41:01.093057720Z [2024-06-27T23:41:01.092+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56f42bbe-64ce-4758-b2c3-3e08e0ffec49 2024-06-27T23:41:02.643761398Z [2024-06-27T23:41:02.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:41:02.644233751Z [2024-06-27T23:41:02.643+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:40:00+00:00, run_id=scheduled__2024-06-27T23:40:00+00:00, run_start_date=2024-06-27 23:41:00.677903+00:00, run_end_date=2024-06-27 23:41:02.643805+00:00, run_duration=1.965902, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:40:00+00:00, data_interval_end=2024-06-27 23:41:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:41:02.657973108Z [2024-06-27T23:41:02.657+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:41:00+00:00, run_after=2024-06-27T23:42:00+00:00 2024-06-27T23:41:02.715520100Z [2024-06-27T23:41:02.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:40:00+00:00 exited with status success for try_number 1 2024-06-27T23:41:02.726265519Z [2024-06-27T23:41:02.725+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:40:00+00:00, map_index=-1, run_start_date=2024-06-27 23:41:01.853451+00:00, run_end_date=2024-06-27 23:41:02.192760+00:00, run_duration=0.339309, state=success, executor_state=success, try_number=1, max_tries=1, job_id=314, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:41:00.725486+00:00, queued_by_job_id=2, pid=4634 2024-06-27T23:41:05.849852232Z [2024-06-27T23:41:05.849+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:41:05.850040664Z [2024-06-27T23:41:05.849+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:40:00+00:00, run_id=scheduled__2024-06-27T23:40:00+00:00, run_start_date=2024-06-27 23:41:00.679127+00:00, run_end_date=2024-06-27 23:41:05.849771+00:00, run_duration=5.170644, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:40:00+00:00, data_interval_end=2024-06-27 23:41:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:41:05.868749885Z [2024-06-27T23:41:05.868+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:41:00+00:00, run_after=2024-06-27T23:42:00+00:00 2024-06-27T23:41:05.882400530Z [2024-06-27T23:41:05.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:41:05.882557739Z [2024-06-27T23:41:05.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:40:00+00:00, run_id=scheduled__2024-06-27T23:40:00+00:00, run_start_date=2024-06-27 23:41:00.680134+00:00, run_end_date=2024-06-27 23:41:05.882316+00:00, run_duration=5.202182, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:40:00+00:00, data_interval_end=2024-06-27 23:41:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:41:05.893851772Z [2024-06-27T23:41:05.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:41:00+00:00, run_after=2024-06-27T23:42:00+00:00 2024-06-27T23:41:05.968671814Z [2024-06-27T23:41:05.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:40:00+00:00 exited with status success for try_number 1 2024-06-27T23:41:05.968710768Z [2024-06-27T23:41:05.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:40:00+00:00 exited with status success for try_number 1 2024-06-27T23:41:05.975062144Z [2024-06-27T23:41:05.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:40:00+00:00, map_index=-1, run_start_date=2024-06-27 23:41:02.952907+00:00, run_end_date=2024-06-27 23:41:05.039432+00:00, run_duration=2.086525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=315, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:41:00.725486+00:00, queued_by_job_id=2, pid=4652 2024-06-27T23:41:05.975172343Z [2024-06-27T23:41:05.975+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:40:00+00:00, map_index=-1, run_start_date=2024-06-27 23:41:03.017431+00:00, run_end_date=2024-06-27 23:41:05.301186+00:00, run_duration=2.283755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=316, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:41:00.725486+00:00, queued_by_job_id=2, pid=4653 2024-06-27T23:41:44.905248829Z [2024-06-27T23:41:44.904+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T23:42:00.578301754Z [2024-06-27T23:42:00.577+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:42:00+00:00, run_after=2024-06-27T23:43:00+00:00 2024-06-27T23:42:00.593324261Z [2024-06-27T23:42:00.593+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:42:00+00:00, run_after=2024-06-27T23:43:00+00:00 2024-06-27T23:42:00.601365406Z [2024-06-27T23:42:00.601+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:42:00.609476508Z [2024-06-27T23:42:00.609+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:42:00.733383981Z [2024-06-27T23:42:00.732+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:42:00.733420203Z 2024-06-27T23:42:00.733430451Z 2024-06-27T23:42:00.733439496Z 2024-06-27T23:42:00.733447317Z 2024-06-27T23:42:00.735242172Z [2024-06-27T23:42:00.734+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:42:00.735906101Z [2024-06-27T23:42:00.735+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:42:00.736949178Z [2024-06-27T23:42:00.735+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:42:00.738060514Z [2024-06-27T23:42:00.737+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:42:00.743862795Z [2024-06-27T23:42:00.741+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:42:00.743886938Z 2024-06-27T23:42:00.743894367Z 2024-06-27T23:42:00.743900858Z 2024-06-27T23:42:00.743928278Z 2024-06-27T23:42:00.752975536Z [2024-06-27T23:42:00.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:42:00.753238400Z [2024-06-27T23:42:00.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:42:00.753476502Z [2024-06-27T23:42:00.753+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:42:00.753895083Z [2024-06-27T23:42:00.753+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:42:00.754910493Z [2024-06-27T23:42:00.754+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:42:00.756116656Z [2024-06-27T23:42:00.754+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:42:00.756463591Z [2024-06-27T23:42:00.756+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:42:00.756541248Z [2024-06-27T23:42:00.756+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:42:01.138524765Z [2024-06-27T23:42:01.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:40:00+00:00 exited with status queued for try_number 1 2024-06-27T23:42:01.138550056Z [2024-06-27T23:42:01.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:41:00+00:00 exited with status queued for try_number 1 2024-06-27T23:42:01.138813722Z [2024-06-27T23:42:01.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:41:00+00:00 exited with status queued for try_number 1 2024-06-27T23:42:01.138916997Z [2024-06-27T23:42:01.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:41:00+00:00 exited with status queued for try_number 1 2024-06-27T23:42:01.164814874Z [2024-06-27T23:42:01.164+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5560263e-5f73-4acc-836e-08e98eaf8775 2024-06-27T23:42:01.165117261Z [2024-06-27T23:42:01.164+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1334eea7-fd09-4fb0-b0e6-a91d565da58b 2024-06-27T23:42:01.165337730Z [2024-06-27T23:42:01.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb9e34d4-44d6-445e-a114-50445d473eb3 2024-06-27T23:42:01.165535102Z [2024-06-27T23:42:01.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to 900b6d6c-956e-4b72-b43d-8c91987a6468 2024-06-27T23:42:03.196493569Z [2024-06-27T23:42:03.196+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:42:03.196762711Z [2024-06-27T23:42:03.196+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:40:00+00:00, run_id=scheduled__2024-06-27T23:40:00+00:00, run_start_date=2024-06-27 23:42:00.627321+00:00, run_end_date=2024-06-27 23:42:03.196381+00:00, run_duration=2.56906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:40:00+00:00, data_interval_end=2024-06-27 23:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:42:03.206661196Z [2024-06-27T23:42:03.206+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:42:00+00:00, run_after=2024-06-27T23:44:00+00:00 2024-06-27T23:42:03.220315474Z [2024-06-27T23:42:03.219+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:42:03.220428232Z [2024-06-27T23:42:03.220+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:41:00+00:00, run_id=scheduled__2024-06-27T23:41:00+00:00, run_start_date=2024-06-27 23:42:00.628612+00:00, run_end_date=2024-06-27 23:42:03.220172+00:00, run_duration=2.59156, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:41:00+00:00, data_interval_end=2024-06-27 23:42:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:42:03.230353176Z [2024-06-27T23:42:03.230+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:42:00+00:00, run_after=2024-06-27T23:43:00+00:00 2024-06-27T23:42:03.293624702Z [2024-06-27T23:42:03.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:40:00+00:00 exited with status success for try_number 1 2024-06-27T23:42:03.293651170Z [2024-06-27T23:42:03.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:41:00+00:00 exited with status success for try_number 1 2024-06-27T23:42:03.306218074Z [2024-06-27T23:42:03.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:40:00+00:00, map_index=-1, run_start_date=2024-06-27 23:42:01.752280+00:00, run_end_date=2024-06-27 23:42:02.233672+00:00, run_duration=0.481392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=317, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:42:00.746496+00:00, queued_by_job_id=2, pid=4686 2024-06-27T23:42:03.306296002Z [2024-06-27T23:42:03.306+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:41:00+00:00, map_index=-1, run_start_date=2024-06-27 23:42:01.935645+00:00, run_end_date=2024-06-27 23:42:02.547070+00:00, run_duration=0.611425, state=success, executor_state=success, try_number=1, max_tries=1, job_id=318, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:42:00.746496+00:00, queued_by_job_id=2, pid=4687 2024-06-27T23:42:05.490477904Z [2024-06-27T23:42:05.490+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:42:05.491249136Z [2024-06-27T23:42:05.490+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:41:00+00:00, run_id=scheduled__2024-06-27T23:41:00+00:00, run_start_date=2024-06-27 23:42:00.629662+00:00, run_end_date=2024-06-27 23:42:05.490361+00:00, run_duration=4.860699, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:41:00+00:00, data_interval_end=2024-06-27 23:42:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:42:05.500005963Z [2024-06-27T23:42:05.499+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:42:00+00:00, run_after=2024-06-27T23:43:00+00:00 2024-06-27T23:42:05.537876537Z [2024-06-27T23:42:05.537+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:42:05.537902219Z [2024-06-27T23:42:05.537+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:41:00+00:00, run_id=scheduled__2024-06-27T23:41:00+00:00, run_start_date=2024-06-27 23:42:00.630644+00:00, run_end_date=2024-06-27 23:42:05.537619+00:00, run_duration=4.906975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:41:00+00:00, data_interval_end=2024-06-27 23:42:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:42:05.554266245Z [2024-06-27T23:42:05.551+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:42:00+00:00, run_after=2024-06-27T23:43:00+00:00 2024-06-27T23:42:05.626902304Z [2024-06-27T23:42:05.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:41:00+00:00 exited with status success for try_number 1 2024-06-27T23:42:05.626918920Z [2024-06-27T23:42:05.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:41:00+00:00 exited with status success for try_number 1 2024-06-27T23:42:05.643617186Z [2024-06-27T23:42:05.643+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:41:00+00:00, map_index=-1, run_start_date=2024-06-27 23:42:03.371520+00:00, run_end_date=2024-06-27 23:42:05.003438+00:00, run_duration=1.631918, state=success, executor_state=success, try_number=1, max_tries=1, job_id=320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:42:00.746496+00:00, queued_by_job_id=2, pid=4711 2024-06-27T23:42:05.644147477Z [2024-06-27T23:42:05.643+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:41:00+00:00, map_index=-1, run_start_date=2024-06-27 23:42:03.253962+00:00, run_end_date=2024-06-27 23:42:05.169620+00:00, run_duration=1.915658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=319, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:42:00.746496+00:00, queued_by_job_id=2, pid=4710 2024-06-27T23:43:00.136922099Z [2024-06-27T23:43:00.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:43:00+00:00, run_after=2024-06-27T23:44:00+00:00 2024-06-27T23:43:00.149915213Z [2024-06-27T23:43:00.149+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:43:00+00:00, run_after=2024-06-27T23:44:00+00:00 2024-06-27T23:43:00.159312656Z [2024-06-27T23:43:00.159+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:43:00.245451554Z [2024-06-27T23:43:00.245+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:43:00.245473144Z 2024-06-27T23:43:00.245477815Z 2024-06-27T23:43:00.245482401Z 2024-06-27T23:43:00.245918470Z [2024-06-27T23:43:00.245+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:43:00.246260211Z [2024-06-27T23:43:00.246+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:43:00.246427329Z [2024-06-27T23:43:00.246+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:43:00.247826053Z [2024-06-27T23:43:00.247+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:43:00.247833499Z 2024-06-27T23:43:00.247837096Z 2024-06-27T23:43:00.247840449Z 2024-06-27T23:43:00.252074650Z [2024-06-27T23:43:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:43:00.252265387Z [2024-06-27T23:43:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:43:00.252581993Z [2024-06-27T23:43:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:43:00.252746636Z [2024-06-27T23:43:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:43:00.253046198Z [2024-06-27T23:43:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:43:00.253230220Z [2024-06-27T23:43:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:43:00.532236840Z [2024-06-27T23:43:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:42:00+00:00 exited with status queued for try_number 1 2024-06-27T23:43:00.532446513Z [2024-06-27T23:43:00.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:42:00+00:00 exited with status queued for try_number 1 2024-06-27T23:43:00.532901369Z [2024-06-27T23:43:00.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:42:00+00:00 exited with status queued for try_number 1 2024-06-27T23:43:00.542772492Z [2024-06-27T23:43:00.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to 510a4ebf-d2ba-4fb0-9165-31d773ea162c 2024-06-27T23:43:00.542975992Z [2024-06-27T23:43:00.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e72c3de-df19-45ce-b3df-5527e50e7e51 2024-06-27T23:43:00.543143738Z [2024-06-27T23:43:00.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to cef47bc6-d75e-4637-910c-d28a6d7ba208 2024-06-27T23:43:01.835557066Z [2024-06-27T23:43:01.834+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:43:01.835914656Z [2024-06-27T23:43:01.835+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:42:00+00:00, run_id=scheduled__2024-06-27T23:42:00+00:00, run_start_date=2024-06-27 23:43:00.172015+00:00, run_end_date=2024-06-27 23:43:01.835502+00:00, run_duration=1.663487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:42:00+00:00, data_interval_end=2024-06-27 23:43:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:43:01.854070004Z [2024-06-27T23:43:01.853+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:43:00+00:00, run_after=2024-06-27T23:44:00+00:00 2024-06-27T23:43:01.917221448Z [2024-06-27T23:43:01.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:42:00+00:00 exited with status success for try_number 1 2024-06-27T23:43:01.924613366Z [2024-06-27T23:43:01.924+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:42:00+00:00, map_index=-1, run_start_date=2024-06-27 23:43:01.179856+00:00, run_end_date=2024-06-27 23:43:01.663882+00:00, run_duration=0.484026, state=success, executor_state=success, try_number=1, max_tries=1, job_id=321, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:43:00.248729+00:00, queued_by_job_id=2, pid=4743 2024-06-27T23:43:04.851598776Z [2024-06-27T23:43:04.850+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:43:04.852288318Z [2024-06-27T23:43:04.851+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:42:00+00:00, run_id=scheduled__2024-06-27T23:42:00+00:00, run_start_date=2024-06-27 23:43:00.174508+00:00, run_end_date=2024-06-27 23:43:04.851767+00:00, run_duration=4.677259, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:42:00+00:00, data_interval_end=2024-06-27 23:43:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:43:04.865750572Z [2024-06-27T23:43:04.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:43:00+00:00, run_after=2024-06-27T23:44:00+00:00 2024-06-27T23:43:04.884926745Z [2024-06-27T23:43:04.884+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:43:04.885379589Z [2024-06-27T23:43:04.885+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:42:00+00:00, run_id=scheduled__2024-06-27T23:42:00+00:00, run_start_date=2024-06-27 23:43:00.173397+00:00, run_end_date=2024-06-27 23:43:04.885034+00:00, run_duration=4.711637, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:42:00+00:00, data_interval_end=2024-06-27 23:43:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:43:04.906244588Z [2024-06-27T23:43:04.905+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:43:00+00:00, run_after=2024-06-27T23:44:00+00:00 2024-06-27T23:43:04.961159515Z [2024-06-27T23:43:04.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:42:00+00:00 exited with status success for try_number 1 2024-06-27T23:43:04.961202589Z [2024-06-27T23:43:04.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:42:00+00:00 exited with status success for try_number 1 2024-06-27T23:43:04.968102297Z [2024-06-27T23:43:04.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:42:00+00:00, map_index=-1, run_start_date=2024-06-27 23:43:02.483169+00:00, run_end_date=2024-06-27 23:43:04.280859+00:00, run_duration=1.79769, state=success, executor_state=success, try_number=1, max_tries=1, job_id=322, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:43:00.248729+00:00, queued_by_job_id=2, pid=4761 2024-06-27T23:43:04.968215363Z [2024-06-27T23:43:04.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:42:00+00:00, map_index=-1, run_start_date=2024-06-27 23:43:02.610417+00:00, run_end_date=2024-06-27 23:43:04.094822+00:00, run_duration=1.484405, state=success, executor_state=success, try_number=1, max_tries=1, job_id=323, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:43:00.248729+00:00, queued_by_job_id=2, pid=4762 2024-06-27T23:44:00.114826936Z [2024-06-27T23:44:00.114+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:44:00.147036749Z [2024-06-27T23:44:00.146+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:44:00+00:00, run_after=2024-06-27T23:45:00+00:00 2024-06-27T23:44:00.169370282Z [2024-06-27T23:44:00.169+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:44:00+00:00, run_after=2024-06-27T23:45:00+00:00 2024-06-27T23:44:00.181942686Z [2024-06-27T23:44:00.181+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:44:00.304872853Z [2024-06-27T23:44:00.304+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:44:00.304898263Z 2024-06-27T23:44:00.304909450Z 2024-06-27T23:44:00.304916588Z 2024-06-27T23:44:00.304923336Z 2024-06-27T23:44:00.305135977Z [2024-06-27T23:44:00.304+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:44:00.305260448Z [2024-06-27T23:44:00.305+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:44:00.305386612Z [2024-06-27T23:44:00.305+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:44:00.305516508Z [2024-06-27T23:44:00.305+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:44:00.306447823Z [2024-06-27T23:44:00.306+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:44:00.306464462Z 2024-06-27T23:44:00.306471765Z 2024-06-27T23:44:00.306478387Z 2024-06-27T23:44:00.306484917Z 2024-06-27T23:44:00.310441242Z [2024-06-27T23:44:00.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:44:00.310625963Z [2024-06-27T23:44:00.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:44:00.310998207Z [2024-06-27T23:44:00.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:44:00.311160261Z [2024-06-27T23:44:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:44:00.311420817Z [2024-06-27T23:44:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:44:00.311573776Z [2024-06-27T23:44:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:44:00.311847965Z [2024-06-27T23:44:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:44:00.312011637Z [2024-06-27T23:44:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:44:00.643524430Z [2024-06-27T23:44:00.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:42:00+00:00 exited with status queued for try_number 1 2024-06-27T23:44:00.646746930Z [2024-06-27T23:44:00.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:43:00+00:00 exited with status queued for try_number 1 2024-06-27T23:44:00.647337660Z [2024-06-27T23:44:00.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:43:00+00:00 exited with status queued for try_number 1 2024-06-27T23:44:00.647569077Z [2024-06-27T23:44:00.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:43:00+00:00 exited with status queued for try_number 1 2024-06-27T23:44:00.656995234Z [2024-06-27T23:44:00.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56ba4a3e-2487-4141-ba99-9d8252fc183e 2024-06-27T23:44:00.657275763Z [2024-06-27T23:44:00.657+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1c53aca-351b-42ad-9ff9-381010f888f1 2024-06-27T23:44:00.657522293Z [2024-06-27T23:44:00.657+0000] {scheduler_job.py:635} INFO - Setting external_id for to 895e5709-9610-47d2-a4d5-c5904323cce5 2024-06-27T23:44:00.658303787Z [2024-06-27T23:44:00.658+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54d6aa94-f214-48f3-86fe-8532304a1d47 2024-06-27T23:44:02.982879852Z [2024-06-27T23:44:02.982+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:44:02.984500924Z [2024-06-27T23:44:02.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:42:00+00:00, run_id=scheduled__2024-06-27T23:42:00+00:00, run_start_date=2024-06-27 23:44:00.204463+00:00, run_end_date=2024-06-27 23:44:02.982718+00:00, run_duration=2.778255, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:42:00+00:00, data_interval_end=2024-06-27 23:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:44:03.009819252Z [2024-06-27T23:44:03.009+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:44:00+00:00, run_after=2024-06-27T23:46:00+00:00 2024-06-27T23:44:03.022316192Z [2024-06-27T23:44:03.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:44:03.022851665Z [2024-06-27T23:44:03.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:43:00+00:00, run_id=scheduled__2024-06-27T23:43:00+00:00, run_start_date=2024-06-27 23:44:00.206002+00:00, run_end_date=2024-06-27 23:44:03.022472+00:00, run_duration=2.81647, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:43:00+00:00, data_interval_end=2024-06-27 23:44:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:44:03.034582852Z [2024-06-27T23:44:03.034+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:44:00+00:00, run_after=2024-06-27T23:45:00+00:00 2024-06-27T23:44:03.095455002Z [2024-06-27T23:44:03.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:42:00+00:00 exited with status success for try_number 1 2024-06-27T23:44:03.096056409Z [2024-06-27T23:44:03.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:43:00+00:00 exited with status success for try_number 1 2024-06-27T23:44:03.106830198Z [2024-06-27T23:44:03.106+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:42:00+00:00, map_index=-1, run_start_date=2024-06-27 23:44:01.236095+00:00, run_end_date=2024-06-27 23:44:01.727349+00:00, run_duration=0.491254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=324, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:44:00.307441+00:00, queued_by_job_id=2, pid=4789 2024-06-27T23:44:03.107250326Z [2024-06-27T23:44:03.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:43:00+00:00, map_index=-1, run_start_date=2024-06-27 23:44:01.854380+00:00, run_end_date=2024-06-27 23:44:02.387357+00:00, run_duration=0.532977, state=success, executor_state=success, try_number=1, max_tries=1, job_id=325, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:44:00.307441+00:00, queued_by_job_id=2, pid=4800 2024-06-27T23:44:05.308143683Z [2024-06-27T23:44:05.307+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:44:05.308477621Z [2024-06-27T23:44:05.308+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:43:00+00:00, run_id=scheduled__2024-06-27T23:43:00+00:00, run_start_date=2024-06-27 23:44:00.208450+00:00, run_end_date=2024-06-27 23:44:05.308040+00:00, run_duration=5.09959, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:43:00+00:00, data_interval_end=2024-06-27 23:44:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:44:05.317296799Z [2024-06-27T23:44:05.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:44:00+00:00, run_after=2024-06-27T23:45:00+00:00 2024-06-27T23:44:05.324086874Z [2024-06-27T23:44:05.323+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:44:05.324441276Z [2024-06-27T23:44:05.324+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:43:00+00:00, run_id=scheduled__2024-06-27T23:43:00+00:00, run_start_date=2024-06-27 23:44:00.207339+00:00, run_end_date=2024-06-27 23:44:05.323943+00:00, run_duration=5.116604, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:43:00+00:00, data_interval_end=2024-06-27 23:44:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:44:05.338150174Z [2024-06-27T23:44:05.337+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:44:00+00:00, run_after=2024-06-27T23:45:00+00:00 2024-06-27T23:44:05.382516161Z [2024-06-27T23:44:05.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:43:00+00:00 exited with status success for try_number 1 2024-06-27T23:44:05.382906261Z [2024-06-27T23:44:05.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:43:00+00:00 exited with status success for try_number 1 2024-06-27T23:44:05.389806378Z [2024-06-27T23:44:05.389+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:43:00+00:00, map_index=-1, run_start_date=2024-06-27 23:44:03.053461+00:00, run_end_date=2024-06-27 23:44:04.342342+00:00, run_duration=1.288881, state=success, executor_state=success, try_number=1, max_tries=1, job_id=327, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:44:00.307441+00:00, queued_by_job_id=2, pid=4819 2024-06-27T23:44:05.390180563Z [2024-06-27T23:44:05.389+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:43:00+00:00, map_index=-1, run_start_date=2024-06-27 23:44:02.924803+00:00, run_end_date=2024-06-27 23:44:04.676071+00:00, run_duration=1.751268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=326, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:44:00.307441+00:00, queued_by_job_id=2, pid=4818 2024-06-27T23:45:00.123647129Z [2024-06-27T23:45:00.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:45:00+00:00, run_after=2024-06-27T23:50:00+00:00 2024-06-27T23:45:00.139103523Z [2024-06-27T23:45:00.138+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:45:00+00:00, run_after=2024-06-27T23:46:00+00:00 2024-06-27T23:45:00.157031606Z [2024-06-27T23:45:00.156+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:45:00+00:00, run_after=2024-06-27T23:46:00+00:00 2024-06-27T23:45:00.186755970Z [2024-06-27T23:45:00.186+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:45:00.322242145Z [2024-06-27T23:45:00.321+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:45:00.322254733Z 2024-06-27T23:45:00.322258654Z 2024-06-27T23:45:00.322261991Z 2024-06-27T23:45:00.322265654Z 2024-06-27T23:45:00.322345920Z [2024-06-27T23:45:00.322+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:45:00.322481026Z [2024-06-27T23:45:00.322+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:45:00.322595321Z [2024-06-27T23:45:00.322+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:45:00.322724365Z [2024-06-27T23:45:00.322+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:45:00.323481575Z [2024-06-27T23:45:00.323+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:45:00.323491035Z 2024-06-27T23:45:00.323494376Z 2024-06-27T23:45:00.323497552Z 2024-06-27T23:45:00.323500763Z 2024-06-27T23:45:00.331971938Z [2024-06-27T23:45:00.331+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T23:45:00.332286490Z [2024-06-27T23:45:00.331+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:45:00.332790407Z [2024-06-27T23:45:00.332+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:45:00.336079016Z [2024-06-27T23:45:00.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:45:00.336927591Z [2024-06-27T23:45:00.336+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:45:00.337367817Z [2024-06-27T23:45:00.337+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:45:00.338473188Z [2024-06-27T23:45:00.338+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:45:00.338759928Z [2024-06-27T23:45:00.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:45:00.695834623Z [2024-06-27T23:45:00.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:40:00+00:00 exited with status queued for try_number 1 2024-06-27T23:45:00.696281672Z [2024-06-27T23:45:00.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:44:00+00:00 exited with status queued for try_number 1 2024-06-27T23:45:00.696424048Z [2024-06-27T23:45:00.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:44:00+00:00 exited with status queued for try_number 1 2024-06-27T23:45:00.696563483Z [2024-06-27T23:45:00.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:44:00+00:00 exited with status queued for try_number 1 2024-06-27T23:45:00.714282837Z [2024-06-27T23:45:00.713+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8045ee8-01ef-445e-aeb7-2a6b7d7d484d 2024-06-27T23:45:00.714647153Z [2024-06-27T23:45:00.714+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd1ac634-dcef-4e28-a83a-b10295cf31d6 2024-06-27T23:45:00.718996331Z [2024-06-27T23:45:00.714+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59224b14-aec9-49f6-8d35-77e344f8820c 2024-06-27T23:45:00.719131457Z [2024-06-27T23:45:00.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to b566499a-2092-46b8-a808-3cfd248b76e9 2024-06-27T23:45:02.019994735Z [2024-06-27T23:45:02.019+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:45:02.020441910Z [2024-06-27T23:45:02.020+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:44:00+00:00, run_id=scheduled__2024-06-27T23:44:00+00:00, run_start_date=2024-06-27 23:45:00.218276+00:00, run_end_date=2024-06-27 23:45:02.020060+00:00, run_duration=1.801784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:44:00+00:00, data_interval_end=2024-06-27 23:45:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:45:02.036867246Z [2024-06-27T23:45:02.035+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:45:00+00:00, run_after=2024-06-27T23:46:00+00:00 2024-06-27T23:45:03.273688786Z [2024-06-27T23:45:03.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:44:00+00:00 exited with status success for try_number 1 2024-06-27T23:45:03.287925664Z [2024-06-27T23:45:03.287+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:44:00+00:00, map_index=-1, run_start_date=2024-06-27 23:45:01.444000+00:00, run_end_date=2024-06-27 23:45:01.953447+00:00, run_duration=0.509447, state=success, executor_state=success, try_number=1, max_tries=1, job_id=328, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:45:00.325640+00:00, queued_by_job_id=2, pid=4852 2024-06-27T23:45:03.552643190Z [2024-06-27T23:45:03.552+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:45:03.552666856Z 2024-06-27T23:45:03.552769567Z [2024-06-27T23:45:03.552+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:45:03.553296875Z [2024-06-27T23:45:03.553+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:45:03.553305848Z 2024-06-27T23:45:03.556328740Z [2024-06-27T23:45:03.555+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-27T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T23:45:03.557018354Z [2024-06-27T23:45:03.556+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-27T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:45:03.630735381Z [2024-06-27T23:45:03.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:40:00+00:00 exited with status queued for try_number 1 2024-06-27T23:45:03.630862125Z [2024-06-27T23:45:03.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:40:00+00:00 exited with status success for try_number 1 2024-06-27T23:45:03.639582465Z [2024-06-27T23:45:03.639+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08a2d932-6d7c-4cb3-9daf-e05745531fc6 2024-06-27T23:45:03.640559968Z [2024-06-27T23:45:03.640+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T23:40:00+00:00, map_index=-1, run_start_date=2024-06-27 23:45:02.833939+00:00, run_end_date=2024-06-27 23:45:03.373110+00:00, run_duration=0.539171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=329, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:45:00.325640+00:00, queued_by_job_id=2, pid=4876 2024-06-27T23:45:05.430666006Z [2024-06-27T23:45:05.430+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:45:05.431046358Z [2024-06-27T23:45:05.430+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:44:00+00:00, run_id=scheduled__2024-06-27T23:44:00+00:00, run_start_date=2024-06-27 23:45:00.219582+00:00, run_end_date=2024-06-27 23:45:05.430681+00:00, run_duration=5.211099, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:44:00+00:00, data_interval_end=2024-06-27 23:45:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:45:05.440007022Z [2024-06-27T23:45:05.439+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:45:00+00:00, run_after=2024-06-27T23:46:00+00:00 2024-06-27T23:45:05.471543806Z [2024-06-27T23:45:05.471+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:45:05.471945781Z [2024-06-27T23:45:05.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:44:00+00:00, run_id=scheduled__2024-06-27T23:44:00+00:00, run_start_date=2024-06-27 23:45:00.220697+00:00, run_end_date=2024-06-27 23:45:05.471635+00:00, run_duration=5.250938, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:44:00+00:00, data_interval_end=2024-06-27 23:45:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:45:05.481932302Z [2024-06-27T23:45:05.481+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:45:00+00:00, run_after=2024-06-27T23:46:00+00:00 2024-06-27T23:45:05.601685421Z [2024-06-27T23:45:05.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:44:00+00:00 exited with status success for try_number 1 2024-06-27T23:45:05.603190594Z [2024-06-27T23:45:05.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:44:00+00:00 exited with status success for try_number 1 2024-06-27T23:45:05.612923730Z [2024-06-27T23:45:05.612+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:44:00+00:00, map_index=-1, run_start_date=2024-06-27 23:45:02.969692+00:00, run_end_date=2024-06-27 23:45:04.454324+00:00, run_duration=1.484632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=330, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:45:00.325640+00:00, queued_by_job_id=2, pid=4877 2024-06-27T23:45:05.613409746Z [2024-06-27T23:45:05.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:44:00+00:00, map_index=-1, run_start_date=2024-06-27 23:45:03.015947+00:00, run_end_date=2024-06-27 23:45:05.183622+00:00, run_duration=2.167675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=331, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:45:00.325640+00:00, queued_by_job_id=2, pid=4878 2024-06-27T23:45:06.686836892Z [2024-06-27T23:45:06.686+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:45:06.686850697Z 2024-06-27T23:45:06.686914194Z [2024-06-27T23:45:06.686+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:45:06.687429264Z [2024-06-27T23:45:06.687+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:45:06.687439971Z 2024-06-27T23:45:06.689825928Z [2024-06-27T23:45:06.689+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-27T23:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T23:45:06.689947900Z [2024-06-27T23:45:06.689+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-27T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T23:45:06.778632792Z [2024-06-27T23:45:06.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:40:00+00:00 exited with status queued for try_number 1 2024-06-27T23:45:06.781880781Z [2024-06-27T23:45:06.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:40:00+00:00 exited with status success for try_number 1 2024-06-27T23:45:06.788191120Z [2024-06-27T23:45:06.787+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72090b01-4c18-4bbf-87c1-511ee97a8055 2024-06-27T23:45:06.788511719Z [2024-06-27T23:45:06.788+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-27T23:40:00+00:00, map_index=-1, run_start_date=2024-06-27 23:45:05.836847+00:00, run_end_date=2024-06-27 23:45:06.212894+00:00, run_duration=0.376047, state=success, executor_state=success, try_number=1, max_tries=1, job_id=332, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:45:03.553632+00:00, queued_by_job_id=2, pid=4901 2024-06-27T23:45:09.430193888Z [2024-06-27T23:45:09.429+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:45:09.430217608Z 2024-06-27T23:45:09.430226288Z [2024-06-27T23:45:09.430+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:45:09.430815390Z [2024-06-27T23:45:09.430+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:45:09.430833884Z 2024-06-27T23:45:09.433260444Z [2024-06-27T23:45:09.432+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-27T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:45:09.433543349Z [2024-06-27T23:45:09.433+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-27T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:45:09.509670036Z [2024-06-27T23:45:09.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:40:00+00:00 exited with status queued for try_number 1 2024-06-27T23:45:09.509842569Z [2024-06-27T23:45:09.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:40:00+00:00 exited with status success for try_number 1 2024-06-27T23:45:09.518442518Z [2024-06-27T23:45:09.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3aed9766-0c03-4b27-99be-ada46f2a8801 2024-06-27T23:45:09.519246621Z [2024-06-27T23:45:09.518+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-27T23:40:00+00:00, map_index=0, run_start_date=2024-06-27 23:45:08.493849+00:00, run_end_date=2024-06-27 23:45:08.883148+00:00, run_duration=0.389299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=333, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:45:06.687739+00:00, queued_by_job_id=2, pid=4909 2024-06-27T23:45:11.794007707Z [2024-06-27T23:45:11.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:45:11.799935211Z [2024-06-27T23:45:11.799+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:40:00+00:00, run_id=scheduled__2024-06-27T23:40:00+00:00, run_start_date=2024-06-27 23:45:00.216690+00:00, run_end_date=2024-06-27 23:45:11.793875+00:00, run_duration=11.577185, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:40:00+00:00, data_interval_end=2024-06-27 23:45:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-27T23:45:11.807432894Z [2024-06-27T23:45:11.807+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:45:00+00:00, run_after=2024-06-27T23:50:00+00:00 2024-06-27T23:45:11.860833920Z [2024-06-27T23:45:11.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:40:00+00:00 exited with status success for try_number 1 2024-06-27T23:45:11.866244322Z [2024-06-27T23:45:11.865+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-27T23:40:00+00:00, map_index=-1, run_start_date=2024-06-27 23:45:11.203976+00:00, run_end_date=2024-06-27 23:45:11.625716+00:00, run_duration=0.42174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=334, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:45:09.431240+00:00, queued_by_job_id=2, pid=4917 2024-06-27T23:46:00.234085865Z [2024-06-27T23:46:00.233+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:46:00.249331425Z [2024-06-27T23:46:00.249+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:46:00+00:00, run_after=2024-06-27T23:47:00+00:00 2024-06-27T23:46:00.263883476Z [2024-06-27T23:46:00.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:46:00+00:00, run_after=2024-06-27T23:47:00+00:00 2024-06-27T23:46:00.277977378Z [2024-06-27T23:46:00.277+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:46:00.387527145Z [2024-06-27T23:46:00.387+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:46:00.387550903Z 2024-06-27T23:46:00.387555603Z 2024-06-27T23:46:00.387560115Z 2024-06-27T23:46:00.387564059Z 2024-06-27T23:46:00.387792548Z [2024-06-27T23:46:00.387+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:46:00.388107384Z [2024-06-27T23:46:00.387+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:46:00.388533916Z [2024-06-27T23:46:00.388+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:46:00.388886706Z [2024-06-27T23:46:00.388+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:46:00.390038977Z [2024-06-27T23:46:00.389+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:46:00.390058526Z 2024-06-27T23:46:00.390065274Z 2024-06-27T23:46:00.390070673Z 2024-06-27T23:46:00.390076187Z 2024-06-27T23:46:00.397416367Z [2024-06-27T23:46:00.396+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:46:00.398044836Z [2024-06-27T23:46:00.397+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:46:00.399259395Z [2024-06-27T23:46:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:46:00.399694130Z [2024-06-27T23:46:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:46:00.400110719Z [2024-06-27T23:46:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:46:00.400734661Z [2024-06-27T23:46:00.400+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:46:00.401450921Z [2024-06-27T23:46:00.401+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:46:00.401684968Z [2024-06-27T23:46:00.401+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:46:00.907944741Z [2024-06-27T23:46:00.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:44:00+00:00 exited with status queued for try_number 1 2024-06-27T23:46:00.908177844Z [2024-06-27T23:46:00.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:45:00+00:00 exited with status queued for try_number 1 2024-06-27T23:46:00.908279698Z [2024-06-27T23:46:00.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:45:00+00:00 exited with status queued for try_number 1 2024-06-27T23:46:00.908395524Z [2024-06-27T23:46:00.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:45:00+00:00 exited with status queued for try_number 1 2024-06-27T23:46:00.928227126Z [2024-06-27T23:46:00.927+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92e1b3ad-cfc2-401f-81ce-36a123884e50 2024-06-27T23:46:00.928462574Z [2024-06-27T23:46:00.928+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a380033-eeda-4fc6-89ed-066413791ac8 2024-06-27T23:46:00.929029393Z [2024-06-27T23:46:00.928+0000] {scheduler_job.py:635} INFO - Setting external_id for to edba5393-60d8-4219-b7b1-abe1fc7d6c8e 2024-06-27T23:46:00.929243051Z [2024-06-27T23:46:00.929+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86e39b9a-93f1-4363-b1bb-1861564f60cf 2024-06-27T23:46:02.182836309Z [2024-06-27T23:46:02.182+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:46:02.183378659Z [2024-06-27T23:46:02.183+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:44:00+00:00, run_id=scheduled__2024-06-27T23:44:00+00:00, run_start_date=2024-06-27 23:46:00.301275+00:00, run_end_date=2024-06-27 23:46:02.182814+00:00, run_duration=1.881539, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:44:00+00:00, data_interval_end=2024-06-27 23:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:46:02.195711235Z [2024-06-27T23:46:02.192+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:46:00+00:00, run_after=2024-06-27T23:48:00+00:00 2024-06-27T23:46:02.203444096Z [2024-06-27T23:46:02.202+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:46:02.203465754Z [2024-06-27T23:46:02.202+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:45:00+00:00, run_id=scheduled__2024-06-27T23:45:00+00:00, run_start_date=2024-06-27 23:46:00.302591+00:00, run_end_date=2024-06-27 23:46:02.202876+00:00, run_duration=1.900285, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:45:00+00:00, data_interval_end=2024-06-27 23:46:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:46:02.214290484Z [2024-06-27T23:46:02.214+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:46:00+00:00, run_after=2024-06-27T23:47:00+00:00 2024-06-27T23:46:02.269531178Z [2024-06-27T23:46:02.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:44:00+00:00 exited with status success for try_number 1 2024-06-27T23:46:02.269558338Z [2024-06-27T23:46:02.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:45:00+00:00 exited with status success for try_number 1 2024-06-27T23:46:02.276135389Z [2024-06-27T23:46:02.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:44:00+00:00, map_index=-1, run_start_date=2024-06-27 23:46:01.457030+00:00, run_end_date=2024-06-27 23:46:01.900444+00:00, run_duration=0.443414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=335, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:46:00.391544+00:00, queued_by_job_id=2, pid=4939 2024-06-27T23:46:02.276406997Z [2024-06-27T23:46:02.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:45:00+00:00, map_index=-1, run_start_date=2024-06-27 23:46:01.488796+00:00, run_end_date=2024-06-27 23:46:01.989954+00:00, run_duration=0.501158, state=success, executor_state=success, try_number=1, max_tries=1, job_id=336, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:46:00.391544+00:00, queued_by_job_id=2, pid=4940 2024-06-27T23:46:05.120742288Z [2024-06-27T23:46:05.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:46:05.121574563Z [2024-06-27T23:46:05.121+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:45:00+00:00, run_id=scheduled__2024-06-27T23:45:00+00:00, run_start_date=2024-06-27 23:46:00.303973+00:00, run_end_date=2024-06-27 23:46:05.120669+00:00, run_duration=4.816696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:45:00+00:00, data_interval_end=2024-06-27 23:46:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:46:05.132422453Z [2024-06-27T23:46:05.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:46:00+00:00, run_after=2024-06-27T23:47:00+00:00 2024-06-27T23:46:05.207329589Z [2024-06-27T23:46:05.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:45:00+00:00 exited with status success for try_number 1 2024-06-27T23:46:05.213019874Z [2024-06-27T23:46:05.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:45:00+00:00, map_index=-1, run_start_date=2024-06-27 23:46:02.684769+00:00, run_end_date=2024-06-27 23:46:04.566464+00:00, run_duration=1.881695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=337, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:46:00.391544+00:00, queued_by_job_id=2, pid=4963 2024-06-27T23:46:06.033007714Z [2024-06-27T23:46:06.032+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:46:06.033563677Z [2024-06-27T23:46:06.033+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:45:00+00:00, run_id=scheduled__2024-06-27T23:45:00+00:00, run_start_date=2024-06-27 23:46:00.306669+00:00, run_end_date=2024-06-27 23:46:06.033255+00:00, run_duration=5.726586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:45:00+00:00, data_interval_end=2024-06-27 23:46:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:46:06.042896339Z [2024-06-27T23:46:06.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:46:00+00:00, run_after=2024-06-27T23:47:00+00:00 2024-06-27T23:46:06.076940483Z [2024-06-27T23:46:06.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:45:00+00:00 exited with status success for try_number 1 2024-06-27T23:46:06.081324320Z [2024-06-27T23:46:06.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:45:00+00:00, map_index=-1, run_start_date=2024-06-27 23:46:02.770158+00:00, run_end_date=2024-06-27 23:46:05.880399+00:00, run_duration=3.110241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:46:00.391544+00:00, queued_by_job_id=2, pid=4964 2024-06-27T23:46:44.974650404Z [2024-06-27T23:46:44.974+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T23:47:01.023515358Z [2024-06-27T23:47:01.023+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:47:00+00:00, run_after=2024-06-27T23:48:00+00:00 2024-06-27T23:47:01.038548102Z [2024-06-27T23:47:01.038+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:47:01.055210509Z [2024-06-27T23:47:01.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:47:00+00:00, run_after=2024-06-27T23:48:00+00:00 2024-06-27T23:47:01.136783825Z [2024-06-27T23:47:01.136+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:47:01.136820623Z 2024-06-27T23:47:01.136827381Z 2024-06-27T23:47:01.136833246Z 2024-06-27T23:47:01.136897013Z [2024-06-27T23:47:01.136+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:47:01.137117804Z [2024-06-27T23:47:01.136+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:47:01.137267697Z [2024-06-27T23:47:01.137+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:47:01.138373090Z [2024-06-27T23:47:01.138+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:47:01.138393891Z 2024-06-27T23:47:01.138402714Z 2024-06-27T23:47:01.138410901Z 2024-06-27T23:47:01.143444961Z [2024-06-27T23:47:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:47:01.143800722Z [2024-06-27T23:47:01.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:47:01.144165487Z [2024-06-27T23:47:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:47:01.144405758Z [2024-06-27T23:47:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:47:01.144742987Z [2024-06-27T23:47:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:47:01.144897684Z [2024-06-27T23:47:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:47:01.475876814Z [2024-06-27T23:47:01.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:46:00+00:00 exited with status queued for try_number 1 2024-06-27T23:47:01.478368365Z [2024-06-27T23:47:01.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:46:00+00:00 exited with status queued for try_number 1 2024-06-27T23:47:01.478546349Z [2024-06-27T23:47:01.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:46:00+00:00 exited with status queued for try_number 1 2024-06-27T23:47:01.486090618Z [2024-06-27T23:47:01.485+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8645ff46-b5cf-4cb0-b38e-72ad6f1055c1 2024-06-27T23:47:01.486293605Z [2024-06-27T23:47:01.486+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6d26e90-1a12-489c-8e6f-0fa51c87f968 2024-06-27T23:47:01.486480932Z [2024-06-27T23:47:01.486+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b16999c-8756-4c1b-9612-30bbfc23c728 2024-06-27T23:47:02.956783592Z [2024-06-27T23:47:02.956+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:47:02.957108752Z [2024-06-27T23:47:02.956+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:46:00+00:00, run_id=scheduled__2024-06-27T23:46:00+00:00, run_start_date=2024-06-27 23:47:01.073832+00:00, run_end_date=2024-06-27 23:47:02.956763+00:00, run_duration=1.882931, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:46:00+00:00, data_interval_end=2024-06-27 23:47:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:47:02.966837590Z [2024-06-27T23:47:02.966+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:47:00+00:00, run_after=2024-06-27T23:48:00+00:00 2024-06-27T23:47:03.023371105Z [2024-06-27T23:47:03.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:46:00+00:00 exited with status success for try_number 1 2024-06-27T23:47:03.028467894Z [2024-06-27T23:47:03.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:46:00+00:00, map_index=-1, run_start_date=2024-06-27 23:47:02.084775+00:00, run_end_date=2024-06-27 23:47:02.534488+00:00, run_duration=0.449713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:47:01.139410+00:00, queued_by_job_id=2, pid=4997 2024-06-27T23:47:05.697362931Z [2024-06-27T23:47:05.696+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:47:05.697740648Z [2024-06-27T23:47:05.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:46:00+00:00, run_id=scheduled__2024-06-27T23:46:00+00:00, run_start_date=2024-06-27 23:47:01.075851+00:00, run_end_date=2024-06-27 23:47:05.697265+00:00, run_duration=4.621414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:46:00+00:00, data_interval_end=2024-06-27 23:47:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:47:05.708948694Z [2024-06-27T23:47:05.708+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:47:00+00:00, run_after=2024-06-27T23:48:00+00:00 2024-06-27T23:47:05.742856998Z [2024-06-27T23:47:05.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:46:00+00:00 exited with status success for try_number 1 2024-06-27T23:47:05.751090967Z [2024-06-27T23:47:05.750+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:46:00+00:00, map_index=-1, run_start_date=2024-06-27 23:47:03.224718+00:00, run_end_date=2024-06-27 23:47:04.966948+00:00, run_duration=1.74223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=340, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:47:01.139410+00:00, queued_by_job_id=2, pid=5015 2024-06-27T23:47:06.823008063Z [2024-06-27T23:47:06.822+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:47:06.823507278Z [2024-06-27T23:47:06.823+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:46:00+00:00, run_id=scheduled__2024-06-27T23:46:00+00:00, run_start_date=2024-06-27 23:47:01.077097+00:00, run_end_date=2024-06-27 23:47:06.823022+00:00, run_duration=5.745925, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:46:00+00:00, data_interval_end=2024-06-27 23:47:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:47:06.835622456Z [2024-06-27T23:47:06.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:47:00+00:00, run_after=2024-06-27T23:48:00+00:00 2024-06-27T23:47:06.882933342Z [2024-06-27T23:47:06.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:46:00+00:00 exited with status success for try_number 1 2024-06-27T23:47:06.892648269Z [2024-06-27T23:47:06.892+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:46:00+00:00, map_index=-1, run_start_date=2024-06-27 23:47:03.410965+00:00, run_end_date=2024-06-27 23:47:05.567108+00:00, run_duration=2.156143, state=success, executor_state=success, try_number=1, max_tries=1, job_id=341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:47:01.139410+00:00, queued_by_job_id=2, pid=5016 2024-06-27T23:48:00.930538613Z [2024-06-27T23:48:00.930+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:48:00+00:00, run_after=2024-06-27T23:49:00+00:00 2024-06-27T23:48:00.943123014Z [2024-06-27T23:48:00.942+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:48:00+00:00, run_after=2024-06-27T23:49:00+00:00 2024-06-27T23:48:00.950118316Z [2024-06-27T23:48:00.949+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:48:00.956718137Z [2024-06-27T23:48:00.956+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:48:01.046284494Z [2024-06-27T23:48:01.045+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:48:01.046313011Z 2024-06-27T23:48:01.046318967Z 2024-06-27T23:48:01.046323582Z 2024-06-27T23:48:01.046328058Z 2024-06-27T23:48:01.046634621Z [2024-06-27T23:48:01.046+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:48:01.046961363Z [2024-06-27T23:48:01.046+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:48:01.047222147Z [2024-06-27T23:48:01.047+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:48:01.047482419Z [2024-06-27T23:48:01.047+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:48:01.048401289Z [2024-06-27T23:48:01.048+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:48:01.048416694Z 2024-06-27T23:48:01.048421966Z 2024-06-27T23:48:01.048445540Z 2024-06-27T23:48:01.048450633Z 2024-06-27T23:48:01.052966374Z [2024-06-27T23:48:01.052+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:48:01.053294552Z [2024-06-27T23:48:01.053+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:48:01.053708791Z [2024-06-27T23:48:01.053+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:48:01.054005850Z [2024-06-27T23:48:01.053+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:48:01.054392378Z [2024-06-27T23:48:01.054+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:48:01.054650295Z [2024-06-27T23:48:01.054+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:48:01.055098025Z [2024-06-27T23:48:01.054+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:48:01.055378401Z [2024-06-27T23:48:01.055+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:48:01.564639087Z [2024-06-27T23:48:01.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:46:00+00:00 exited with status queued for try_number 1 2024-06-27T23:48:01.568514229Z [2024-06-27T23:48:01.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:47:00+00:00 exited with status queued for try_number 1 2024-06-27T23:48:01.568705090Z [2024-06-27T23:48:01.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:47:00+00:00 exited with status queued for try_number 1 2024-06-27T23:48:01.568860232Z [2024-06-27T23:48:01.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:47:00+00:00 exited with status queued for try_number 1 2024-06-27T23:48:01.591550271Z [2024-06-27T23:48:01.591+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33051174-9711-4948-989d-a4ddf38605ea 2024-06-27T23:48:01.595190718Z [2024-06-27T23:48:01.594+0000] {scheduler_job.py:635} INFO - Setting external_id for to 066fa14f-84aa-4e60-bc53-4200ea244313 2024-06-27T23:48:01.595434389Z [2024-06-27T23:48:01.595+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7bd84c79-7fe4-486e-8727-b6914b07351e 2024-06-27T23:48:01.595586648Z [2024-06-27T23:48:01.595+0000] {scheduler_job.py:635} INFO - Setting external_id for to b46c9569-5a41-4f9a-8e15-c7331ad12eac 2024-06-27T23:48:02.798477552Z [2024-06-27T23:48:02.798+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:48:02.798837698Z [2024-06-27T23:48:02.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:46:00+00:00, run_id=scheduled__2024-06-27T23:46:00+00:00, run_start_date=2024-06-27 23:48:00.966573+00:00, run_end_date=2024-06-27 23:48:02.798440+00:00, run_duration=1.831867, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:46:00+00:00, data_interval_end=2024-06-27 23:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:48:02.807823490Z [2024-06-27T23:48:02.807+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:48:00+00:00, run_after=2024-06-27T23:50:00+00:00 2024-06-27T23:48:02.823955652Z [2024-06-27T23:48:02.823+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:48:02.824281842Z [2024-06-27T23:48:02.824+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:47:00+00:00, run_id=scheduled__2024-06-27T23:47:00+00:00, run_start_date=2024-06-27 23:48:00.968990+00:00, run_end_date=2024-06-27 23:48:02.823880+00:00, run_duration=1.85489, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:47:00+00:00, data_interval_end=2024-06-27 23:48:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:48:02.836409109Z [2024-06-27T23:48:02.836+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:48:00+00:00, run_after=2024-06-27T23:49:00+00:00 2024-06-27T23:48:02.907040381Z [2024-06-27T23:48:02.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:46:00+00:00 exited with status success for try_number 1 2024-06-27T23:48:02.907531969Z [2024-06-27T23:48:02.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:47:00+00:00 exited with status success for try_number 1 2024-06-27T23:48:02.914813517Z [2024-06-27T23:48:02.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:46:00+00:00, map_index=-1, run_start_date=2024-06-27 23:48:01.963847+00:00, run_end_date=2024-06-27 23:48:02.423864+00:00, run_duration=0.460017, state=success, executor_state=success, try_number=1, max_tries=1, job_id=342, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:48:01.049626+00:00, queued_by_job_id=2, pid=5049 2024-06-27T23:48:02.915148713Z [2024-06-27T23:48:02.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:47:00+00:00, map_index=-1, run_start_date=2024-06-27 23:48:02.194503+00:00, run_end_date=2024-06-27 23:48:02.653697+00:00, run_duration=0.459194, state=success, executor_state=success, try_number=1, max_tries=1, job_id=343, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:48:01.049626+00:00, queued_by_job_id=2, pid=5050 2024-06-27T23:48:05.111662582Z [2024-06-27T23:48:05.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:48:05.112025511Z [2024-06-27T23:48:05.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:47:00+00:00, run_id=scheduled__2024-06-27T23:47:00+00:00, run_start_date=2024-06-27 23:48:00.970398+00:00, run_end_date=2024-06-27 23:48:05.111705+00:00, run_duration=4.141307, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:47:00+00:00, data_interval_end=2024-06-27 23:48:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:48:05.123197132Z [2024-06-27T23:48:05.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:48:00+00:00, run_after=2024-06-27T23:49:00+00:00 2024-06-27T23:48:06.260289933Z [2024-06-27T23:48:06.259+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:48:06.260299460Z [2024-06-27T23:48:06.260+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:47:00+00:00, run_id=scheduled__2024-06-27T23:47:00+00:00, run_start_date=2024-06-27 23:48:00.971731+00:00, run_end_date=2024-06-27 23:48:06.260015+00:00, run_duration=5.288284, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:47:00+00:00, data_interval_end=2024-06-27 23:48:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:48:06.289485798Z [2024-06-27T23:48:06.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:48:00+00:00, run_after=2024-06-27T23:49:00+00:00 2024-06-27T23:48:06.335826553Z [2024-06-27T23:48:06.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:47:00+00:00 exited with status success for try_number 1 2024-06-27T23:48:06.336095823Z [2024-06-27T23:48:06.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:47:00+00:00 exited with status success for try_number 1 2024-06-27T23:48:06.344730093Z [2024-06-27T23:48:06.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:47:00+00:00, map_index=-1, run_start_date=2024-06-27 23:48:03.403751+00:00, run_end_date=2024-06-27 23:48:05.064515+00:00, run_duration=1.660764, state=success, executor_state=success, try_number=1, max_tries=1, job_id=344, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:48:01.049626+00:00, queued_by_job_id=2, pid=5073 2024-06-27T23:48:06.345103650Z [2024-06-27T23:48:06.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:47:00+00:00, map_index=-1, run_start_date=2024-06-27 23:48:03.462675+00:00, run_end_date=2024-06-27 23:48:05.345969+00:00, run_duration=1.883294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=345, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:48:01.049626+00:00, queued_by_job_id=2, pid=5074 2024-06-27T23:49:00.931571592Z [2024-06-27T23:49:00.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:49:00+00:00, run_after=2024-06-27T23:50:00+00:00 2024-06-27T23:49:00.944000399Z [2024-06-27T23:49:00.943+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:49:00.965176624Z [2024-06-27T23:49:00.964+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:49:00+00:00, run_after=2024-06-27T23:50:00+00:00 2024-06-27T23:49:01.049838418Z [2024-06-27T23:49:01.049+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:49:01.049874513Z 2024-06-27T23:49:01.049884484Z 2024-06-27T23:49:01.049893331Z 2024-06-27T23:49:01.050303339Z [2024-06-27T23:49:01.049+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:49:01.051504509Z [2024-06-27T23:49:01.050+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:49:01.051890562Z [2024-06-27T23:49:01.051+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:49:01.053621829Z [2024-06-27T23:49:01.053+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:49:01.053637673Z 2024-06-27T23:49:01.053679141Z 2024-06-27T23:49:01.053686697Z 2024-06-27T23:49:01.059983591Z [2024-06-27T23:49:01.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:49:01.060403884Z [2024-06-27T23:49:01.059+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:49:01.060958719Z [2024-06-27T23:49:01.060+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:49:01.061431145Z [2024-06-27T23:49:01.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:49:01.061931299Z [2024-06-27T23:49:01.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:49:01.062296302Z [2024-06-27T23:49:01.061+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:49:01.378859501Z [2024-06-27T23:49:01.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:48:00+00:00 exited with status queued for try_number 1 2024-06-27T23:49:01.379433942Z [2024-06-27T23:49:01.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:48:00+00:00 exited with status queued for try_number 1 2024-06-27T23:49:01.380137248Z [2024-06-27T23:49:01.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:48:00+00:00 exited with status queued for try_number 1 2024-06-27T23:49:01.397583091Z [2024-06-27T23:49:01.397+0000] {scheduler_job.py:635} INFO - Setting external_id for to f068e968-0340-4077-a83f-c698d890d255 2024-06-27T23:49:01.398778306Z [2024-06-27T23:49:01.397+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2277544d-1c59-47f1-a613-e8d62ded6320 2024-06-27T23:49:01.399754560Z [2024-06-27T23:49:01.399+0000] {scheduler_job.py:635} INFO - Setting external_id for to 714a2d77-279f-4f46-b488-f116eadaf1a4 2024-06-27T23:49:02.649463870Z [2024-06-27T23:49:02.649+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:49:02.652071712Z [2024-06-27T23:49:02.651+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:48:00+00:00, run_id=scheduled__2024-06-27T23:48:00+00:00, run_start_date=2024-06-27 23:49:00.977103+00:00, run_end_date=2024-06-27 23:49:02.649394+00:00, run_duration=1.672291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:48:00+00:00, data_interval_end=2024-06-27 23:49:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:49:02.678885843Z [2024-06-27T23:49:02.677+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:49:00+00:00, run_after=2024-06-27T23:50:00+00:00 2024-06-27T23:49:03.836721879Z [2024-06-27T23:49:03.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:48:00+00:00 exited with status success for try_number 1 2024-06-27T23:49:03.847473098Z [2024-06-27T23:49:03.847+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:48:00+00:00, map_index=-1, run_start_date=2024-06-27 23:49:02.052552+00:00, run_end_date=2024-06-27 23:49:02.593120+00:00, run_duration=0.540568, state=success, executor_state=success, try_number=1, max_tries=1, job_id=346, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:49:01.055036+00:00, queued_by_job_id=2, pid=5105 2024-06-27T23:49:06.760023698Z [2024-06-27T23:49:06.759+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:49:06.760390114Z [2024-06-27T23:49:06.760+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:48:00+00:00, run_id=scheduled__2024-06-27T23:48:00+00:00, run_start_date=2024-06-27 23:49:00.981606+00:00, run_end_date=2024-06-27 23:49:06.759958+00:00, run_duration=5.778352, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:48:00+00:00, data_interval_end=2024-06-27 23:49:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:49:06.770163671Z [2024-06-27T23:49:06.769+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:49:00+00:00, run_after=2024-06-27T23:50:00+00:00 2024-06-27T23:49:06.827849250Z [2024-06-27T23:49:06.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:48:00+00:00 exited with status success for try_number 1 2024-06-27T23:49:06.846023485Z [2024-06-27T23:49:06.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:48:00+00:00, map_index=-1, run_start_date=2024-06-27 23:49:03.378240+00:00, run_end_date=2024-06-27 23:49:05.707285+00:00, run_duration=2.329045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=347, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:49:01.055036+00:00, queued_by_job_id=2, pid=5123 2024-06-27T23:49:07.910087159Z [2024-06-27T23:49:07.909+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:49:07.910587097Z [2024-06-27T23:49:07.910+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:48:00+00:00, run_id=scheduled__2024-06-27T23:48:00+00:00, run_start_date=2024-06-27 23:49:00.979540+00:00, run_end_date=2024-06-27 23:49:07.910200+00:00, run_duration=6.93066, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:48:00+00:00, data_interval_end=2024-06-27 23:49:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:49:07.920773072Z [2024-06-27T23:49:07.920+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:49:00+00:00, run_after=2024-06-27T23:50:00+00:00 2024-06-27T23:49:07.951252361Z [2024-06-27T23:49:07.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:48:00+00:00 exited with status success for try_number 1 2024-06-27T23:49:07.956387600Z [2024-06-27T23:49:07.956+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:48:00+00:00, map_index=-1, run_start_date=2024-06-27 23:49:03.414815+00:00, run_end_date=2024-06-27 23:49:06.886978+00:00, run_duration=3.472163, state=success, executor_state=success, try_number=1, max_tries=1, job_id=348, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:49:01.055036+00:00, queued_by_job_id=2, pid=5124 2024-06-27T23:50:00.912030436Z [2024-06-27T23:50:00.911+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:50:00.939310800Z [2024-06-27T23:50:00.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:50:00+00:00, run_after=2024-06-27T23:55:00+00:00 2024-06-27T23:50:00.954587489Z [2024-06-27T23:50:00.953+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:50:00+00:00, run_after=2024-06-27T23:51:00+00:00 2024-06-27T23:50:00.986320200Z [2024-06-27T23:50:00.985+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:50:00+00:00, run_after=2024-06-27T23:51:00+00:00 2024-06-27T23:50:01.005179150Z [2024-06-27T23:50:01.004+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:50:01.122995815Z [2024-06-27T23:50:01.122+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-27T23:50:01.123017154Z 2024-06-27T23:50:01.123022136Z 2024-06-27T23:50:01.123051664Z 2024-06-27T23:50:01.123056690Z 2024-06-27T23:50:01.123061470Z 2024-06-27T23:50:01.123336047Z [2024-06-27T23:50:01.122+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:50:01.123532537Z [2024-06-27T23:50:01.123+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:50:01.124463696Z [2024-06-27T23:50:01.123+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:50:01.126768050Z [2024-06-27T23:50:01.124+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:50:01.126955106Z [2024-06-27T23:50:01.126+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:50:01.128348159Z [2024-06-27T23:50:01.128+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:50:01.128360264Z 2024-06-27T23:50:01.128364476Z 2024-06-27T23:50:01.128381033Z 2024-06-27T23:50:01.128384287Z 2024-06-27T23:50:01.128387362Z 2024-06-27T23:50:01.139051480Z [2024-06-27T23:50:01.136+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T23:50:01.139279835Z [2024-06-27T23:50:01.139+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:50:01.139602833Z [2024-06-27T23:50:01.139+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:50:01.139773189Z [2024-06-27T23:50:01.139+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:50:01.140077715Z [2024-06-27T23:50:01.139+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:50:01.140243403Z [2024-06-27T23:50:01.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:50:01.140557656Z [2024-06-27T23:50:01.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:50:01.140843303Z [2024-06-27T23:50:01.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:50:01.141135898Z [2024-06-27T23:50:01.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:50:01.141324264Z [2024-06-27T23:50:01.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:50:01.833035641Z [2024-06-27T23:50:01.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:45:00+00:00 exited with status queued for try_number 1 2024-06-27T23:50:01.835319380Z [2024-06-27T23:50:01.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:48:00+00:00 exited with status queued for try_number 1 2024-06-27T23:50:01.835547918Z [2024-06-27T23:50:01.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:49:00+00:00 exited with status queued for try_number 1 2024-06-27T23:50:01.835674891Z [2024-06-27T23:50:01.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:49:00+00:00 exited with status queued for try_number 1 2024-06-27T23:50:01.838824162Z [2024-06-27T23:50:01.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:49:00+00:00 exited with status queued for try_number 1 2024-06-27T23:50:01.882459127Z [2024-06-27T23:50:01.882+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00141ff8-0aad-471c-a319-95453cf3ce9a 2024-06-27T23:50:01.882646875Z [2024-06-27T23:50:01.882+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0e3f3e4-cbbf-4de5-abac-b2cd06ed6dc9 2024-06-27T23:50:01.882877378Z [2024-06-27T23:50:01.882+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7dd5744-1c3d-4888-b34c-95abcbc11123 2024-06-27T23:50:01.892517659Z [2024-06-27T23:50:01.892+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb27f741-9ef1-42ed-8a4f-916b4b29a729 2024-06-27T23:50:01.893279956Z [2024-06-27T23:50:01.893+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5b72d8f-d940-4460-869a-b5312dc1627f 2024-06-27T23:50:04.430354437Z [2024-06-27T23:50:04.429+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:50:04.430700832Z [2024-06-27T23:50:04.430+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:48:00+00:00, run_id=scheduled__2024-06-27T23:48:00+00:00, run_start_date=2024-06-27 23:50:01.020328+00:00, run_end_date=2024-06-27 23:50:04.430351+00:00, run_duration=3.410023, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:48:00+00:00, data_interval_end=2024-06-27 23:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:50:04.440454987Z [2024-06-27T23:50:04.440+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:50:00+00:00, run_after=2024-06-27T23:52:00+00:00 2024-06-27T23:50:04.448404626Z [2024-06-27T23:50:04.448+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:50:04.449031042Z [2024-06-27T23:50:04.448+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:49:00+00:00, run_id=scheduled__2024-06-27T23:49:00+00:00, run_start_date=2024-06-27 23:50:01.021625+00:00, run_end_date=2024-06-27 23:50:04.448408+00:00, run_duration=3.426783, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:49:00+00:00, data_interval_end=2024-06-27 23:50:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:50:04.460294867Z [2024-06-27T23:50:04.460+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:50:00+00:00, run_after=2024-06-27T23:51:00+00:00 2024-06-27T23:50:04.611361990Z [2024-06-27T23:50:04.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:48:00+00:00 exited with status success for try_number 1 2024-06-27T23:50:04.611512152Z [2024-06-27T23:50:04.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:49:00+00:00 exited with status success for try_number 1 2024-06-27T23:50:04.627600045Z [2024-06-27T23:50:04.627+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:48:00+00:00, map_index=-1, run_start_date=2024-06-27 23:50:02.871008+00:00, run_end_date=2024-06-27 23:50:03.964992+00:00, run_duration=1.093984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=350, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:50:01.131573+00:00, queued_by_job_id=2, pid=5159 2024-06-27T23:50:04.627846704Z [2024-06-27T23:50:04.627+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:49:00+00:00, map_index=-1, run_start_date=2024-06-27 23:50:02.631180+00:00, run_end_date=2024-06-27 23:50:03.947930+00:00, run_duration=1.31675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=349, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:50:01.131573+00:00, queued_by_job_id=2, pid=5158 2024-06-27T23:50:08.969679657Z [2024-06-27T23:50:08.969+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:50:08.969703390Z 2024-06-27T23:50:08.969998667Z [2024-06-27T23:50:08.969+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:50:08.970712046Z [2024-06-27T23:50:08.970+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:50:08.970726200Z 2024-06-27T23:50:08.980247559Z [2024-06-27T23:50:08.979+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-27T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T23:50:08.980442955Z [2024-06-27T23:50:08.980+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-27T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:50:09.174077562Z [2024-06-27T23:50:09.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:45:00+00:00 exited with status queued for try_number 1 2024-06-27T23:50:09.174107430Z [2024-06-27T23:50:09.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:45:00+00:00 exited with status success for try_number 1 2024-06-27T23:50:09.183848076Z [2024-06-27T23:50:09.183+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffa85a52-7914-4844-a4ac-c7ed787117bc 2024-06-27T23:50:09.184060978Z [2024-06-27T23:50:09.183+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T23:45:00+00:00, map_index=-1, run_start_date=2024-06-27 23:50:07.332627+00:00, run_end_date=2024-06-27 23:50:08.501724+00:00, run_duration=1.169097, state=success, executor_state=success, try_number=1, max_tries=1, job_id=352, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:50:01.131573+00:00, queued_by_job_id=2, pid=5189 2024-06-27T23:50:10.240396007Z [2024-06-27T23:50:10.239+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:50:10.245401289Z [2024-06-27T23:50:10.245+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:49:00+00:00, run_id=scheduled__2024-06-27T23:49:00+00:00, run_start_date=2024-06-27 23:50:01.022827+00:00, run_end_date=2024-06-27 23:50:10.240296+00:00, run_duration=9.217469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:49:00+00:00, data_interval_end=2024-06-27 23:50:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:50:10.304508422Z [2024-06-27T23:50:10.304+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:50:00+00:00, run_after=2024-06-27T23:51:00+00:00 2024-06-27T23:50:10.608599662Z [2024-06-27T23:50:10.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:49:00+00:00 exited with status success for try_number 1 2024-06-27T23:50:10.618060558Z [2024-06-27T23:50:10.617+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:49:00+00:00, map_index=-1, run_start_date=2024-06-27 23:50:07.073863+00:00, run_end_date=2024-06-27 23:50:09.862293+00:00, run_duration=2.78843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=351, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:50:01.131573+00:00, queued_by_job_id=2, pid=5188 2024-06-27T23:50:11.700284585Z [2024-06-27T23:50:11.699+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:50:11.703507621Z [2024-06-27T23:50:11.703+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:49:00+00:00, run_id=scheduled__2024-06-27T23:49:00+00:00, run_start_date=2024-06-27 23:50:01.024180+00:00, run_end_date=2024-06-27 23:50:11.700183+00:00, run_duration=10.676003, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:49:00+00:00, data_interval_end=2024-06-27 23:50:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:50:11.733426787Z [2024-06-27T23:50:11.733+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:50:00+00:00, run_after=2024-06-27T23:51:00+00:00 2024-06-27T23:50:11.793457654Z [2024-06-27T23:50:11.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:49:00+00:00 exited with status success for try_number 1 2024-06-27T23:50:11.807129375Z [2024-06-27T23:50:11.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:49:00+00:00, map_index=-1, run_start_date=2024-06-27 23:50:07.656287+00:00, run_end_date=2024-06-27 23:50:10.812155+00:00, run_duration=3.155868, state=success, executor_state=success, try_number=1, max_tries=1, job_id=353, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:50:01.131573+00:00, queued_by_job_id=2, pid=5190 2024-06-27T23:50:14.154868783Z [2024-06-27T23:50:14.154+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:50:14.154892684Z 2024-06-27T23:50:14.159949119Z [2024-06-27T23:50:14.154+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:50:14.160598257Z [2024-06-27T23:50:14.160+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:50:14.160612778Z 2024-06-27T23:50:14.164754563Z [2024-06-27T23:50:14.164+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-27T23:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T23:50:14.171727443Z [2024-06-27T23:50:14.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-27T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T23:50:14.310923215Z [2024-06-27T23:50:14.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:45:00+00:00 exited with status queued for try_number 1 2024-06-27T23:50:14.313112996Z [2024-06-27T23:50:14.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:45:00+00:00 exited with status success for try_number 1 2024-06-27T23:50:14.323168229Z [2024-06-27T23:50:14.322+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf77fd61-978a-43ee-9ea7-a94165623d9e 2024-06-27T23:50:14.323323017Z [2024-06-27T23:50:14.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-27T23:45:00+00:00, map_index=-1, run_start_date=2024-06-27 23:50:12.557140+00:00, run_end_date=2024-06-27 23:50:13.107102+00:00, run_duration=0.549962, state=success, executor_state=success, try_number=1, max_tries=1, job_id=354, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:50:08.973655+00:00, queued_by_job_id=2, pid=5213 2024-06-27T23:50:17.751227486Z [2024-06-27T23:50:17.746+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:50:17.751245093Z 2024-06-27T23:50:17.751249263Z [2024-06-27T23:50:17.750+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:50:17.751253240Z [2024-06-27T23:50:17.751+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:50:17.751256500Z 2024-06-27T23:50:17.763081672Z [2024-06-27T23:50:17.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-27T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:50:17.763090663Z [2024-06-27T23:50:17.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-27T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:50:17.950795370Z [2024-06-27T23:50:17.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:45:00+00:00 exited with status queued for try_number 1 2024-06-27T23:50:17.950813078Z [2024-06-27T23:50:17.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:45:00+00:00 exited with status success for try_number 1 2024-06-27T23:50:17.963107746Z [2024-06-27T23:50:17.961+0000] {scheduler_job.py:635} INFO - Setting external_id for to d13856d7-da25-4f7e-bdd9-c11e728b5fa6 2024-06-27T23:50:17.963128084Z [2024-06-27T23:50:17.961+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-27T23:45:00+00:00, map_index=0, run_start_date=2024-06-27 23:50:16.963319+00:00, run_end_date=2024-06-27 23:50:17.419714+00:00, run_duration=0.456395, state=success, executor_state=success, try_number=1, max_tries=1, job_id=355, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:50:14.161030+00:00, queued_by_job_id=2, pid=5231 2024-06-27T23:50:21.888073221Z [2024-06-27T23:50:21.887+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:50:21.888505855Z [2024-06-27T23:50:21.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:45:00+00:00, run_id=scheduled__2024-06-27T23:45:00+00:00, run_start_date=2024-06-27 23:50:01.018577+00:00, run_end_date=2024-06-27 23:50:21.888099+00:00, run_duration=20.869522, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:45:00+00:00, data_interval_end=2024-06-27 23:50:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-27T23:50:21.895649409Z [2024-06-27T23:50:21.894+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:50:00+00:00, run_after=2024-06-27T23:55:00+00:00 2024-06-27T23:50:21.935442956Z [2024-06-27T23:50:21.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:45:00+00:00 exited with status success for try_number 1 2024-06-27T23:50:21.942925501Z [2024-06-27T23:50:21.942+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-27T23:45:00+00:00, map_index=-1, run_start_date=2024-06-27 23:50:20.631751+00:00, run_end_date=2024-06-27 23:50:21.147383+00:00, run_duration=0.515632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=356, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:50:17.758807+00:00, queued_by_job_id=2, pid=5242 2024-06-27T23:51:01.074244190Z [2024-06-27T23:51:01.073+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:51:01.087322829Z [2024-06-27T23:51:01.087+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:51:00+00:00, run_after=2024-06-27T23:52:00+00:00 2024-06-27T23:51:01.103540554Z [2024-06-27T23:51:01.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:51:00+00:00, run_after=2024-06-27T23:52:00+00:00 2024-06-27T23:51:01.178318218Z [2024-06-27T23:51:01.177+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:51:01.178363070Z 2024-06-27T23:51:01.178369421Z 2024-06-27T23:51:01.178374834Z 2024-06-27T23:51:01.178380158Z [2024-06-27T23:51:01.178+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:51:01.178857066Z [2024-06-27T23:51:01.178+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:51:01.179447464Z [2024-06-27T23:51:01.178+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:51:01.180077512Z [2024-06-27T23:51:01.179+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:51:01.180090786Z 2024-06-27T23:51:01.180096694Z 2024-06-27T23:51:01.180101511Z 2024-06-27T23:51:01.185298495Z [2024-06-27T23:51:01.185+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:51:01.186012514Z [2024-06-27T23:51:01.185+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:51:01.187529888Z [2024-06-27T23:51:01.186+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:51:01.187709882Z [2024-06-27T23:51:01.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:51:01.188360237Z [2024-06-27T23:51:01.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:51:01.188604310Z [2024-06-27T23:51:01.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:51:01.552424635Z [2024-06-27T23:51:01.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:50:00+00:00 exited with status queued for try_number 1 2024-06-27T23:51:01.552464878Z [2024-06-27T23:51:01.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:50:00+00:00 exited with status queued for try_number 1 2024-06-27T23:51:01.552759959Z [2024-06-27T23:51:01.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:50:00+00:00 exited with status queued for try_number 1 2024-06-27T23:51:01.572837826Z [2024-06-27T23:51:01.572+0000] {scheduler_job.py:635} INFO - Setting external_id for to 669b884a-732c-452f-9b33-b97495270778 2024-06-27T23:51:01.573021370Z [2024-06-27T23:51:01.572+0000] {scheduler_job.py:635} INFO - Setting external_id for to 844f8bf8-2278-4710-b0b1-03529b02aa42 2024-06-27T23:51:01.573236638Z [2024-06-27T23:51:01.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62f6ec8b-7917-41dc-b2f9-ef8da24883cb 2024-06-27T23:51:02.876299556Z [2024-06-27T23:51:02.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:51:02.877031574Z [2024-06-27T23:51:02.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:50:00+00:00, run_id=scheduled__2024-06-27T23:50:00+00:00, run_start_date=2024-06-27 23:51:01.116361+00:00, run_end_date=2024-06-27 23:51:02.876178+00:00, run_duration=1.759817, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:50:00+00:00, data_interval_end=2024-06-27 23:51:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:51:02.887827024Z [2024-06-27T23:51:02.887+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:51:00+00:00, run_after=2024-06-27T23:52:00+00:00 2024-06-27T23:51:02.942279741Z [2024-06-27T23:51:02.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:50:00+00:00 exited with status success for try_number 1 2024-06-27T23:51:02.950233105Z [2024-06-27T23:51:02.949+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:50:00+00:00, map_index=-1, run_start_date=2024-06-27 23:51:02.227762+00:00, run_end_date=2024-06-27 23:51:02.710949+00:00, run_duration=0.483187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=357, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:51:01.180809+00:00, queued_by_job_id=2, pid=5251 2024-06-27T23:51:05.207972839Z [2024-06-27T23:51:05.207+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:51:05.208524715Z [2024-06-27T23:51:05.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:50:00+00:00, run_id=scheduled__2024-06-27T23:50:00+00:00, run_start_date=2024-06-27 23:51:01.117674+00:00, run_end_date=2024-06-27 23:51:05.207885+00:00, run_duration=4.090211, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:50:00+00:00, data_interval_end=2024-06-27 23:51:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:51:05.218766862Z [2024-06-27T23:51:05.218+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:51:00+00:00, run_after=2024-06-27T23:52:00+00:00 2024-06-27T23:51:06.348997723Z [2024-06-27T23:51:06.348+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:51:06.349026821Z [2024-06-27T23:51:06.348+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:50:00+00:00, run_id=scheduled__2024-06-27T23:50:00+00:00, run_start_date=2024-06-27 23:51:01.118744+00:00, run_end_date=2024-06-27 23:51:06.348658+00:00, run_duration=5.229914, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:50:00+00:00, data_interval_end=2024-06-27 23:51:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:51:06.357754692Z [2024-06-27T23:51:06.357+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:51:00+00:00, run_after=2024-06-27T23:52:00+00:00 2024-06-27T23:51:06.387910613Z [2024-06-27T23:51:06.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:50:00+00:00 exited with status success for try_number 1 2024-06-27T23:51:06.387950792Z [2024-06-27T23:51:06.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:50:00+00:00 exited with status success for try_number 1 2024-06-27T23:51:06.397558246Z [2024-06-27T23:51:06.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:50:00+00:00, map_index=-1, run_start_date=2024-06-27 23:51:03.640852+00:00, run_end_date=2024-06-27 23:51:05.110214+00:00, run_duration=1.469362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=358, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:51:01.180809+00:00, queued_by_job_id=2, pid=5270 2024-06-27T23:51:06.397575264Z [2024-06-27T23:51:06.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:50:00+00:00, map_index=-1, run_start_date=2024-06-27 23:51:03.658064+00:00, run_end_date=2024-06-27 23:51:05.807967+00:00, run_duration=2.149903, state=success, executor_state=success, try_number=1, max_tries=1, job_id=359, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:51:01.180809+00:00, queued_by_job_id=2, pid=5269 2024-06-27T23:51:45.049751629Z [2024-06-27T23:51:45.049+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T23:52:00.497771533Z [2024-06-27T23:52:00.497+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:52:00+00:00, run_after=2024-06-27T23:53:00+00:00 2024-06-27T23:52:00.516439966Z [2024-06-27T23:52:00.515+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:52:00+00:00, run_after=2024-06-27T23:53:00+00:00 2024-06-27T23:52:00.531011815Z [2024-06-27T23:52:00.530+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:52:00.540378987Z [2024-06-27T23:52:00.539+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:52:00.647527385Z [2024-06-27T23:52:00.647+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:52:00.647541941Z 2024-06-27T23:52:00.647546671Z 2024-06-27T23:52:00.647550727Z 2024-06-27T23:52:00.647554534Z 2024-06-27T23:52:00.648158905Z [2024-06-27T23:52:00.647+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:52:00.648189472Z [2024-06-27T23:52:00.647+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:52:00.648193770Z [2024-06-27T23:52:00.647+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:52:00.648197755Z [2024-06-27T23:52:00.647+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:52:00.648971689Z [2024-06-27T23:52:00.648+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:52:00.648982670Z 2024-06-27T23:52:00.648987051Z 2024-06-27T23:52:00.648990816Z 2024-06-27T23:52:00.648994723Z 2024-06-27T23:52:00.657678711Z [2024-06-27T23:52:00.657+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:52:00.657918446Z [2024-06-27T23:52:00.657+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:52:00.658275063Z [2024-06-27T23:52:00.658+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:52:00.658447709Z [2024-06-27T23:52:00.658+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:52:00.658726033Z [2024-06-27T23:52:00.658+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:52:00.658843554Z [2024-06-27T23:52:00.658+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:52:00.659093312Z [2024-06-27T23:52:00.658+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:52:00.659263854Z [2024-06-27T23:52:00.659+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:52:00.982821322Z [2024-06-27T23:52:00.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:50:00+00:00 exited with status queued for try_number 1 2024-06-27T23:52:00.985928128Z [2024-06-27T23:52:00.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:51:00+00:00 exited with status queued for try_number 1 2024-06-27T23:52:00.986201788Z [2024-06-27T23:52:00.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:51:00+00:00 exited with status queued for try_number 1 2024-06-27T23:52:00.986672033Z [2024-06-27T23:52:00.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:51:00+00:00 exited with status queued for try_number 1 2024-06-27T23:52:00.997894829Z [2024-06-27T23:52:00.997+0000] {scheduler_job.py:635} INFO - Setting external_id for to f55c6147-5e71-4b97-b007-6f637c37af02 2024-06-27T23:52:00.998214751Z [2024-06-27T23:52:00.998+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8aa38584-ccee-48c2-9698-47682540cf09 2024-06-27T23:52:00.998487158Z [2024-06-27T23:52:00.998+0000] {scheduler_job.py:635} INFO - Setting external_id for to f73fe8d1-1f8f-41a9-9b59-e5829c0b9b41 2024-06-27T23:52:00.998752299Z [2024-06-27T23:52:00.998+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99b57df9-5096-4df5-8f76-bc6d816720e1 2024-06-27T23:52:02.278675182Z [2024-06-27T23:52:02.278+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:52:02.279110620Z [2024-06-27T23:52:02.278+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:50:00+00:00, run_id=scheduled__2024-06-27T23:50:00+00:00, run_start_date=2024-06-27 23:52:00.557600+00:00, run_end_date=2024-06-27 23:52:02.278768+00:00, run_duration=1.721168, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:50:00+00:00, data_interval_end=2024-06-27 23:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:52:02.286319238Z [2024-06-27T23:52:02.286+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:52:00+00:00, run_after=2024-06-27T23:54:00+00:00 2024-06-27T23:52:02.301557554Z [2024-06-27T23:52:02.301+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:52:02.301912084Z [2024-06-27T23:52:02.301+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:51:00+00:00, run_id=scheduled__2024-06-27T23:51:00+00:00, run_start_date=2024-06-27 23:52:00.559493+00:00, run_end_date=2024-06-27 23:52:02.301586+00:00, run_duration=1.742093, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:51:00+00:00, data_interval_end=2024-06-27 23:52:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:52:02.313985740Z [2024-06-27T23:52:02.313+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:52:00+00:00, run_after=2024-06-27T23:53:00+00:00 2024-06-27T23:52:02.363181901Z [2024-06-27T23:52:02.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:50:00+00:00 exited with status success for try_number 1 2024-06-27T23:52:02.374101923Z [2024-06-27T23:52:02.373+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:50:00+00:00, map_index=-1, run_start_date=2024-06-27 23:52:01.623055+00:00, run_end_date=2024-06-27 23:52:02.012867+00:00, run_duration=0.389812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:52:00.650086+00:00, queued_by_job_id=2, pid=5302 2024-06-27T23:52:03.513517939Z [2024-06-27T23:52:03.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:51:00+00:00 exited with status success for try_number 1 2024-06-27T23:52:03.521935066Z [2024-06-27T23:52:03.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:51:00+00:00, map_index=-1, run_start_date=2024-06-27 23:52:01.667975+00:00, run_end_date=2024-06-27 23:52:02.175929+00:00, run_duration=0.507954, state=success, executor_state=success, try_number=1, max_tries=1, job_id=361, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:52:00.650086+00:00, queued_by_job_id=2, pid=5303 2024-06-27T23:52:05.689903165Z [2024-06-27T23:52:05.689+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:52:05.691240203Z [2024-06-27T23:52:05.690+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:51:00+00:00, run_id=scheduled__2024-06-27T23:51:00+00:00, run_start_date=2024-06-27 23:52:00.561221+00:00, run_end_date=2024-06-27 23:52:05.689962+00:00, run_duration=5.128741, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:51:00+00:00, data_interval_end=2024-06-27 23:52:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:52:05.703179474Z [2024-06-27T23:52:05.702+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:52:00+00:00, run_after=2024-06-27T23:53:00+00:00 2024-06-27T23:52:05.710735538Z [2024-06-27T23:52:05.710+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:52:05.711396813Z [2024-06-27T23:52:05.710+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:51:00+00:00, run_id=scheduled__2024-06-27T23:51:00+00:00, run_start_date=2024-06-27 23:52:00.562593+00:00, run_end_date=2024-06-27 23:52:05.710632+00:00, run_duration=5.148039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:51:00+00:00, data_interval_end=2024-06-27 23:52:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:52:05.721534743Z [2024-06-27T23:52:05.721+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:52:00+00:00, run_after=2024-06-27T23:53:00+00:00 2024-06-27T23:52:05.758385631Z [2024-06-27T23:52:05.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:51:00+00:00 exited with status success for try_number 1 2024-06-27T23:52:05.758674763Z [2024-06-27T23:52:05.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:51:00+00:00 exited with status success for try_number 1 2024-06-27T23:52:05.765262917Z [2024-06-27T23:52:05.764+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:51:00+00:00, map_index=-1, run_start_date=2024-06-27 23:52:03.153520+00:00, run_end_date=2024-06-27 23:52:04.889951+00:00, run_duration=1.736431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=363, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:52:00.650086+00:00, queued_by_job_id=2, pid=5327 2024-06-27T23:52:05.765675229Z [2024-06-27T23:52:05.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:51:00+00:00, map_index=-1, run_start_date=2024-06-27 23:52:03.133464+00:00, run_end_date=2024-06-27 23:52:05.297008+00:00, run_duration=2.163544, state=success, executor_state=success, try_number=1, max_tries=1, job_id=362, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:52:00.650086+00:00, queued_by_job_id=2, pid=5326 2024-06-27T23:53:00.341281487Z [2024-06-27T23:53:00.340+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:53:00.354334802Z [2024-06-27T23:53:00.353+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:53:00+00:00, run_after=2024-06-27T23:54:00+00:00 2024-06-27T23:53:00.370236267Z [2024-06-27T23:53:00.369+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:53:00+00:00, run_after=2024-06-27T23:54:00+00:00 2024-06-27T23:53:00.443023208Z [2024-06-27T23:53:00.442+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:53:00.443090544Z 2024-06-27T23:53:00.443095177Z 2024-06-27T23:53:00.443098573Z 2024-06-27T23:53:00.443287050Z [2024-06-27T23:53:00.443+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:53:00.443501679Z [2024-06-27T23:53:00.443+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:53:00.443717067Z [2024-06-27T23:53:00.443+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:53:00.444337894Z [2024-06-27T23:53:00.444+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:53:00.444350310Z 2024-06-27T23:53:00.444353715Z 2024-06-27T23:53:00.444356743Z 2024-06-27T23:53:00.447345436Z [2024-06-27T23:53:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:53:00.447602243Z [2024-06-27T23:53:00.447+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:53:00.447935426Z [2024-06-27T23:53:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:53:00.448139848Z [2024-06-27T23:53:00.448+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:53:00.448446799Z [2024-06-27T23:53:00.448+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:53:00.449209893Z [2024-06-27T23:53:00.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:53:00.758006956Z [2024-06-27T23:53:00.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:52:00+00:00 exited with status queued for try_number 1 2024-06-27T23:53:00.758071048Z [2024-06-27T23:53:00.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:52:00+00:00 exited with status queued for try_number 1 2024-06-27T23:53:00.758075245Z [2024-06-27T23:53:00.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:52:00+00:00 exited with status queued for try_number 1 2024-06-27T23:53:00.768792933Z [2024-06-27T23:53:00.768+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99518e6d-d2a3-4ae3-8deb-39d712b3a3c5 2024-06-27T23:53:00.768867251Z [2024-06-27T23:53:00.768+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27cb736e-bd5d-4d9d-b7b7-6a2d002b7a81 2024-06-27T23:53:00.768980658Z [2024-06-27T23:53:00.768+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb415547-32f4-41af-ba73-9c18006b1262 2024-06-27T23:53:03.357200632Z [2024-06-27T23:53:03.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:53:03.357740720Z [2024-06-27T23:53:03.357+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:52:00+00:00, run_id=scheduled__2024-06-27T23:52:00+00:00, run_start_date=2024-06-27 23:53:00.382432+00:00, run_end_date=2024-06-27 23:53:03.357168+00:00, run_duration=2.974736, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:52:00+00:00, data_interval_end=2024-06-27 23:53:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:53:03.380251744Z [2024-06-27T23:53:03.379+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:53:00+00:00, run_after=2024-06-27T23:54:00+00:00 2024-06-27T23:53:03.465834456Z [2024-06-27T23:53:03.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:52:00+00:00 exited with status success for try_number 1 2024-06-27T23:53:03.473048972Z [2024-06-27T23:53:03.472+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:52:00+00:00, map_index=-1, run_start_date=2024-06-27 23:53:01.880047+00:00, run_end_date=2024-06-27 23:53:02.477441+00:00, run_duration=0.597394, state=success, executor_state=success, try_number=1, max_tries=1, job_id=364, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:53:00.445085+00:00, queued_by_job_id=2, pid=5358 2024-06-27T23:53:06.886151024Z [2024-06-27T23:53:06.885+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:53:06.886453998Z [2024-06-27T23:53:06.886+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:52:00+00:00, run_id=scheduled__2024-06-27T23:52:00+00:00, run_start_date=2024-06-27 23:53:00.383845+00:00, run_end_date=2024-06-27 23:53:06.886087+00:00, run_duration=6.502242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:52:00+00:00, data_interval_end=2024-06-27 23:53:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:53:06.910477869Z [2024-06-27T23:53:06.910+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:53:00+00:00, run_after=2024-06-27T23:54:00+00:00 2024-06-27T23:53:06.950135210Z [2024-06-27T23:53:06.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:53:06.959746813Z [2024-06-27T23:53:06.959+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:52:00+00:00, run_id=scheduled__2024-06-27T23:52:00+00:00, run_start_date=2024-06-27 23:53:00.385225+00:00, run_end_date=2024-06-27 23:53:06.950051+00:00, run_duration=6.564826, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:52:00+00:00, data_interval_end=2024-06-27 23:53:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:53:07.006102263Z [2024-06-27T23:53:07.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:53:00+00:00, run_after=2024-06-27T23:54:00+00:00 2024-06-27T23:53:07.060028875Z [2024-06-27T23:53:07.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:52:00+00:00 exited with status success for try_number 1 2024-06-27T23:53:07.060063361Z [2024-06-27T23:53:07.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:52:00+00:00 exited with status success for try_number 1 2024-06-27T23:53:07.076773277Z [2024-06-27T23:53:07.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:52:00+00:00, map_index=-1, run_start_date=2024-06-27 23:53:04.056820+00:00, run_end_date=2024-06-27 23:53:05.731514+00:00, run_duration=1.674694, state=success, executor_state=success, try_number=1, max_tries=1, job_id=366, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:53:00.445085+00:00, queued_by_job_id=2, pid=5377 2024-06-27T23:53:07.077242880Z [2024-06-27T23:53:07.077+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:52:00+00:00, map_index=-1, run_start_date=2024-06-27 23:53:03.718899+00:00, run_end_date=2024-06-27 23:53:05.906539+00:00, run_duration=2.18764, state=success, executor_state=success, try_number=1, max_tries=1, job_id=365, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:53:00.445085+00:00, queued_by_job_id=2, pid=5376 2024-06-27T23:54:00.271929476Z [2024-06-27T23:54:00.269+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:54:00.283989811Z [2024-06-27T23:54:00.283+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:54:00+00:00, run_after=2024-06-27T23:55:00+00:00 2024-06-27T23:54:00.319757102Z [2024-06-27T23:54:00.319+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:54:00.346078584Z [2024-06-27T23:54:00.345+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:54:00+00:00, run_after=2024-06-27T23:55:00+00:00 2024-06-27T23:54:00.512892097Z [2024-06-27T23:54:00.512+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:54:00.512914878Z 2024-06-27T23:54:00.512918812Z 2024-06-27T23:54:00.512934243Z 2024-06-27T23:54:00.512937484Z 2024-06-27T23:54:00.513180454Z [2024-06-27T23:54:00.512+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:54:00.513345376Z [2024-06-27T23:54:00.513+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:54:00.513549157Z [2024-06-27T23:54:00.513+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:54:00.513716027Z [2024-06-27T23:54:00.513+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:54:00.514415454Z [2024-06-27T23:54:00.514+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:54:00.514427736Z 2024-06-27T23:54:00.514431780Z 2024-06-27T23:54:00.514435036Z 2024-06-27T23:54:00.514438190Z 2024-06-27T23:54:00.519500680Z [2024-06-27T23:54:00.519+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:54:00.519869186Z [2024-06-27T23:54:00.519+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:54:00.520176580Z [2024-06-27T23:54:00.520+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:54:00.520363170Z [2024-06-27T23:54:00.520+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:54:00.520634264Z [2024-06-27T23:54:00.520+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:54:00.520852799Z [2024-06-27T23:54:00.520+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:54:00.521133398Z [2024-06-27T23:54:00.520+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:54:00.521291275Z [2024-06-27T23:54:00.521+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:54:00.981821925Z [2024-06-27T23:54:00.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:52:00+00:00 exited with status queued for try_number 1 2024-06-27T23:54:00.981862671Z [2024-06-27T23:54:00.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:53:00+00:00 exited with status queued for try_number 1 2024-06-27T23:54:00.994206594Z [2024-06-27T23:54:00.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:53:00+00:00 exited with status queued for try_number 1 2024-06-27T23:54:00.994759479Z [2024-06-27T23:54:00.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:53:00+00:00 exited with status queued for try_number 1 2024-06-27T23:54:01.015009587Z [2024-06-27T23:54:01.014+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09cc3336-7ec9-4dd1-9ab5-e4fbdde2e4f0 2024-06-27T23:54:01.015160002Z [2024-06-27T23:54:01.014+0000] {scheduler_job.py:635} INFO - Setting external_id for to 654636a3-1d76-46a3-b482-a2ec693e9587 2024-06-27T23:54:01.015305593Z [2024-06-27T23:54:01.015+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa33eaa8-869d-44f1-8d13-7c60f79dbbd1 2024-06-27T23:54:01.015422646Z [2024-06-27T23:54:01.015+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbc9c1f3-775f-4eb1-921e-b4eb82db2cea 2024-06-27T23:54:03.549658254Z [2024-06-27T23:54:03.548+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:54:03.550325727Z [2024-06-27T23:54:03.549+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:52:00+00:00, run_id=scheduled__2024-06-27T23:52:00+00:00, run_start_date=2024-06-27 23:54:00.361975+00:00, run_end_date=2024-06-27 23:54:03.549719+00:00, run_duration=3.187744, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:52:00+00:00, data_interval_end=2024-06-27 23:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:54:03.574343531Z [2024-06-27T23:54:03.570+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:54:00+00:00, run_after=2024-06-27T23:56:00+00:00 2024-06-27T23:54:03.595406247Z [2024-06-27T23:54:03.595+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:54:03.595695663Z [2024-06-27T23:54:03.595+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:53:00+00:00, run_id=scheduled__2024-06-27T23:53:00+00:00, run_start_date=2024-06-27 23:54:00.363382+00:00, run_end_date=2024-06-27 23:54:03.595320+00:00, run_duration=3.231938, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:53:00+00:00, data_interval_end=2024-06-27 23:54:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:54:03.617938089Z [2024-06-27T23:54:03.617+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:54:00+00:00, run_after=2024-06-27T23:55:00+00:00 2024-06-27T23:54:03.693277911Z [2024-06-27T23:54:03.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:52:00+00:00 exited with status success for try_number 1 2024-06-27T23:54:03.694395518Z [2024-06-27T23:54:03.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:53:00+00:00 exited with status success for try_number 1 2024-06-27T23:54:03.741078371Z [2024-06-27T23:54:03.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:52:00+00:00, map_index=-1, run_start_date=2024-06-27 23:54:01.720349+00:00, run_end_date=2024-06-27 23:54:02.603339+00:00, run_duration=0.88299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=367, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:54:00.515539+00:00, queued_by_job_id=2, pid=5409 2024-06-27T23:54:03.742674172Z [2024-06-27T23:54:03.742+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:53:00+00:00, map_index=-1, run_start_date=2024-06-27 23:54:01.798753+00:00, run_end_date=2024-06-27 23:54:02.676667+00:00, run_duration=0.877914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=368, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:54:00.515539+00:00, queued_by_job_id=2, pid=5410 2024-06-27T23:54:06.683507921Z [2024-06-27T23:54:06.683+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:54:06.684609735Z [2024-06-27T23:54:06.684+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:53:00+00:00, run_id=scheduled__2024-06-27T23:53:00+00:00, run_start_date=2024-06-27 23:54:00.365340+00:00, run_end_date=2024-06-27 23:54:06.684050+00:00, run_duration=6.31871, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:53:00+00:00, data_interval_end=2024-06-27 23:54:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:54:06.719869679Z [2024-06-27T23:54:06.719+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:54:00+00:00, run_after=2024-06-27T23:55:00+00:00 2024-06-27T23:54:06.731614910Z [2024-06-27T23:54:06.731+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:54:06.731773832Z [2024-06-27T23:54:06.731+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:53:00+00:00, run_id=scheduled__2024-06-27T23:53:00+00:00, run_start_date=2024-06-27 23:54:00.364377+00:00, run_end_date=2024-06-27 23:54:06.731521+00:00, run_duration=6.367144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:53:00+00:00, data_interval_end=2024-06-27 23:54:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:54:06.755558195Z [2024-06-27T23:54:06.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:54:00+00:00, run_after=2024-06-27T23:55:00+00:00 2024-06-27T23:54:06.785180205Z [2024-06-27T23:54:06.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:53:00+00:00 exited with status success for try_number 1 2024-06-27T23:54:06.785209417Z [2024-06-27T23:54:06.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:53:00+00:00 exited with status success for try_number 1 2024-06-27T23:54:06.791165706Z [2024-06-27T23:54:06.790+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:53:00+00:00, map_index=-1, run_start_date=2024-06-27 23:54:03.905584+00:00, run_end_date=2024-06-27 23:54:06.280104+00:00, run_duration=2.37452, state=success, executor_state=success, try_number=1, max_tries=1, job_id=369, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:54:00.515539+00:00, queued_by_job_id=2, pid=5428 2024-06-27T23:54:06.791337501Z [2024-06-27T23:54:06.791+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:53:00+00:00, map_index=-1, run_start_date=2024-06-27 23:54:04.665274+00:00, run_end_date=2024-06-27 23:54:06.083134+00:00, run_duration=1.41786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=370, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:54:00.515539+00:00, queued_by_job_id=2, pid=5434 2024-06-27T23:55:00.257340240Z [2024-06-27T23:55:00.256+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:55:00+00:00, run_after=2024-06-28T00:00:00+00:00 2024-06-27T23:55:00.264154321Z [2024-06-27T23:55:00.263+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:55:00.280091543Z [2024-06-27T23:55:00.277+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:55:00+00:00, run_after=2024-06-27T23:56:00+00:00 2024-06-27T23:55:00.297758394Z [2024-06-27T23:55:00.297+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:55:00+00:00, run_after=2024-06-27T23:56:00+00:00 2024-06-27T23:55:00.415201191Z [2024-06-27T23:55:00.414+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:55:00.415224872Z 2024-06-27T23:55:00.415255206Z 2024-06-27T23:55:00.415262201Z 2024-06-27T23:55:00.415268669Z 2024-06-27T23:55:00.415284984Z [2024-06-27T23:55:00.415+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:55:00.415339861Z [2024-06-27T23:55:00.415+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:55:00.415432257Z [2024-06-27T23:55:00.415+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:55:00.415500528Z [2024-06-27T23:55:00.415+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:55:00.416117959Z [2024-06-27T23:55:00.415+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:55:00.416133413Z 2024-06-27T23:55:00.416140463Z 2024-06-27T23:55:00.416147074Z 2024-06-27T23:55:00.416153594Z 2024-06-27T23:55:00.421844980Z [2024-06-27T23:55:00.421+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-27T23:55:00.422357265Z [2024-06-27T23:55:00.421+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:55:00.422982910Z [2024-06-27T23:55:00.422+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:55:00.423314817Z [2024-06-27T23:55:00.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:55:00.425481445Z [2024-06-27T23:55:00.425+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:55:00.430685090Z [2024-06-27T23:55:00.426+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:55:00.431262758Z [2024-06-27T23:55:00.431+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:55:00.431537643Z [2024-06-27T23:55:00.431+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:55:00.924360170Z [2024-06-27T23:55:00.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:50:00+00:00 exited with status queued for try_number 1 2024-06-27T23:55:00.924417930Z [2024-06-27T23:55:00.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:54:00+00:00 exited with status queued for try_number 1 2024-06-27T23:55:00.924709376Z [2024-06-27T23:55:00.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:54:00+00:00 exited with status queued for try_number 1 2024-06-27T23:55:00.924796226Z [2024-06-27T23:55:00.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:54:00+00:00 exited with status queued for try_number 1 2024-06-27T23:55:00.955414966Z [2024-06-27T23:55:00.954+0000] {scheduler_job.py:635} INFO - Setting external_id for to 618c7566-e7bc-4a99-9d82-3edcfd0e551f 2024-06-27T23:55:00.958106910Z [2024-06-27T23:55:00.957+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3881589-e443-4fb4-b324-21047f55c8cf 2024-06-27T23:55:00.958141693Z [2024-06-27T23:55:00.957+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e3c9489-e1e0-48ed-88fd-6fd25a3a5512 2024-06-27T23:55:00.959520754Z [2024-06-27T23:55:00.957+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03c163e3-d3b2-4557-9549-cefe716534f7 2024-06-27T23:55:03.497958617Z [2024-06-27T23:55:03.497+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:55:03.498433216Z [2024-06-27T23:55:03.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:54:00+00:00, run_id=scheduled__2024-06-27T23:54:00+00:00, run_start_date=2024-06-27 23:55:00.314225+00:00, run_end_date=2024-06-27 23:55:03.497946+00:00, run_duration=3.183721, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:54:00+00:00, data_interval_end=2024-06-27 23:55:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:55:03.513862746Z [2024-06-27T23:55:03.513+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:55:00+00:00, run_after=2024-06-27T23:56:00+00:00 2024-06-27T23:55:03.689881792Z [2024-06-27T23:55:03.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:54:00+00:00 exited with status success for try_number 1 2024-06-27T23:55:03.704695450Z [2024-06-27T23:55:03.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:54:00+00:00, map_index=-1, run_start_date=2024-06-27 23:55:01.962899+00:00, run_end_date=2024-06-27 23:55:02.862932+00:00, run_duration=0.900033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=371, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:55:00.416966+00:00, queued_by_job_id=2, pid=5468 2024-06-27T23:55:04.821542770Z [2024-06-27T23:55:04.821+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:55:04.821576217Z 2024-06-27T23:55:04.821681504Z [2024-06-27T23:55:04.821+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:55:04.822983821Z [2024-06-27T23:55:04.822+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:55:04.822997906Z 2024-06-27T23:55:04.827466440Z [2024-06-27T23:55:04.827+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-27T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-27T23:55:04.827787750Z [2024-06-27T23:55:04.827+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:55:04.934511885Z [2024-06-27T23:55:04.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:50:00+00:00 exited with status queued for try_number 1 2024-06-27T23:55:04.935968291Z [2024-06-27T23:55:04.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:50:00+00:00 exited with status success for try_number 1 2024-06-27T23:55:04.943856615Z [2024-06-27T23:55:04.943+0000] {scheduler_job.py:635} INFO - Setting external_id for to d92a48c8-88a8-4123-a79f-9f00620fda58 2024-06-27T23:55:04.944245744Z [2024-06-27T23:55:04.944+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T23:50:00+00:00, map_index=-1, run_start_date=2024-06-27 23:55:03.492392+00:00, run_end_date=2024-06-27 23:55:04.039386+00:00, run_duration=0.546994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=373, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:55:00.416966+00:00, queued_by_job_id=2, pid=5493 2024-06-27T23:55:06.137661345Z [2024-06-27T23:55:06.137+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:55:06.138043253Z [2024-06-27T23:55:06.137+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:54:00+00:00, run_id=scheduled__2024-06-27T23:54:00+00:00, run_start_date=2024-06-27 23:55:00.316061+00:00, run_end_date=2024-06-27 23:55:06.137664+00:00, run_duration=5.821603, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:54:00+00:00, data_interval_end=2024-06-27 23:55:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:55:06.148471094Z [2024-06-27T23:55:06.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:55:00+00:00, run_after=2024-06-27T23:56:00+00:00 2024-06-27T23:55:06.155791138Z [2024-06-27T23:55:06.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:55:06.157138028Z [2024-06-27T23:55:06.155+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:54:00+00:00, run_id=scheduled__2024-06-27T23:54:00+00:00, run_start_date=2024-06-27 23:55:00.317417+00:00, run_end_date=2024-06-27 23:55:06.155685+00:00, run_duration=5.838268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:54:00+00:00, data_interval_end=2024-06-27 23:55:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:55:06.167958606Z [2024-06-27T23:55:06.167+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:55:00+00:00, run_after=2024-06-27T23:56:00+00:00 2024-06-27T23:55:06.252545879Z [2024-06-27T23:55:06.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:54:00+00:00 exited with status success for try_number 1 2024-06-27T23:55:06.252711549Z [2024-06-27T23:55:06.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:54:00+00:00 exited with status success for try_number 1 2024-06-27T23:55:06.268021231Z [2024-06-27T23:55:06.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:54:00+00:00, map_index=-1, run_start_date=2024-06-27 23:55:03.326290+00:00, run_end_date=2024-06-27 23:55:05.097226+00:00, run_duration=1.770936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=372, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:55:00.416966+00:00, queued_by_job_id=2, pid=5487 2024-06-27T23:55:06.268397136Z [2024-06-27T23:55:06.268+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:54:00+00:00, map_index=-1, run_start_date=2024-06-27 23:55:03.688904+00:00, run_end_date=2024-06-27 23:55:05.616322+00:00, run_duration=1.927418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=374, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:55:00.416966+00:00, queued_by_job_id=2, pid=5494 2024-06-27T23:55:09.926488663Z [2024-06-27T23:55:09.925+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:55:09.926504813Z 2024-06-27T23:55:09.926807839Z [2024-06-27T23:55:09.926+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:55:09.927477526Z [2024-06-27T23:55:09.927+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:55:09.927489161Z 2024-06-27T23:55:09.931284601Z [2024-06-27T23:55:09.931+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-27T23:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-27T23:55:09.931636830Z [2024-06-27T23:55:09.931+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-27T23:55:10.015957500Z [2024-06-27T23:55:10.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:50:00+00:00 exited with status queued for try_number 1 2024-06-27T23:55:10.016399244Z [2024-06-27T23:55:10.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:50:00+00:00 exited with status success for try_number 1 2024-06-27T23:55:10.034616129Z [2024-06-27T23:55:10.034+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d771d4e-afd5-4bf7-9946-be4afab6a9b3 2024-06-27T23:55:10.036740647Z [2024-06-27T23:55:10.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-27T23:50:00+00:00, map_index=-1, run_start_date=2024-06-27 23:55:08.581236+00:00, run_end_date=2024-06-27 23:55:09.491667+00:00, run_duration=0.910431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=375, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:55:04.824296+00:00, queued_by_job_id=2, pid=5517 2024-06-27T23:55:13.635045997Z [2024-06-27T23:55:13.634+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-27T23:55:13.635092203Z 2024-06-27T23:55:13.635523453Z [2024-06-27T23:55:13.635+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:55:13.636843144Z [2024-06-27T23:55:13.636+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:55:13.636947211Z 2024-06-27T23:55:13.645394380Z [2024-06-27T23:55:13.644+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-27T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:55:13.645426360Z [2024-06-27T23:55:13.644+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-27T23:55:13.759210140Z [2024-06-27T23:55:13.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:50:00+00:00 exited with status queued for try_number 1 2024-06-27T23:55:13.761013444Z [2024-06-27T23:55:13.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:50:00+00:00 exited with status success for try_number 1 2024-06-27T23:55:13.773944803Z [2024-06-27T23:55:13.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to efbca7ef-31d7-4e29-8224-4880136206d6 2024-06-27T23:55:13.778165147Z [2024-06-27T23:55:13.777+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-27T23:50:00+00:00, map_index=0, run_start_date=2024-06-27 23:55:12.868319+00:00, run_end_date=2024-06-27 23:55:13.359882+00:00, run_duration=0.491563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=376, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:55:09.928552+00:00, queued_by_job_id=2, pid=5525 2024-06-27T23:55:16.457832672Z [2024-06-27T23:55:16.457+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:55:16.458436755Z [2024-06-27T23:55:16.458+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:50:00+00:00, run_id=scheduled__2024-06-27T23:50:00+00:00, run_start_date=2024-06-27 23:55:00.312830+00:00, run_end_date=2024-06-27 23:55:16.457975+00:00, run_duration=16.145145, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:50:00+00:00, data_interval_end=2024-06-27 23:55:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-27T23:55:16.468506832Z [2024-06-27T23:55:16.468+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:55:00+00:00, run_after=2024-06-28T00:00:00+00:00 2024-06-27T23:55:17.603667681Z [2024-06-27T23:55:17.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:50:00+00:00 exited with status success for try_number 1 2024-06-27T23:55:17.612678700Z [2024-06-27T23:55:17.612+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-27T23:50:00+00:00, map_index=-1, run_start_date=2024-06-27 23:55:15.859869+00:00, run_end_date=2024-06-27 23:55:16.330131+00:00, run_duration=0.470262, state=success, executor_state=success, try_number=1, max_tries=1, job_id=377, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:55:13.637792+00:00, queued_by_job_id=2, pid=5533 2024-06-27T23:56:00.185279479Z [2024-06-27T23:56:00.184+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:56:00+00:00, run_after=2024-06-27T23:57:00+00:00 2024-06-27T23:56:00.202465831Z [2024-06-27T23:56:00.202+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:56:00+00:00, run_after=2024-06-27T23:57:00+00:00 2024-06-27T23:56:00.214535262Z [2024-06-27T23:56:00.213+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:56:00.230983797Z [2024-06-27T23:56:00.230+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:56:00.324087900Z [2024-06-27T23:56:00.323+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:56:00.324108460Z 2024-06-27T23:56:00.324112607Z 2024-06-27T23:56:00.324115939Z 2024-06-27T23:56:00.324118979Z 2024-06-27T23:56:00.324127968Z [2024-06-27T23:56:00.323+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:56:00.324189912Z [2024-06-27T23:56:00.324+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:56:00.324357189Z [2024-06-27T23:56:00.324+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:56:00.324514482Z [2024-06-27T23:56:00.324+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:56:00.325136875Z [2024-06-27T23:56:00.324+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:56:00.325144132Z 2024-06-27T23:56:00.325147933Z 2024-06-27T23:56:00.325151419Z 2024-06-27T23:56:00.325154790Z 2024-06-27T23:56:00.339659582Z [2024-06-27T23:56:00.339+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:56:00.339911580Z [2024-06-27T23:56:00.339+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:56:00.340171162Z [2024-06-27T23:56:00.340+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:56:00.340395389Z [2024-06-27T23:56:00.340+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:56:00.340761622Z [2024-06-27T23:56:00.340+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:56:00.341002081Z [2024-06-27T23:56:00.340+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:56:00.341327184Z [2024-06-27T23:56:00.341+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:56:00.341490930Z [2024-06-27T23:56:00.341+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:56:00.764297962Z [2024-06-27T23:56:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:54:00+00:00 exited with status queued for try_number 1 2024-06-27T23:56:00.767046046Z [2024-06-27T23:56:00.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:55:00+00:00 exited with status queued for try_number 1 2024-06-27T23:56:00.767273520Z [2024-06-27T23:56:00.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:55:00+00:00 exited with status queued for try_number 1 2024-06-27T23:56:00.767442530Z [2024-06-27T23:56:00.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:55:00+00:00 exited with status queued for try_number 1 2024-06-27T23:56:00.783501713Z [2024-06-27T23:56:00.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to 451e87c0-691a-4d5b-8488-c64f31611cb4 2024-06-27T23:56:00.783630132Z [2024-06-27T23:56:00.783+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d31f435-fc20-4320-aa66-ff8e648f6b3e 2024-06-27T23:56:00.783794952Z [2024-06-27T23:56:00.783+0000] {scheduler_job.py:635} INFO - Setting external_id for to d04304fc-b89b-4995-a6df-a31f8621dcb8 2024-06-27T23:56:00.784008263Z [2024-06-27T23:56:00.783+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d1f4315-276f-4dcd-bd8a-c8fd4006725f 2024-06-27T23:56:03.291848186Z [2024-06-27T23:56:03.290+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:56:03.297432550Z [2024-06-27T23:56:03.297+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:54:00+00:00, run_id=scheduled__2024-06-27T23:54:00+00:00, run_start_date=2024-06-27 23:56:00.247388+00:00, run_end_date=2024-06-27 23:56:03.292203+00:00, run_duration=3.044815, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:54:00+00:00, data_interval_end=2024-06-27 23:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:56:03.321825211Z [2024-06-27T23:56:03.321+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:56:00+00:00, run_after=2024-06-27T23:58:00+00:00 2024-06-27T23:56:03.335973606Z [2024-06-27T23:56:03.334+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:56:03.336313680Z [2024-06-27T23:56:03.336+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:55:00+00:00, run_id=scheduled__2024-06-27T23:55:00+00:00, run_start_date=2024-06-27 23:56:00.248928+00:00, run_end_date=2024-06-27 23:56:03.335937+00:00, run_duration=3.087009, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:55:00+00:00, data_interval_end=2024-06-27 23:56:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:56:03.349928677Z [2024-06-27T23:56:03.349+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:56:00+00:00, run_after=2024-06-27T23:57:00+00:00 2024-06-27T23:56:03.499340628Z [2024-06-27T23:56:03.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:54:00+00:00 exited with status success for try_number 1 2024-06-27T23:56:03.499617544Z [2024-06-27T23:56:03.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:55:00+00:00 exited with status success for try_number 1 2024-06-27T23:56:03.507884192Z [2024-06-27T23:56:03.507+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:54:00+00:00, map_index=-1, run_start_date=2024-06-27 23:56:01.624576+00:00, run_end_date=2024-06-27 23:56:02.269849+00:00, run_duration=0.645273, state=success, executor_state=success, try_number=1, max_tries=1, job_id=378, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:56:00.326564+00:00, queued_by_job_id=2, pid=5556 2024-06-27T23:56:03.508248070Z [2024-06-27T23:56:03.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:55:00+00:00, map_index=-1, run_start_date=2024-06-27 23:56:01.927268+00:00, run_end_date=2024-06-27 23:56:02.471090+00:00, run_duration=0.543822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=379, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:56:00.326564+00:00, queued_by_job_id=2, pid=5557 2024-06-27T23:56:04.623023461Z [2024-06-27T23:56:04.622+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:56:04.623479694Z [2024-06-27T23:56:04.623+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:55:00+00:00, run_id=scheduled__2024-06-27T23:55:00+00:00, run_start_date=2024-06-27 23:56:00.250019+00:00, run_end_date=2024-06-27 23:56:04.623121+00:00, run_duration=4.373102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:55:00+00:00, data_interval_end=2024-06-27 23:56:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:56:04.653960163Z [2024-06-27T23:56:04.653+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:56:00+00:00, run_after=2024-06-27T23:57:00+00:00 2024-06-27T23:56:04.747460164Z [2024-06-27T23:56:04.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:55:00+00:00 exited with status success for try_number 1 2024-06-27T23:56:04.755665971Z [2024-06-27T23:56:04.755+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:55:00+00:00, map_index=-1, run_start_date=2024-06-27 23:56:02.985844+00:00, run_end_date=2024-06-27 23:56:04.511938+00:00, run_duration=1.526094, state=success, executor_state=success, try_number=1, max_tries=1, job_id=380, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:56:00.326564+00:00, queued_by_job_id=2, pid=5575 2024-06-27T23:56:05.805314991Z [2024-06-27T23:56:05.804+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:56:05.805847216Z [2024-06-27T23:56:05.805+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:55:00+00:00, run_id=scheduled__2024-06-27T23:55:00+00:00, run_start_date=2024-06-27 23:56:00.251248+00:00, run_end_date=2024-06-27 23:56:05.805492+00:00, run_duration=5.554244, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:55:00+00:00, data_interval_end=2024-06-27 23:56:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:56:05.816007388Z [2024-06-27T23:56:05.815+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:56:00+00:00, run_after=2024-06-27T23:57:00+00:00 2024-06-27T23:56:05.859694340Z [2024-06-27T23:56:05.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:55:00+00:00 exited with status success for try_number 1 2024-06-27T23:56:05.870164023Z [2024-06-27T23:56:05.869+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:55:00+00:00, map_index=-1, run_start_date=2024-06-27 23:56:03.341409+00:00, run_end_date=2024-06-27 23:56:05.654078+00:00, run_duration=2.312669, state=success, executor_state=success, try_number=1, max_tries=1, job_id=381, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:56:00.326564+00:00, queued_by_job_id=2, pid=5586 2024-06-27T23:56:45.127437072Z [2024-06-27T23:56:45.125+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-27T23:57:00.634256186Z [2024-06-27T23:57:00.633+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:57:00.655368576Z [2024-06-27T23:57:00.654+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:57:00+00:00, run_after=2024-06-27T23:58:00+00:00 2024-06-27T23:57:00.674552002Z [2024-06-27T23:57:00.674+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:57:00+00:00, run_after=2024-06-27T23:58:00+00:00 2024-06-27T23:57:00.772291335Z [2024-06-27T23:57:00.771+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:57:00.772310106Z 2024-06-27T23:57:00.772313670Z 2024-06-27T23:57:00.772316977Z 2024-06-27T23:57:00.772320103Z [2024-06-27T23:57:00.772+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:57:00.773641241Z [2024-06-27T23:57:00.773+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:57:00.773836114Z [2024-06-27T23:57:00.773+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:57:00.774995297Z [2024-06-27T23:57:00.774+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:57:00.775006645Z 2024-06-27T23:57:00.775009986Z 2024-06-27T23:57:00.775013353Z 2024-06-27T23:57:00.792628208Z [2024-06-27T23:57:00.792+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:57:00.792920790Z [2024-06-27T23:57:00.792+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:57:00.793395949Z [2024-06-27T23:57:00.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:57:00.793636867Z [2024-06-27T23:57:00.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:57:00.794100073Z [2024-06-27T23:57:00.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:57:00.794327838Z [2024-06-27T23:57:00.794+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:57:01.165535317Z [2024-06-27T23:57:01.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:56:00+00:00 exited with status queued for try_number 1 2024-06-27T23:57:01.165595330Z [2024-06-27T23:57:01.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:56:00+00:00 exited with status queued for try_number 1 2024-06-27T23:57:01.165620884Z [2024-06-27T23:57:01.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:56:00+00:00 exited with status queued for try_number 1 2024-06-27T23:57:01.174430973Z [2024-06-27T23:57:01.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1be83c97-d3b0-4322-b6b4-b3c1bb4c63bb 2024-06-27T23:57:01.174491734Z [2024-06-27T23:57:01.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to be4eddc8-a963-4ba9-9e75-69f9218d1bbf 2024-06-27T23:57:01.174586178Z [2024-06-27T23:57:01.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f244f17-cb17-44f0-b49b-299ba93a0e7b 2024-06-27T23:57:03.143633416Z [2024-06-27T23:57:03.143+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:57:03.144175691Z [2024-06-27T23:57:03.143+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:56:00+00:00, run_id=scheduled__2024-06-27T23:56:00+00:00, run_start_date=2024-06-27 23:57:00.688917+00:00, run_end_date=2024-06-27 23:57:03.143779+00:00, run_duration=2.454862, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:56:00+00:00, data_interval_end=2024-06-27 23:57:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:57:03.155692853Z [2024-06-27T23:57:03.155+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:57:00+00:00, run_after=2024-06-27T23:58:00+00:00 2024-06-27T23:57:03.214417919Z [2024-06-27T23:57:03.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:56:00+00:00 exited with status success for try_number 1 2024-06-27T23:57:03.225022545Z [2024-06-27T23:57:03.224+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:56:00+00:00, map_index=-1, run_start_date=2024-06-27 23:57:01.921361+00:00, run_end_date=2024-06-27 23:57:02.451350+00:00, run_duration=0.529989, state=success, executor_state=success, try_number=1, max_tries=1, job_id=382, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:57:00.777014+00:00, queued_by_job_id=2, pid=5613 2024-06-27T23:57:05.455220745Z [2024-06-27T23:57:05.454+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:57:05.455612342Z [2024-06-27T23:57:05.455+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:56:00+00:00, run_id=scheduled__2024-06-27T23:56:00+00:00, run_start_date=2024-06-27 23:57:00.690918+00:00, run_end_date=2024-06-27 23:57:05.455124+00:00, run_duration=4.764206, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:56:00+00:00, data_interval_end=2024-06-27 23:57:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:57:05.467485455Z [2024-06-27T23:57:05.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:57:00+00:00, run_after=2024-06-27T23:58:00+00:00 2024-06-27T23:57:05.609911501Z [2024-06-27T23:57:05.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:56:00+00:00 exited with status success for try_number 1 2024-06-27T23:57:05.621143626Z [2024-06-27T23:57:05.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:56:00+00:00, map_index=-1, run_start_date=2024-06-27 23:57:03.211727+00:00, run_end_date=2024-06-27 23:57:04.816601+00:00, run_duration=1.604874, state=success, executor_state=success, try_number=1, max_tries=1, job_id=383, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:57:00.777014+00:00, queued_by_job_id=2, pid=5631 2024-06-27T23:57:06.707429005Z [2024-06-27T23:57:06.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:57:06.709068744Z [2024-06-27T23:57:06.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:56:00+00:00, run_id=scheduled__2024-06-27T23:56:00+00:00, run_start_date=2024-06-27 23:57:00.692273+00:00, run_end_date=2024-06-27 23:57:06.707677+00:00, run_duration=6.015404, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:56:00+00:00, data_interval_end=2024-06-27 23:57:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:57:06.727937401Z [2024-06-27T23:57:06.727+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:57:00+00:00, run_after=2024-06-27T23:58:00+00:00 2024-06-27T23:57:06.794509016Z [2024-06-27T23:57:06.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:56:00+00:00 exited with status success for try_number 1 2024-06-27T23:57:06.827795162Z [2024-06-27T23:57:06.826+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:56:00+00:00, map_index=-1, run_start_date=2024-06-27 23:57:03.366202+00:00, run_end_date=2024-06-27 23:57:05.759916+00:00, run_duration=2.393714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=384, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:57:00.777014+00:00, queued_by_job_id=2, pid=5632 2024-06-27T23:58:01.055060936Z [2024-06-27T23:58:01.054+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:58:01.064673258Z [2024-06-27T23:58:01.064+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:58:01.080557408Z [2024-06-27T23:58:01.080+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:58:00+00:00, run_after=2024-06-27T23:59:00+00:00 2024-06-27T23:58:01.101291021Z [2024-06-27T23:58:01.099+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:58:00+00:00, run_after=2024-06-27T23:59:00+00:00 2024-06-27T23:58:01.197946397Z [2024-06-27T23:58:01.197+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-27T23:58:01.197963091Z 2024-06-27T23:58:01.197968524Z 2024-06-27T23:58:01.197972819Z 2024-06-27T23:58:01.197977022Z 2024-06-27T23:58:01.198254186Z [2024-06-27T23:58:01.197+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-27T23:58:01.198566087Z [2024-06-27T23:58:01.198+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:58:01.199278588Z [2024-06-27T23:58:01.198+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:58:01.199500131Z [2024-06-27T23:58:01.199+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:58:01.200438085Z [2024-06-27T23:58:01.200+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:58:01.200450230Z 2024-06-27T23:58:01.200454485Z 2024-06-27T23:58:01.200458010Z 2024-06-27T23:58:01.200476112Z 2024-06-27T23:58:01.205723385Z [2024-06-27T23:58:01.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:58:01.205928520Z [2024-06-27T23:58:01.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-27T23:58:01.206247799Z [2024-06-27T23:58:01.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:58:01.206424148Z [2024-06-27T23:58:01.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:58:01.206723704Z [2024-06-27T23:58:01.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:58:01.206908746Z [2024-06-27T23:58:01.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:58:01.207203035Z [2024-06-27T23:58:01.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:58:01.207359835Z [2024-06-27T23:58:01.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:58:01.633714756Z [2024-06-27T23:58:01.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:56:00+00:00 exited with status queued for try_number 1 2024-06-27T23:58:01.635614860Z [2024-06-27T23:58:01.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:57:00+00:00 exited with status queued for try_number 1 2024-06-27T23:58:01.635814822Z [2024-06-27T23:58:01.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:57:00+00:00 exited with status queued for try_number 1 2024-06-27T23:58:01.635963761Z [2024-06-27T23:58:01.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:57:00+00:00 exited with status queued for try_number 1 2024-06-27T23:58:01.670872212Z [2024-06-27T23:58:01.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8aa492b3-2186-4ec8-8ee9-ca411ace14a9 2024-06-27T23:58:01.670958174Z [2024-06-27T23:58:01.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf69b1c6-79a1-43e5-bac4-84b16ae91a5e 2024-06-27T23:58:01.671551761Z [2024-06-27T23:58:01.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8465ff3-cb8b-48d4-bd95-9ea17d08848c 2024-06-27T23:58:01.671808387Z [2024-06-27T23:58:01.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to 425bfd9d-b313-423c-8988-109a417f1a82 2024-06-27T23:58:02.996665051Z [2024-06-27T23:58:02.996+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:58:02.997054647Z [2024-06-27T23:58:02.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:56:00+00:00, run_id=scheduled__2024-06-27T23:56:00+00:00, run_start_date=2024-06-27 23:58:01.115340+00:00, run_end_date=2024-06-27 23:58:02.996598+00:00, run_duration=1.881258, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:56:00+00:00, data_interval_end=2024-06-27 23:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-27T23:58:03.007845582Z [2024-06-27T23:58:03.007+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-27T23:58:00+00:00, run_after=2024-06-28T00:00:00+00:00 2024-06-27T23:58:03.031436015Z [2024-06-27T23:58:03.031+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:58:03.031695732Z [2024-06-27T23:58:03.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:57:00+00:00, run_id=scheduled__2024-06-27T23:57:00+00:00, run_start_date=2024-06-27 23:58:01.117085+00:00, run_end_date=2024-06-27 23:58:03.031364+00:00, run_duration=1.914279, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:57:00+00:00, data_interval_end=2024-06-27 23:58:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:58:03.048125117Z [2024-06-27T23:58:03.047+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:58:00+00:00, run_after=2024-06-27T23:59:00+00:00 2024-06-27T23:58:03.195448572Z [2024-06-27T23:58:03.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:56:00+00:00 exited with status success for try_number 1 2024-06-27T23:58:03.195489581Z [2024-06-27T23:58:03.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:57:00+00:00 exited with status success for try_number 1 2024-06-27T23:58:03.206341001Z [2024-06-27T23:58:03.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:56:00+00:00, map_index=-1, run_start_date=2024-06-27 23:58:02.253126+00:00, run_end_date=2024-06-27 23:58:02.676729+00:00, run_duration=0.423603, state=success, executor_state=success, try_number=1, max_tries=1, job_id=385, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:58:01.201517+00:00, queued_by_job_id=2, pid=5664 2024-06-27T23:58:03.206657346Z [2024-06-27T23:58:03.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:57:00+00:00, map_index=-1, run_start_date=2024-06-27 23:58:02.481043+00:00, run_end_date=2024-06-27 23:58:02.940005+00:00, run_duration=0.458962, state=success, executor_state=success, try_number=1, max_tries=1, job_id=386, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:58:01.201517+00:00, queued_by_job_id=2, pid=5665 2024-06-27T23:58:06.605495800Z [2024-06-27T23:58:06.605+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:58:06.605767244Z [2024-06-27T23:58:06.605+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:57:00+00:00, run_id=scheduled__2024-06-27T23:57:00+00:00, run_start_date=2024-06-27 23:58:01.119967+00:00, run_end_date=2024-06-27 23:58:06.605483+00:00, run_duration=5.485516, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:57:00+00:00, data_interval_end=2024-06-27 23:58:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:58:06.613414352Z [2024-06-27T23:58:06.613+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:58:00+00:00, run_after=2024-06-27T23:59:00+00:00 2024-06-27T23:58:06.618757624Z [2024-06-27T23:58:06.618+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:58:06.619026810Z [2024-06-27T23:58:06.618+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:57:00+00:00, run_id=scheduled__2024-06-27T23:57:00+00:00, run_start_date=2024-06-27 23:58:01.118464+00:00, run_end_date=2024-06-27 23:58:06.618755+00:00, run_duration=5.500291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:57:00+00:00, data_interval_end=2024-06-27 23:58:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:58:06.628661983Z [2024-06-27T23:58:06.627+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:58:00+00:00, run_after=2024-06-27T23:59:00+00:00 2024-06-27T23:58:06.727070111Z [2024-06-27T23:58:06.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:57:00+00:00 exited with status success for try_number 1 2024-06-27T23:58:06.727112266Z [2024-06-27T23:58:06.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:57:00+00:00 exited with status success for try_number 1 2024-06-27T23:58:06.739796260Z [2024-06-27T23:58:06.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:57:00+00:00, map_index=-1, run_start_date=2024-06-27 23:58:03.972437+00:00, run_end_date=2024-06-27 23:58:05.695897+00:00, run_duration=1.72346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=388, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:58:01.201517+00:00, queued_by_job_id=2, pid=5689 2024-06-27T23:58:06.740100038Z [2024-06-27T23:58:06.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:57:00+00:00, map_index=-1, run_start_date=2024-06-27 23:58:03.925450+00:00, run_end_date=2024-06-27 23:58:05.865491+00:00, run_duration=1.940041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:58:01.201517+00:00, queued_by_job_id=2, pid=5688 2024-06-27T23:59:00.265598044Z [2024-06-27T23:59:00.265+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:59:00+00:00, run_after=2024-06-28T00:00:00+00:00 2024-06-27T23:59:00.273242219Z [2024-06-27T23:59:00.272+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-27T23:59:00.287657257Z [2024-06-27T23:59:00.287+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:59:00+00:00, run_after=2024-06-28T00:00:00+00:00 2024-06-27T23:59:00.357579259Z [2024-06-27T23:59:00.357+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-27T23:59:00.357604665Z 2024-06-27T23:59:00.357608768Z 2024-06-27T23:59:00.357612266Z 2024-06-27T23:59:00.357823969Z [2024-06-27T23:59:00.357+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:59:00.358182291Z [2024-06-27T23:59:00.357+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-27T23:59:00.358440358Z [2024-06-27T23:59:00.358+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-27T23:59:00.359740159Z [2024-06-27T23:59:00.359+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-27T23:59:00.359754268Z 2024-06-27T23:59:00.359757818Z 2024-06-27T23:59:00.359761367Z 2024-06-27T23:59:00.365991564Z [2024-06-27T23:59:00.365+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:59:00.366326812Z [2024-06-27T23:59:00.366+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-27T23:59:00.369263573Z [2024-06-27T23:59:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:59:00.369497514Z [2024-06-27T23:59:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-27T23:59:00.369906094Z [2024-06-27T23:59:00.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-27T23:59:00.370128411Z [2024-06-27T23:59:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-27T23:59:00.718910358Z [2024-06-27T23:59:00.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:58:00+00:00 exited with status queued for try_number 1 2024-06-27T23:59:00.719047549Z [2024-06-27T23:59:00.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:58:00+00:00 exited with status queued for try_number 1 2024-06-27T23:59:00.719142913Z [2024-06-27T23:59:00.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:58:00+00:00 exited with status queued for try_number 1 2024-06-27T23:59:00.731678394Z [2024-06-27T23:59:00.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 817a023a-6f42-40a3-886f-146e30eb257b 2024-06-27T23:59:00.732146661Z [2024-06-27T23:59:00.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27a02919-3797-42d8-b132-f1330d6975d2 2024-06-27T23:59:00.732425923Z [2024-06-27T23:59:00.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99c38194-6275-42be-af59-7d201e9514ab 2024-06-27T23:59:01.960597093Z [2024-06-27T23:59:01.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:59:01.961130319Z [2024-06-27T23:59:01.960+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:58:00+00:00, run_id=scheduled__2024-06-27T23:58:00+00:00, run_start_date=2024-06-27 23:59:00.300113+00:00, run_end_date=2024-06-27 23:59:01.960704+00:00, run_duration=1.660591, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:58:00+00:00, data_interval_end=2024-06-27 23:59:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-27T23:59:01.972174147Z [2024-06-27T23:59:01.971+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-27T23:59:00+00:00, run_after=2024-06-28T00:00:00+00:00 2024-06-27T23:59:02.035751071Z [2024-06-27T23:59:02.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:58:00+00:00 exited with status success for try_number 1 2024-06-27T23:59:02.041466852Z [2024-06-27T23:59:02.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:58:00+00:00, map_index=-1, run_start_date=2024-06-27 23:59:01.300493+00:00, run_end_date=2024-06-27 23:59:01.816672+00:00, run_duration=0.516179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=389, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:59:00.361277+00:00, queued_by_job_id=2, pid=5721 2024-06-27T23:59:04.173272177Z [2024-06-27T23:59:04.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:59:04.173948083Z [2024-06-27T23:59:04.173+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:58:00+00:00, run_id=scheduled__2024-06-27T23:58:00+00:00, run_start_date=2024-06-27 23:59:00.301454+00:00, run_end_date=2024-06-27 23:59:04.173177+00:00, run_duration=3.871723, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:58:00+00:00, data_interval_end=2024-06-27 23:59:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-27T23:59:04.185790427Z [2024-06-27T23:59:04.185+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:59:00+00:00, run_after=2024-06-28T00:00:00+00:00 2024-06-27T23:59:04.240756840Z [2024-06-27T23:59:04.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:58:00+00:00 exited with status success for try_number 1 2024-06-27T23:59:04.248402208Z [2024-06-27T23:59:04.248+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:58:00+00:00, map_index=-1, run_start_date=2024-06-27 23:59:02.495667+00:00, run_end_date=2024-06-27 23:59:03.851485+00:00, run_duration=1.355818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=390, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:59:00.361277+00:00, queued_by_job_id=2, pid=5739 2024-06-27T23:59:05.289890081Z [2024-06-27T23:59:05.289+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-27T23:59:05.290292758Z [2024-06-27T23:59:05.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:58:00+00:00, run_id=scheduled__2024-06-27T23:58:00+00:00, run_start_date=2024-06-27 23:59:00.302473+00:00, run_end_date=2024-06-27 23:59:05.289817+00:00, run_duration=4.987344, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:58:00+00:00, data_interval_end=2024-06-27 23:59:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-27T23:59:05.299018768Z [2024-06-27T23:59:05.298+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-27T23:59:00+00:00, run_after=2024-06-28T00:00:00+00:00 2024-06-27T23:59:05.352539600Z [2024-06-27T23:59:05.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:58:00+00:00 exited with status success for try_number 1 2024-06-27T23:59:05.359351637Z [2024-06-27T23:59:05.359+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:58:00+00:00, map_index=-1, run_start_date=2024-06-27 23:59:02.525950+00:00, run_end_date=2024-06-27 23:59:04.152025+00:00, run_duration=1.626075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=391, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-27 23:59:00.361277+00:00, queued_by_job_id=2, pid=5740 2024-06-28T00:00:00.886249963Z [2024-06-28T00:00:00.885+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:00:00+00:00, run_after=2024-06-28T00:01:00+00:00 2024-06-28T00:00:00.899943940Z [2024-06-28T00:00:00.899+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:00:00.913629855Z [2024-06-28T00:00:00.913+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:00:00.935420732Z [2024-06-28T00:00:00.934+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:00:00+00:00, run_after=2024-06-28T00:05:00+00:00 2024-06-28T00:00:00.953965388Z [2024-06-28T00:00:00.953+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:00:00+00:00, run_after=2024-06-28T00:01:00+00:00 2024-06-28T00:00:01.094945450Z [2024-06-28T00:00:01.094+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-28T00:00:01.094986412Z 2024-06-28T00:00:01.094999298Z 2024-06-28T00:00:01.095011820Z 2024-06-28T00:00:01.095023907Z 2024-06-28T00:00:01.095036632Z 2024-06-28T00:00:01.095541788Z [2024-06-28T00:00:01.094+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:00:01.096129710Z [2024-06-28T00:00:01.095+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:00:01.096738939Z [2024-06-28T00:00:01.096+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:00:01.097220121Z [2024-06-28T00:00:01.096+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:00:01.097618306Z [2024-06-28T00:00:01.097+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:00:01.099410544Z [2024-06-28T00:00:01.098+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:00:01.099432045Z 2024-06-28T00:00:01.099438409Z 2024-06-28T00:00:01.099443995Z 2024-06-28T00:00:01.099467829Z 2024-06-28T00:00:01.099473979Z 2024-06-28T00:00:01.108496719Z [2024-06-28T00:00:01.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-27T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T00:00:01.108941965Z [2024-06-28T00:00:01.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-27T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:00:01.109507467Z [2024-06-28T00:00:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-27T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:00:01.109891854Z [2024-06-28T00:00:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-27T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:00:01.110409469Z [2024-06-28T00:00:01.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:00:01.110798975Z [2024-06-28T00:00:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:00:01.111346395Z [2024-06-28T00:00:01.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:00:01.111690949Z [2024-06-28T00:00:01.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:00:01.112149820Z [2024-06-28T00:00:01.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-27T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:00:01.112443639Z [2024-06-28T00:00:01.112+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-27T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:00:01.739605789Z [2024-06-28T00:00:01.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:55:00+00:00 exited with status queued for try_number 1 2024-06-28T00:00:01.739885224Z [2024-06-28T00:00:01.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:58:00+00:00 exited with status queued for try_number 1 2024-06-28T00:00:01.740086973Z [2024-06-28T00:00:01.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:59:00+00:00 exited with status queued for try_number 1 2024-06-28T00:00:01.740260849Z [2024-06-28T00:00:01.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:59:00+00:00 exited with status queued for try_number 1 2024-06-28T00:00:01.740405090Z [2024-06-28T00:00:01.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:59:00+00:00 exited with status queued for try_number 1 2024-06-28T00:00:01.766320236Z [2024-06-28T00:00:01.761+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3c9fbe8-5df8-46d4-a286-6b17e775dd17 2024-06-28T00:00:01.766701495Z [2024-06-28T00:00:01.766+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fbbb278-7e1e-48ca-946d-96aa38d19ee9 2024-06-28T00:00:01.766923399Z [2024-06-28T00:00:01.766+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe617c2f-d9ba-46fb-86ff-3b9c98982222 2024-06-28T00:00:01.767114329Z [2024-06-28T00:00:01.766+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4bf2404d-326f-43c4-bd04-a401f2130532 2024-06-28T00:00:01.767365185Z [2024-06-28T00:00:01.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9522643-6207-4f34-88b9-ef565f2e973a 2024-06-28T00:00:02.997038232Z [2024-06-28T00:00:02.996+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:00:02.999086083Z [2024-06-28T00:00:02.998+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-27 23:58:00+00:00, run_id=scheduled__2024-06-27T23:58:00+00:00, run_start_date=2024-06-28 00:00:00.966716+00:00, run_end_date=2024-06-28 00:00:02.998607+00:00, run_duration=2.031891, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:58:00+00:00, data_interval_end=2024-06-28 00:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:00:03.013277144Z [2024-06-28T00:00:03.012+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:00:00+00:00, run_after=2024-06-28T00:02:00+00:00 2024-06-28T00:00:03.128220724Z [2024-06-28T00:00:03.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-27T23:58:00+00:00 exited with status success for try_number 1 2024-06-28T00:00:03.138159605Z [2024-06-28T00:00:03.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-27T23:58:00+00:00, map_index=-1, run_start_date=2024-06-28 00:00:02.244982+00:00, run_end_date=2024-06-28 00:00:02.748075+00:00, run_duration=0.503093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=392, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:00:01.103087+00:00, queued_by_job_id=2, pid=5774 2024-06-28T00:00:04.277071456Z [2024-06-28T00:00:04.275+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:00:04.291230383Z [2024-06-28T00:00:04.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-27 23:59:00+00:00, run_id=scheduled__2024-06-27T23:59:00+00:00, run_start_date=2024-06-28 00:00:00.967880+00:00, run_end_date=2024-06-28 00:00:04.276268+00:00, run_duration=3.308388, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:59:00+00:00, data_interval_end=2024-06-28 00:00:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:00:04.318834663Z [2024-06-28T00:00:04.318+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:00:00+00:00, run_after=2024-06-28T00:01:00+00:00 2024-06-28T00:00:04.699015586Z [2024-06-28T00:00:04.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:59:00+00:00 exited with status success for try_number 1 2024-06-28T00:00:04.723800234Z [2024-06-28T00:00:04.723+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:59:00+00:00, map_index=-1, run_start_date=2024-06-28 00:00:02.565105+00:00, run_end_date=2024-06-28 00:00:03.250019+00:00, run_duration=0.684914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=393, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:00:01.103087+00:00, queued_by_job_id=2, pid=5775 2024-06-28T00:00:05.823697852Z [2024-06-28T00:00:05.823+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:00:05.823726237Z 2024-06-28T00:00:05.824159851Z [2024-06-28T00:00:05.823+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:00:05.824821603Z [2024-06-28T00:00:05.824+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:00:05.824832975Z 2024-06-28T00:00:05.827896920Z [2024-06-28T00:00:05.827+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-27T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T00:00:05.828152131Z [2024-06-28T00:00:05.827+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-27T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:00:05.961041650Z [2024-06-28T00:00:05.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:55:00+00:00 exited with status queued for try_number 1 2024-06-28T00:00:05.961656640Z [2024-06-28T00:00:05.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-27T23:55:00+00:00 exited with status success for try_number 1 2024-06-28T00:00:05.979237101Z [2024-06-28T00:00:05.978+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18305ca1-9803-4aaa-b0a9-dba3cc01ef55 2024-06-28T00:00:05.979381633Z [2024-06-28T00:00:05.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-27T23:55:00+00:00, map_index=-1, run_start_date=2024-06-28 00:00:04.311848+00:00, run_end_date=2024-06-28 00:00:05.183372+00:00, run_duration=0.871524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=395, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:00:01.103087+00:00, queued_by_job_id=2, pid=5800 2024-06-28T00:00:06.876412244Z [2024-06-28T00:00:06.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:00:06.876765983Z [2024-06-28T00:00:06.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:59:00+00:00, run_id=scheduled__2024-06-27T23:59:00+00:00, run_start_date=2024-06-28 00:00:00.969927+00:00, run_end_date=2024-06-28 00:00:06.876290+00:00, run_duration=5.906363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:59:00+00:00, data_interval_end=2024-06-28 00:00:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:00:06.893202589Z [2024-06-28T00:00:06.892+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:00:00+00:00, run_after=2024-06-28T00:01:00+00:00 2024-06-28T00:00:06.915723115Z [2024-06-28T00:00:06.915+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:00:06.916004381Z [2024-06-28T00:00:06.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:59:00+00:00, run_id=scheduled__2024-06-27T23:59:00+00:00, run_start_date=2024-06-28 00:00:00.968943+00:00, run_end_date=2024-06-28 00:00:06.915632+00:00, run_duration=5.946689, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:59:00+00:00, data_interval_end=2024-06-28 00:00:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:00:06.957651486Z [2024-06-28T00:00:06.957+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:00:00+00:00, run_after=2024-06-28T00:01:00+00:00 2024-06-28T00:00:07.144004817Z [2024-06-28T00:00:07.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:59:00+00:00 exited with status success for try_number 1 2024-06-28T00:00:07.144342288Z [2024-06-28T00:00:07.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-27T23:59:00+00:00 exited with status success for try_number 1 2024-06-28T00:00:07.154238651Z [2024-06-28T00:00:07.153+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:59:00+00:00, map_index=-1, run_start_date=2024-06-28 00:00:04.048522+00:00, run_end_date=2024-06-28 00:00:06.580406+00:00, run_duration=2.531884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=394, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:00:01.103087+00:00, queued_by_job_id=2, pid=5799 2024-06-28T00:00:07.154518132Z [2024-06-28T00:00:07.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-27T23:59:00+00:00, map_index=-1, run_start_date=2024-06-28 00:00:05.043588+00:00, run_end_date=2024-06-28 00:00:06.552580+00:00, run_duration=1.508992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=396, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:00:01.103087+00:00, queued_by_job_id=2, pid=5816 2024-06-28T00:00:09.452822812Z [2024-06-28T00:00:09.452+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:00:09.452854993Z 2024-06-28T00:00:09.453029547Z [2024-06-28T00:00:09.452+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:00:09.453726193Z [2024-06-28T00:00:09.453+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:00:09.453743655Z 2024-06-28T00:00:09.456368072Z [2024-06-28T00:00:09.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-27T23:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T00:00:09.456588234Z [2024-06-28T00:00:09.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-27T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T00:00:09.532103391Z [2024-06-28T00:00:09.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:55:00+00:00 exited with status queued for try_number 1 2024-06-28T00:00:09.534108349Z [2024-06-28T00:00:09.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-27T23:55:00+00:00 exited with status success for try_number 1 2024-06-28T00:00:09.541741241Z [2024-06-28T00:00:09.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73a9d08f-319e-4f02-b909-5af553370104 2024-06-28T00:00:09.542602898Z [2024-06-28T00:00:09.542+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-27T23:55:00+00:00, map_index=-1, run_start_date=2024-06-28 00:00:08.639143+00:00, run_end_date=2024-06-28 00:00:09.134054+00:00, run_duration=0.494911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=397, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:00:05.825490+00:00, queued_by_job_id=2, pid=5829 2024-06-28T00:00:11.824466621Z [2024-06-28T00:00:11.824+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:00:11.824506731Z 2024-06-28T00:00:11.824532346Z [2024-06-28T00:00:11.824+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:00:11.825230999Z [2024-06-28T00:00:11.825+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:00:11.825246734Z 2024-06-28T00:00:11.827977744Z [2024-06-28T00:00:11.827+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-27T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:00:11.828476150Z [2024-06-28T00:00:11.827+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-27T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:00:11.908279731Z [2024-06-28T00:00:11.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:55:00+00:00 exited with status queued for try_number 1 2024-06-28T00:00:11.908592421Z [2024-06-28T00:00:11.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-27T23:55:00+00:00 exited with status success for try_number 1 2024-06-28T00:00:11.915681987Z [2024-06-28T00:00:11.915+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a0d1017-d018-4ca9-b1f8-48a22e528d7c 2024-06-28T00:00:11.916042669Z [2024-06-28T00:00:11.915+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-27T23:55:00+00:00, map_index=0, run_start_date=2024-06-28 00:00:11.281214+00:00, run_end_date=2024-06-28 00:00:11.629329+00:00, run_duration=0.348115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=398, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:00:09.454275+00:00, queued_by_job_id=2, pid=5837 2024-06-28T00:00:14.962076705Z [2024-06-28T00:00:14.961+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:00:14.962992670Z [2024-06-28T00:00:14.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-27 23:55:00+00:00, run_id=scheduled__2024-06-27T23:55:00+00:00, run_start_date=2024-06-28 00:00:00.965310+00:00, run_end_date=2024-06-28 00:00:14.962125+00:00, run_duration=13.996815, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-27 23:55:00+00:00, data_interval_end=2024-06-28 00:00:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T00:00:14.970085324Z [2024-06-28T00:00:14.969+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:00:00+00:00, run_after=2024-06-28T00:05:00+00:00 2024-06-28T00:00:15.029866877Z [2024-06-28T00:00:15.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-27T23:55:00+00:00 exited with status success for try_number 1 2024-06-28T00:00:15.036521460Z [2024-06-28T00:00:15.036+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-27T23:55:00+00:00, map_index=-1, run_start_date=2024-06-28 00:00:13.899957+00:00, run_end_date=2024-06-28 00:00:14.318546+00:00, run_duration=0.418589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=399, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:00:11.825677+00:00, queued_by_job_id=2, pid=5845 2024-06-28T00:01:00.352698312Z [2024-06-28T00:01:00.352+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:01:00+00:00, run_after=2024-06-28T00:02:00+00:00 2024-06-28T00:01:00.369187086Z [2024-06-28T00:01:00.368+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:01:00+00:00, run_after=2024-06-28T00:02:00+00:00 2024-06-28T00:01:00.377033154Z [2024-06-28T00:01:00.376+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:01:00.467037934Z [2024-06-28T00:01:00.465+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:01:00.467061407Z 2024-06-28T00:01:00.467065533Z 2024-06-28T00:01:00.467069251Z 2024-06-28T00:01:00.467111769Z [2024-06-28T00:01:00.466+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:01:00.467241012Z [2024-06-28T00:01:00.467+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:01:00.467338146Z [2024-06-28T00:01:00.467+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:01:00.467823460Z [2024-06-28T00:01:00.467+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:01:00.467829082Z 2024-06-28T00:01:00.467832220Z 2024-06-28T00:01:00.467835580Z 2024-06-28T00:01:00.472497471Z [2024-06-28T00:01:00.471+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:01:00.472534533Z [2024-06-28T00:01:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:01:00.472947604Z [2024-06-28T00:01:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:01:00.472958916Z [2024-06-28T00:01:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:01:00.472962340Z [2024-06-28T00:01:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:01:00.473038303Z [2024-06-28T00:01:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:01:01.071932148Z [2024-06-28T00:01:01.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:00:00+00:00 exited with status queued for try_number 1 2024-06-28T00:01:01.071969698Z [2024-06-28T00:01:01.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:00:00+00:00 exited with status queued for try_number 1 2024-06-28T00:01:01.071981293Z [2024-06-28T00:01:01.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:00:00+00:00 exited with status queued for try_number 1 2024-06-28T00:01:01.083385320Z [2024-06-28T00:01:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09eb4d1e-808b-460a-8192-3a0b18374801 2024-06-28T00:01:01.083430447Z [2024-06-28T00:01:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b82a489-c8d6-4263-aefe-29e9543187ad 2024-06-28T00:01:01.083529246Z [2024-06-28T00:01:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ea70235-0700-4a57-89d7-f0f38e96796b 2024-06-28T00:01:03.341454764Z [2024-06-28T00:01:03.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:01:03.342763126Z [2024-06-28T00:01:03.342+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:00:00+00:00, run_id=scheduled__2024-06-28T00:00:00+00:00, run_start_date=2024-06-28 00:01:00.387560+00:00, run_end_date=2024-06-28 00:01:03.342235+00:00, run_duration=2.954675, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:00:00+00:00, data_interval_end=2024-06-28 00:01:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:01:03.358571473Z [2024-06-28T00:01:03.358+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:01:00+00:00, run_after=2024-06-28T00:02:00+00:00 2024-06-28T00:01:03.467477000Z [2024-06-28T00:01:03.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:00:00+00:00 exited with status success for try_number 1 2024-06-28T00:01:03.481471293Z [2024-06-28T00:01:03.481+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:00:00+00:00, map_index=-1, run_start_date=2024-06-28 00:01:02.198887+00:00, run_end_date=2024-06-28 00:01:02.852817+00:00, run_duration=0.65393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=400, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:01:00.468882+00:00, queued_by_job_id=2, pid=5867 2024-06-28T00:01:05.971749122Z [2024-06-28T00:01:05.965+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:01:05.972198461Z [2024-06-28T00:01:05.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:00:00+00:00, run_id=scheduled__2024-06-28T00:00:00+00:00, run_start_date=2024-06-28 00:01:00.388918+00:00, run_end_date=2024-06-28 00:01:05.971600+00:00, run_duration=5.582682, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:00:00+00:00, data_interval_end=2024-06-28 00:01:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:01:05.996024694Z [2024-06-28T00:01:05.995+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:01:00+00:00, run_after=2024-06-28T00:02:00+00:00 2024-06-28T00:01:06.015134134Z [2024-06-28T00:01:06.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:01:06.015547587Z [2024-06-28T00:01:06.015+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:00:00+00:00, run_id=scheduled__2024-06-28T00:00:00+00:00, run_start_date=2024-06-28 00:01:00.390647+00:00, run_end_date=2024-06-28 00:01:06.015213+00:00, run_duration=5.624566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:00:00+00:00, data_interval_end=2024-06-28 00:01:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:01:06.038752161Z [2024-06-28T00:01:06.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:01:00+00:00, run_after=2024-06-28T00:02:00+00:00 2024-06-28T00:01:06.138442737Z [2024-06-28T00:01:06.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:00:00+00:00 exited with status success for try_number 1 2024-06-28T00:01:06.138648684Z [2024-06-28T00:01:06.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:00:00+00:00 exited with status success for try_number 1 2024-06-28T00:01:06.147169409Z [2024-06-28T00:01:06.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:00:00+00:00, map_index=-1, run_start_date=2024-06-28 00:01:03.324551+00:00, run_end_date=2024-06-28 00:01:05.404490+00:00, run_duration=2.079939, state=success, executor_state=success, try_number=1, max_tries=1, job_id=401, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:01:00.468882+00:00, queued_by_job_id=2, pid=5880 2024-06-28T00:01:06.147449406Z [2024-06-28T00:01:06.147+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:00:00+00:00, map_index=-1, run_start_date=2024-06-28 00:01:03.886213+00:00, run_end_date=2024-06-28 00:01:05.658926+00:00, run_duration=1.772713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=402, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:01:00.468882+00:00, queued_by_job_id=2, pid=5891 2024-06-28T00:01:45.219246525Z [2024-06-28T00:01:45.218+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T00:02:00.635722761Z [2024-06-28T00:02:00.635+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:02:00.650285473Z [2024-06-28T00:02:00.649+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:02:00+00:00, run_after=2024-06-28T00:03:00+00:00 2024-06-28T00:02:00.659333828Z [2024-06-28T00:02:00.659+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:02:00.677782046Z [2024-06-28T00:02:00.677+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:02:00+00:00, run_after=2024-06-28T00:03:00+00:00 2024-06-28T00:02:00.791828758Z [2024-06-28T00:02:00.791+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:02:00.791852783Z 2024-06-28T00:02:00.791857101Z 2024-06-28T00:02:00.791860701Z 2024-06-28T00:02:00.791863990Z 2024-06-28T00:02:00.792061573Z [2024-06-28T00:02:00.791+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:02:00.792545327Z [2024-06-28T00:02:00.792+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:02:00.792820047Z [2024-06-28T00:02:00.792+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:02:00.793036847Z [2024-06-28T00:02:00.792+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:02:00.793691357Z [2024-06-28T00:02:00.793+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:02:00.793702403Z 2024-06-28T00:02:00.793706131Z 2024-06-28T00:02:00.793709366Z 2024-06-28T00:02:00.793732566Z 2024-06-28T00:02:00.797671744Z [2024-06-28T00:02:00.797+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:02:00.797967446Z [2024-06-28T00:02:00.797+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:02:00.798275640Z [2024-06-28T00:02:00.798+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:02:00.798457696Z [2024-06-28T00:02:00.798+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:02:00.798767035Z [2024-06-28T00:02:00.798+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:02:00.798979276Z [2024-06-28T00:02:00.798+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:02:00.799309036Z [2024-06-28T00:02:00.799+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:02:00.799903531Z [2024-06-28T00:02:00.799+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:02:01.217868039Z [2024-06-28T00:02:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:00:00+00:00 exited with status queued for try_number 1 2024-06-28T00:02:01.217898923Z [2024-06-28T00:02:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:01:00+00:00 exited with status queued for try_number 1 2024-06-28T00:02:01.217972812Z [2024-06-28T00:02:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:01:00+00:00 exited with status queued for try_number 1 2024-06-28T00:02:01.218140474Z [2024-06-28T00:02:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:01:00+00:00 exited with status queued for try_number 1 2024-06-28T00:02:01.236101293Z [2024-06-28T00:02:01.235+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbfdf2c2-76d6-449f-97a0-582dd9cf1f2a 2024-06-28T00:02:01.236338743Z [2024-06-28T00:02:01.236+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ebc42f9-5300-4cdb-ba0d-180c4a2d06c5 2024-06-28T00:02:01.236652229Z [2024-06-28T00:02:01.236+0000] {scheduler_job.py:635} INFO - Setting external_id for to f23fa9b8-9398-44ea-99f6-3d027f943147 2024-06-28T00:02:01.237027411Z [2024-06-28T00:02:01.236+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8528fe2-4b91-4622-ad08-54ca17e510a8 2024-06-28T00:02:02.535785507Z [2024-06-28T00:02:02.535+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:02:02.536174248Z [2024-06-28T00:02:02.535+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:00:00+00:00, run_id=scheduled__2024-06-28T00:00:00+00:00, run_start_date=2024-06-28 00:02:00.692455+00:00, run_end_date=2024-06-28 00:02:02.535742+00:00, run_duration=1.843287, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:00:00+00:00, data_interval_end=2024-06-28 00:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:02:02.544225742Z [2024-06-28T00:02:02.543+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:02:00+00:00, run_after=2024-06-28T00:04:00+00:00 2024-06-28T00:02:02.564659817Z [2024-06-28T00:02:02.564+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:02:02.564925340Z [2024-06-28T00:02:02.564+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:01:00+00:00, run_id=scheduled__2024-06-28T00:01:00+00:00, run_start_date=2024-06-28 00:02:00.694363+00:00, run_end_date=2024-06-28 00:02:02.564577+00:00, run_duration=1.870214, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:01:00+00:00, data_interval_end=2024-06-28 00:02:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:02:02.577729285Z [2024-06-28T00:02:02.577+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:02:00+00:00, run_after=2024-06-28T00:03:00+00:00 2024-06-28T00:02:02.615316427Z [2024-06-28T00:02:02.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:00:00+00:00 exited with status success for try_number 1 2024-06-28T00:02:02.622027960Z [2024-06-28T00:02:02.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:00:00+00:00, map_index=-1, run_start_date=2024-06-28 00:02:01.918959+00:00, run_end_date=2024-06-28 00:02:02.361529+00:00, run_duration=0.44257, state=success, executor_state=success, try_number=1, max_tries=1, job_id=403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:02:00.794584+00:00, queued_by_job_id=2, pid=5919 2024-06-28T00:02:03.191046333Z [2024-06-28T00:02:03.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:01:00+00:00 exited with status success for try_number 1 2024-06-28T00:02:03.207894168Z [2024-06-28T00:02:03.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:01:00+00:00, map_index=-1, run_start_date=2024-06-28 00:02:02.022370+00:00, run_end_date=2024-06-28 00:02:02.502313+00:00, run_duration=0.479943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=404, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:02:00.794584+00:00, queued_by_job_id=2, pid=5920 2024-06-28T00:02:05.764662236Z [2024-06-28T00:02:05.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:02:05.764684372Z [2024-06-28T00:02:05.760+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:01:00+00:00, run_id=scheduled__2024-06-28T00:01:00+00:00, run_start_date=2024-06-28 00:02:00.695665+00:00, run_end_date=2024-06-28 00:02:05.760521+00:00, run_duration=5.064856, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:01:00+00:00, data_interval_end=2024-06-28 00:02:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:02:05.792594916Z [2024-06-28T00:02:05.792+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:02:00+00:00, run_after=2024-06-28T00:03:00+00:00 2024-06-28T00:02:05.803214271Z [2024-06-28T00:02:05.802+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:02:05.803551664Z [2024-06-28T00:02:05.803+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:01:00+00:00, run_id=scheduled__2024-06-28T00:01:00+00:00, run_start_date=2024-06-28 00:02:00.696839+00:00, run_end_date=2024-06-28 00:02:05.803200+00:00, run_duration=5.106361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:01:00+00:00, data_interval_end=2024-06-28 00:02:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:02:05.814866752Z [2024-06-28T00:02:05.814+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:02:00+00:00, run_after=2024-06-28T00:03:00+00:00 2024-06-28T00:02:05.853970276Z [2024-06-28T00:02:05.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:01:00+00:00 exited with status success for try_number 1 2024-06-28T00:02:05.855574919Z [2024-06-28T00:02:05.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:01:00+00:00 exited with status success for try_number 1 2024-06-28T00:02:05.862928517Z [2024-06-28T00:02:05.862+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:01:00+00:00, map_index=-1, run_start_date=2024-06-28 00:02:03.396793+00:00, run_end_date=2024-06-28 00:02:05.001293+00:00, run_duration=1.6045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:02:00.794584+00:00, queued_by_job_id=2, pid=5943 2024-06-28T00:02:05.863639076Z [2024-06-28T00:02:05.863+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:01:00+00:00, map_index=-1, run_start_date=2024-06-28 00:02:03.465552+00:00, run_end_date=2024-06-28 00:02:05.612183+00:00, run_duration=2.146631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:02:00.794584+00:00, queued_by_job_id=2, pid=5944 2024-06-28T00:03:00.505358519Z [2024-06-28T00:03:00.504+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:03:00.523955452Z [2024-06-28T00:03:00.523+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:03:00+00:00, run_after=2024-06-28T00:04:00+00:00 2024-06-28T00:03:00.538659865Z [2024-06-28T00:03:00.538+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:03:00+00:00, run_after=2024-06-28T00:04:00+00:00 2024-06-28T00:03:00.613948808Z [2024-06-28T00:03:00.612+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:03:00.613963848Z 2024-06-28T00:03:00.613967416Z 2024-06-28T00:03:00.613970699Z 2024-06-28T00:03:00.613973964Z [2024-06-28T00:03:00.613+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:03:00.614005458Z [2024-06-28T00:03:00.613+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:03:00.614009703Z [2024-06-28T00:03:00.613+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:03:00.615792348Z [2024-06-28T00:03:00.615+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:03:00.615811808Z 2024-06-28T00:03:00.615818165Z 2024-06-28T00:03:00.615824064Z 2024-06-28T00:03:00.623081556Z [2024-06-28T00:03:00.622+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:03:00.623317631Z [2024-06-28T00:03:00.623+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:03:00.623700190Z [2024-06-28T00:03:00.623+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:03:00.623928604Z [2024-06-28T00:03:00.623+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:03:00.624285120Z [2024-06-28T00:03:00.624+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:03:00.624487780Z [2024-06-28T00:03:00.624+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:03:00.954019163Z [2024-06-28T00:03:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:02:00+00:00 exited with status queued for try_number 1 2024-06-28T00:03:00.954228081Z [2024-06-28T00:03:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:02:00+00:00 exited with status queued for try_number 1 2024-06-28T00:03:00.954393288Z [2024-06-28T00:03:00.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:02:00+00:00 exited with status queued for try_number 1 2024-06-28T00:03:00.965802630Z [2024-06-28T00:03:00.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to dcec271b-baa4-4112-817c-14ff48e6ea7f 2024-06-28T00:03:00.966325815Z [2024-06-28T00:03:00.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cdc06f9-8869-4b73-920f-860801b5080d 2024-06-28T00:03:00.966595557Z [2024-06-28T00:03:00.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to b77c776c-9bf4-429f-b5ef-c2698428781c 2024-06-28T00:03:02.260400636Z [2024-06-28T00:03:02.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:02:00+00:00 exited with status success for try_number 1 2024-06-28T00:03:02.267569889Z [2024-06-28T00:03:02.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:02:00+00:00, map_index=-1, run_start_date=2024-06-28 00:03:01.601722+00:00, run_end_date=2024-06-28 00:03:02.101041+00:00, run_duration=0.499319, state=success, executor_state=success, try_number=1, max_tries=1, job_id=407, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:03:00.619519+00:00, queued_by_job_id=2, pid=5977 2024-06-28T00:03:03.316363706Z [2024-06-28T00:03:03.315+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:03:03.316663104Z [2024-06-28T00:03:03.316+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:02:00+00:00, run_id=scheduled__2024-06-28T00:02:00+00:00, run_start_date=2024-06-28 00:03:00.555529+00:00, run_end_date=2024-06-28 00:03:03.316287+00:00, run_duration=2.760758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:02:00+00:00, data_interval_end=2024-06-28 00:03:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:03:03.330195702Z [2024-06-28T00:03:03.329+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:03:00+00:00, run_after=2024-06-28T00:04:00+00:00 2024-06-28T00:03:05.808568801Z [2024-06-28T00:03:05.808+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:03:05.808848433Z [2024-06-28T00:03:05.808+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:02:00+00:00, run_id=scheduled__2024-06-28T00:02:00+00:00, run_start_date=2024-06-28 00:03:00.558175+00:00, run_end_date=2024-06-28 00:03:05.808559+00:00, run_duration=5.250384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:02:00+00:00, data_interval_end=2024-06-28 00:03:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:03:05.817491794Z [2024-06-28T00:03:05.817+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:03:00+00:00, run_after=2024-06-28T00:04:00+00:00 2024-06-28T00:03:05.826497792Z [2024-06-28T00:03:05.826+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:03:05.826981679Z [2024-06-28T00:03:05.826+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:02:00+00:00, run_id=scheduled__2024-06-28T00:02:00+00:00, run_start_date=2024-06-28 00:03:00.556900+00:00, run_end_date=2024-06-28 00:03:05.826639+00:00, run_duration=5.269739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:02:00+00:00, data_interval_end=2024-06-28 00:03:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:03:05.839330236Z [2024-06-28T00:03:05.839+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:03:00+00:00, run_after=2024-06-28T00:04:00+00:00 2024-06-28T00:03:05.900476486Z [2024-06-28T00:03:05.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:02:00+00:00 exited with status success for try_number 1 2024-06-28T00:03:05.900601176Z [2024-06-28T00:03:05.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:02:00+00:00 exited with status success for try_number 1 2024-06-28T00:03:05.908078223Z [2024-06-28T00:03:05.907+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:02:00+00:00, map_index=-1, run_start_date=2024-06-28 00:03:02.949214+00:00, run_end_date=2024-06-28 00:03:05.644102+00:00, run_duration=2.694888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=409, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:03:00.619519+00:00, queued_by_job_id=2, pid=5996 2024-06-28T00:03:05.908316529Z [2024-06-28T00:03:05.908+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:02:00+00:00, map_index=-1, run_start_date=2024-06-28 00:03:02.957752+00:00, run_end_date=2024-06-28 00:03:04.784742+00:00, run_duration=1.82699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=408, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:03:00.619519+00:00, queued_by_job_id=2, pid=5995 2024-06-28T00:04:01.047921672Z [2024-06-28T00:04:01.047+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:04:01.065034712Z [2024-06-28T00:04:01.064+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:04:00+00:00, run_after=2024-06-28T00:05:00+00:00 2024-06-28T00:04:01.074665476Z [2024-06-28T00:04:01.074+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:04:01.093734648Z [2024-06-28T00:04:01.093+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:04:00+00:00, run_after=2024-06-28T00:05:00+00:00 2024-06-28T00:04:01.179700093Z [2024-06-28T00:04:01.179+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:04:01.179728638Z 2024-06-28T00:04:01.179736577Z 2024-06-28T00:04:01.179742526Z 2024-06-28T00:04:01.179748177Z 2024-06-28T00:04:01.180566559Z [2024-06-28T00:04:01.179+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:04:01.180815688Z [2024-06-28T00:04:01.180+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:04:01.181354704Z [2024-06-28T00:04:01.180+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:04:01.181750540Z [2024-06-28T00:04:01.181+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:04:01.183832951Z [2024-06-28T00:04:01.183+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:04:01.183853391Z 2024-06-28T00:04:01.183858851Z 2024-06-28T00:04:01.183863888Z 2024-06-28T00:04:01.183869208Z 2024-06-28T00:04:01.201217260Z [2024-06-28T00:04:01.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:04:01.201527280Z [2024-06-28T00:04:01.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:04:01.202001443Z [2024-06-28T00:04:01.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:04:01.202169138Z [2024-06-28T00:04:01.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:04:01.202660447Z [2024-06-28T00:04:01.202+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:04:01.203004432Z [2024-06-28T00:04:01.202+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:04:01.203721876Z [2024-06-28T00:04:01.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:04:01.204097521Z [2024-06-28T00:04:01.203+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:04:01.570161394Z [2024-06-28T00:04:01.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:02:00+00:00 exited with status queued for try_number 1 2024-06-28T00:04:01.570945422Z [2024-06-28T00:04:01.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:03:00+00:00 exited with status queued for try_number 1 2024-06-28T00:04:01.571095187Z [2024-06-28T00:04:01.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:03:00+00:00 exited with status queued for try_number 1 2024-06-28T00:04:01.571238699Z [2024-06-28T00:04:01.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:03:00+00:00 exited with status queued for try_number 1 2024-06-28T00:04:01.590221707Z [2024-06-28T00:04:01.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to 663f5fb6-d1d5-423f-a3ee-b33e1f36613f 2024-06-28T00:04:01.590252495Z [2024-06-28T00:04:01.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ee833f6-3c16-441f-a258-cc94abbcb105 2024-06-28T00:04:01.590258102Z [2024-06-28T00:04:01.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46dd7694-5e39-4c32-9f75-5c90090be700 2024-06-28T00:04:01.590551631Z [2024-06-28T00:04:01.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bba9c66-f087-4b4d-a41b-e054245ce8b4 2024-06-28T00:04:04.823673364Z [2024-06-28T00:04:04.823+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:04:04.823924997Z [2024-06-28T00:04:04.823+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:02:00+00:00, run_id=scheduled__2024-06-28T00:02:00+00:00, run_start_date=2024-06-28 00:04:01.105313+00:00, run_end_date=2024-06-28 00:04:04.823570+00:00, run_duration=3.718257, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:02:00+00:00, data_interval_end=2024-06-28 00:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:04:04.836062591Z [2024-06-28T00:04:04.835+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:04:00+00:00, run_after=2024-06-28T00:06:00+00:00 2024-06-28T00:04:04.852827694Z [2024-06-28T00:04:04.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:04:04.853062010Z [2024-06-28T00:04:04.852+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:03:00+00:00, run_id=scheduled__2024-06-28T00:03:00+00:00, run_start_date=2024-06-28 00:04:01.106967+00:00, run_end_date=2024-06-28 00:04:04.852715+00:00, run_duration=3.745748, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:03:00+00:00, data_interval_end=2024-06-28 00:04:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:04:04.899638269Z [2024-06-28T00:04:04.899+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:04:00+00:00, run_after=2024-06-28T00:05:00+00:00 2024-06-28T00:04:05.089891763Z [2024-06-28T00:04:05.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:02:00+00:00 exited with status success for try_number 1 2024-06-28T00:04:05.090105701Z [2024-06-28T00:04:05.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:03:00+00:00 exited with status success for try_number 1 2024-06-28T00:04:05.097508623Z [2024-06-28T00:04:05.097+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:03:00+00:00, map_index=-1, run_start_date=2024-06-28 00:04:02.759819+00:00, run_end_date=2024-06-28 00:04:03.419349+00:00, run_duration=0.65953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=410, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:04:01.188119+00:00, queued_by_job_id=2, pid=6029 2024-06-28T00:04:05.097799564Z [2024-06-28T00:04:05.097+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:02:00+00:00, map_index=-1, run_start_date=2024-06-28 00:04:02.794261+00:00, run_end_date=2024-06-28 00:04:03.437532+00:00, run_duration=0.643271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=411, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:04:01.188119+00:00, queued_by_job_id=2, pid=6030 2024-06-28T00:04:07.119572562Z [2024-06-28T00:04:07.119+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:04:07.120084611Z [2024-06-28T00:04:07.119+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:03:00+00:00, run_id=scheduled__2024-06-28T00:03:00+00:00, run_start_date=2024-06-28 00:04:01.108358+00:00, run_end_date=2024-06-28 00:04:07.119676+00:00, run_duration=6.011318, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:03:00+00:00, data_interval_end=2024-06-28 00:04:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:04:07.129901334Z [2024-06-28T00:04:07.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:04:00+00:00, run_after=2024-06-28T00:05:00+00:00 2024-06-28T00:04:07.140985038Z [2024-06-28T00:04:07.140+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:04:07.141380173Z [2024-06-28T00:04:07.141+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:03:00+00:00, run_id=scheduled__2024-06-28T00:03:00+00:00, run_start_date=2024-06-28 00:04:01.109641+00:00, run_end_date=2024-06-28 00:04:07.140925+00:00, run_duration=6.031284, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:03:00+00:00, data_interval_end=2024-06-28 00:04:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:04:07.153654841Z [2024-06-28T00:04:07.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:04:00+00:00, run_after=2024-06-28T00:05:00+00:00 2024-06-28T00:04:07.202919001Z [2024-06-28T00:04:07.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:03:00+00:00 exited with status success for try_number 1 2024-06-28T00:04:07.203228439Z [2024-06-28T00:04:07.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:03:00+00:00 exited with status success for try_number 1 2024-06-28T00:04:07.214431081Z [2024-06-28T00:04:07.214+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:03:00+00:00, map_index=-1, run_start_date=2024-06-28 00:04:04.579267+00:00, run_end_date=2024-06-28 00:04:06.427081+00:00, run_duration=1.847814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=412, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:04:01.188119+00:00, queued_by_job_id=2, pid=6048 2024-06-28T00:04:07.214829549Z [2024-06-28T00:04:07.214+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:03:00+00:00, map_index=-1, run_start_date=2024-06-28 00:04:05.142777+00:00, run_end_date=2024-06-28 00:04:06.703201+00:00, run_duration=1.560424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=413, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:04:01.188119+00:00, queued_by_job_id=2, pid=6059 2024-06-28T00:05:00.328284232Z [2024-06-28T00:05:00.327+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:05:00+00:00, run_after=2024-06-28T00:06:00+00:00 2024-06-28T00:05:00.343233675Z [2024-06-28T00:05:00.342+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:05:00+00:00, run_after=2024-06-28T00:10:00+00:00 2024-06-28T00:05:00.360577509Z [2024-06-28T00:05:00.360+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:05:00+00:00, run_after=2024-06-28T00:06:00+00:00 2024-06-28T00:05:00.373947697Z [2024-06-28T00:05:00.373+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:05:00.477381867Z [2024-06-28T00:05:00.476+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:05:00.477428660Z 2024-06-28T00:05:00.477439447Z 2024-06-28T00:05:00.477448455Z 2024-06-28T00:05:00.477457046Z 2024-06-28T00:05:00.478737339Z [2024-06-28T00:05:00.477+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:05:00.479262502Z [2024-06-28T00:05:00.478+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:05:00.479733394Z [2024-06-28T00:05:00.479+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:05:00.479995350Z [2024-06-28T00:05:00.479+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:05:00.481554475Z [2024-06-28T00:05:00.481+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:05:00.481574455Z 2024-06-28T00:05:00.481581600Z 2024-06-28T00:05:00.481587968Z 2024-06-28T00:05:00.481593730Z 2024-06-28T00:05:00.489559483Z [2024-06-28T00:05:00.489+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T00:05:00.489862317Z [2024-06-28T00:05:00.489+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:05:00.490370768Z [2024-06-28T00:05:00.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:05:00.490607592Z [2024-06-28T00:05:00.490+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:05:00.491229657Z [2024-06-28T00:05:00.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:05:00.491408711Z [2024-06-28T00:05:00.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:05:00.491768067Z [2024-06-28T00:05:00.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:05:00.491960927Z [2024-06-28T00:05:00.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:05:00.859424159Z [2024-06-28T00:05:00.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:00:00+00:00 exited with status queued for try_number 1 2024-06-28T00:05:00.859603268Z [2024-06-28T00:05:00.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:04:00+00:00 exited with status queued for try_number 1 2024-06-28T00:05:00.859762245Z [2024-06-28T00:05:00.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:04:00+00:00 exited with status queued for try_number 1 2024-06-28T00:05:00.859925858Z [2024-06-28T00:05:00.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:04:00+00:00 exited with status queued for try_number 1 2024-06-28T00:05:00.872267289Z [2024-06-28T00:05:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6d95f26-abc3-474b-b679-dc12dca141a5 2024-06-28T00:05:00.872498798Z [2024-06-28T00:05:00.872+0000] {scheduler_job.py:635} INFO - Setting external_id for to 988a012c-a02b-410c-920b-566b2db00503 2024-06-28T00:05:00.872723720Z [2024-06-28T00:05:00.872+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a042bbf-6bea-481b-a103-f38d35af942a 2024-06-28T00:05:00.872934302Z [2024-06-28T00:05:00.872+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e7a79c2-8fff-4405-b38e-98bac4d9a95f 2024-06-28T00:05:03.120611379Z [2024-06-28T00:05:03.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:05:03.124915293Z [2024-06-28T00:05:03.124+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:04:00+00:00, run_id=scheduled__2024-06-28T00:04:00+00:00, run_start_date=2024-06-28 00:05:00.391892+00:00, run_end_date=2024-06-28 00:05:03.120526+00:00, run_duration=2.728634, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:04:00+00:00, data_interval_end=2024-06-28 00:05:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:05:03.171373279Z [2024-06-28T00:05:03.171+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:05:00+00:00, run_after=2024-06-28T00:06:00+00:00 2024-06-28T00:05:03.360138573Z [2024-06-28T00:05:03.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:04:00+00:00 exited with status success for try_number 1 2024-06-28T00:05:03.378978324Z [2024-06-28T00:05:03.378+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:04:00+00:00, map_index=-1, run_start_date=2024-06-28 00:05:01.644174+00:00, run_end_date=2024-06-28 00:05:02.285134+00:00, run_duration=0.64096, state=success, executor_state=success, try_number=1, max_tries=1, job_id=414, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:05:00.483769+00:00, queued_by_job_id=2, pid=6087 2024-06-28T00:05:04.546658287Z [2024-06-28T00:05:04.546+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:05:04.546739512Z 2024-06-28T00:05:04.547111039Z [2024-06-28T00:05:04.546+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:05:04.547985193Z [2024-06-28T00:05:04.547+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:05:04.547999749Z 2024-06-28T00:05:04.550935599Z [2024-06-28T00:05:04.550+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T00:05:04.551410207Z [2024-06-28T00:05:04.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:05:04.643396484Z [2024-06-28T00:05:04.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:00:00+00:00 exited with status queued for try_number 1 2024-06-28T00:05:04.643433228Z [2024-06-28T00:05:04.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:00:00+00:00 exited with status success for try_number 1 2024-06-28T00:05:04.663634706Z [2024-06-28T00:05:04.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to f32baa04-f3e7-4208-9fc9-c0eb718d33eb 2024-06-28T00:05:04.663672407Z [2024-06-28T00:05:04.661+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T00:00:00+00:00, map_index=-1, run_start_date=2024-06-28 00:05:03.265590+00:00, run_end_date=2024-06-28 00:05:03.934574+00:00, run_duration=0.668984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=416, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:05:00.483769+00:00, queued_by_job_id=2, pid=6111 2024-06-28T00:05:05.612402016Z [2024-06-28T00:05:05.612+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:05:05.620500670Z [2024-06-28T00:05:05.620+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:04:00+00:00, run_id=scheduled__2024-06-28T00:04:00+00:00, run_start_date=2024-06-28 00:05:00.393121+00:00, run_end_date=2024-06-28 00:05:05.619923+00:00, run_duration=5.226802, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:04:00+00:00, data_interval_end=2024-06-28 00:05:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:05:05.632702149Z [2024-06-28T00:05:05.632+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:05:00+00:00, run_after=2024-06-28T00:06:00+00:00 2024-06-28T00:05:05.649454071Z [2024-06-28T00:05:05.649+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:05:05.650338423Z [2024-06-28T00:05:05.650+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:04:00+00:00, run_id=scheduled__2024-06-28T00:04:00+00:00, run_start_date=2024-06-28 00:05:00.394235+00:00, run_end_date=2024-06-28 00:05:05.649387+00:00, run_duration=5.255152, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:04:00+00:00, data_interval_end=2024-06-28 00:05:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:05:05.669787170Z [2024-06-28T00:05:05.669+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:05:00+00:00, run_after=2024-06-28T00:06:00+00:00 2024-06-28T00:05:05.989031393Z [2024-06-28T00:05:05.987+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:04:00+00:00 exited with status success for try_number 1 2024-06-28T00:05:05.989071836Z [2024-06-28T00:05:05.987+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:04:00+00:00 exited with status success for try_number 1 2024-06-28T00:05:06.007887990Z [2024-06-28T00:05:06.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:04:00+00:00, map_index=-1, run_start_date=2024-06-28 00:05:03.319915+00:00, run_end_date=2024-06-28 00:05:04.936359+00:00, run_duration=1.616444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=417, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:05:00.483769+00:00, queued_by_job_id=2, pid=6113 2024-06-28T00:05:06.010730404Z [2024-06-28T00:05:06.007+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:04:00+00:00, map_index=-1, run_start_date=2024-06-28 00:05:03.259162+00:00, run_end_date=2024-06-28 00:05:05.206632+00:00, run_duration=1.94747, state=success, executor_state=success, try_number=1, max_tries=1, job_id=415, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:05:00.483769+00:00, queued_by_job_id=2, pid=6112 2024-06-28T00:05:09.740229580Z [2024-06-28T00:05:09.738+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:05:09.740243155Z 2024-06-28T00:05:09.740246713Z [2024-06-28T00:05:09.738+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:05:09.740250512Z [2024-06-28T00:05:09.739+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:05:09.740253793Z 2024-06-28T00:05:09.747625279Z [2024-06-28T00:05:09.746+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T00:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T00:05:09.747638101Z [2024-06-28T00:05:09.746+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T00:05:09.850885554Z [2024-06-28T00:05:09.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:00:00+00:00 exited with status queued for try_number 1 2024-06-28T00:05:09.850900383Z [2024-06-28T00:05:09.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:00:00+00:00 exited with status success for try_number 1 2024-06-28T00:05:09.870140174Z [2024-06-28T00:05:09.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ebf47b4-0762-445b-a12b-63587f5f8f8d 2024-06-28T00:05:09.870167854Z [2024-06-28T00:05:09.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T00:00:00+00:00, map_index=-1, run_start_date=2024-06-28 00:05:07.493735+00:00, run_end_date=2024-06-28 00:05:08.271449+00:00, run_duration=0.777714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=418, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:05:04.548678+00:00, queued_by_job_id=2, pid=6136 2024-06-28T00:05:12.280198947Z [2024-06-28T00:05:12.279+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:05:12.280217118Z 2024-06-28T00:05:12.280299073Z [2024-06-28T00:05:12.280+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:05:12.282496068Z [2024-06-28T00:05:12.280+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:05:12.282510695Z 2024-06-28T00:05:12.291613573Z [2024-06-28T00:05:12.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:05:12.295282989Z [2024-06-28T00:05:12.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:05:12.410515597Z [2024-06-28T00:05:12.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:00:00+00:00 exited with status queued for try_number 1 2024-06-28T00:05:12.424646663Z [2024-06-28T00:05:12.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20454cec-6325-4617-ab9f-350705ea1f00 2024-06-28T00:05:12.554565633Z [2024-06-28T00:05:12.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:00:00+00:00 exited with status success for try_number 1 2024-06-28T00:05:12.559418486Z [2024-06-28T00:05:12.558+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T00:00:00+00:00, map_index=0, run_start_date=2024-06-28 00:05:11.779412+00:00, run_end_date=2024-06-28 00:05:12.185657+00:00, run_duration=0.406245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=419, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:05:09.743082+00:00, queued_by_job_id=2, pid=6144 2024-06-28T00:05:15.517458864Z [2024-06-28T00:05:15.517+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:05:15.517679944Z [2024-06-28T00:05:15.517+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:00:00+00:00, run_id=scheduled__2024-06-28T00:00:00+00:00, run_start_date=2024-06-28 00:05:00.390407+00:00, run_end_date=2024-06-28 00:05:15.517319+00:00, run_duration=15.126912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:00:00+00:00, data_interval_end=2024-06-28 00:05:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T00:05:15.527524770Z [2024-06-28T00:05:15.527+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:05:00+00:00, run_after=2024-06-28T00:10:00+00:00 2024-06-28T00:05:15.605815655Z [2024-06-28T00:05:15.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:00:00+00:00 exited with status success for try_number 1 2024-06-28T00:05:15.614873570Z [2024-06-28T00:05:15.612+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T00:00:00+00:00, map_index=-1, run_start_date=2024-06-28 00:05:14.357919+00:00, run_end_date=2024-06-28 00:05:14.757391+00:00, run_duration=0.399472, state=success, executor_state=success, try_number=1, max_tries=1, job_id=420, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:05:12.281407+00:00, queued_by_job_id=2, pid=6152 2024-06-28T00:06:00.688785182Z [2024-06-28T00:06:00.688+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:06:00.695095696Z [2024-06-28T00:06:00.694+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:06:00.707205268Z [2024-06-28T00:06:00.706+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:06:00+00:00, run_after=2024-06-28T00:07:00+00:00 2024-06-28T00:06:00.720618729Z [2024-06-28T00:06:00.720+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:06:00+00:00, run_after=2024-06-28T00:07:00+00:00 2024-06-28T00:06:00.827028015Z [2024-06-28T00:06:00.826+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:06:00.827067924Z 2024-06-28T00:06:00.827072231Z 2024-06-28T00:06:00.827075593Z 2024-06-28T00:06:00.827078854Z 2024-06-28T00:06:00.830185303Z [2024-06-28T00:06:00.829+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:06:00.830381467Z [2024-06-28T00:06:00.830+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:06:00.830583291Z [2024-06-28T00:06:00.830+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:06:00.830771445Z [2024-06-28T00:06:00.830+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:06:00.831437039Z [2024-06-28T00:06:00.831+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:06:00.831455230Z 2024-06-28T00:06:00.831485079Z 2024-06-28T00:06:00.831491291Z 2024-06-28T00:06:00.831497122Z 2024-06-28T00:06:00.837347004Z [2024-06-28T00:06:00.837+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:06:00.837597058Z [2024-06-28T00:06:00.837+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:06:00.837911010Z [2024-06-28T00:06:00.837+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:06:00.838123662Z [2024-06-28T00:06:00.837+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:06:00.838500404Z [2024-06-28T00:06:00.838+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:06:00.838721779Z [2024-06-28T00:06:00.838+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:06:00.839040564Z [2024-06-28T00:06:00.838+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:06:00.839198755Z [2024-06-28T00:06:00.839+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:06:01.162210093Z [2024-06-28T00:06:01.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:04:00+00:00 exited with status queued for try_number 1 2024-06-28T00:06:01.162264252Z [2024-06-28T00:06:01.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:05:00+00:00 exited with status queued for try_number 1 2024-06-28T00:06:01.162331735Z [2024-06-28T00:06:01.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:05:00+00:00 exited with status queued for try_number 1 2024-06-28T00:06:01.162385335Z [2024-06-28T00:06:01.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:05:00+00:00 exited with status queued for try_number 1 2024-06-28T00:06:01.170421360Z [2024-06-28T00:06:01.170+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c96a641-738f-4ef6-8526-7b4400e3f424 2024-06-28T00:06:01.170465451Z [2024-06-28T00:06:01.170+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28905b47-fb87-4709-bd24-25feb43131f2 2024-06-28T00:06:01.170580177Z [2024-06-28T00:06:01.170+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72b5b269-1aa0-4685-83ac-598b5d4323b0 2024-06-28T00:06:01.170663785Z [2024-06-28T00:06:01.170+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75409432-19d0-47e3-a5fc-9722580be28b 2024-06-28T00:06:03.607823554Z [2024-06-28T00:06:03.607+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:06:03.608339839Z [2024-06-28T00:06:03.608+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:04:00+00:00, run_id=scheduled__2024-06-28T00:04:00+00:00, run_start_date=2024-06-28 00:06:00.731230+00:00, run_end_date=2024-06-28 00:06:03.607851+00:00, run_duration=2.876621, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:04:00+00:00, data_interval_end=2024-06-28 00:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:06:03.617764813Z [2024-06-28T00:06:03.617+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:06:00+00:00, run_after=2024-06-28T00:08:00+00:00 2024-06-28T00:06:03.627664179Z [2024-06-28T00:06:03.627+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:06:03.628055345Z [2024-06-28T00:06:03.627+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:05:00+00:00, run_id=scheduled__2024-06-28T00:05:00+00:00, run_start_date=2024-06-28 00:06:00.732403+00:00, run_end_date=2024-06-28 00:06:03.627722+00:00, run_duration=2.895319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:05:00+00:00, data_interval_end=2024-06-28 00:06:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:06:03.636819746Z [2024-06-28T00:06:03.636+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:06:00+00:00, run_after=2024-06-28T00:07:00+00:00 2024-06-28T00:06:03.687648077Z [2024-06-28T00:06:03.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:04:00+00:00 exited with status success for try_number 1 2024-06-28T00:06:03.688362828Z [2024-06-28T00:06:03.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:05:00+00:00 exited with status success for try_number 1 2024-06-28T00:06:03.697419281Z [2024-06-28T00:06:03.697+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:04:00+00:00, map_index=-1, run_start_date=2024-06-28 00:06:02.186910+00:00, run_end_date=2024-06-28 00:06:02.662462+00:00, run_duration=0.475552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=421, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:06:00.832584+00:00, queued_by_job_id=2, pid=6175 2024-06-28T00:06:03.698181971Z [2024-06-28T00:06:03.697+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:05:00+00:00, map_index=-1, run_start_date=2024-06-28 00:06:02.223254+00:00, run_end_date=2024-06-28 00:06:02.838265+00:00, run_duration=0.615011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=422, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:06:00.832584+00:00, queued_by_job_id=2, pid=6177 2024-06-28T00:06:05.610490064Z [2024-06-28T00:06:05.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:06:05.610682173Z [2024-06-28T00:06:05.610+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:05:00+00:00, run_id=scheduled__2024-06-28T00:05:00+00:00, run_start_date=2024-06-28 00:06:00.734346+00:00, run_end_date=2024-06-28 00:06:05.610418+00:00, run_duration=4.876072, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:05:00+00:00, data_interval_end=2024-06-28 00:06:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:06:05.620054877Z [2024-06-28T00:06:05.619+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:06:00+00:00, run_after=2024-06-28T00:07:00+00:00 2024-06-28T00:06:05.634185067Z [2024-06-28T00:06:05.633+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:06:05.634299006Z [2024-06-28T00:06:05.634+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:05:00+00:00, run_id=scheduled__2024-06-28T00:05:00+00:00, run_start_date=2024-06-28 00:06:00.733420+00:00, run_end_date=2024-06-28 00:06:05.634038+00:00, run_duration=4.900618, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:05:00+00:00, data_interval_end=2024-06-28 00:06:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:06:05.647837126Z [2024-06-28T00:06:05.647+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:06:00+00:00, run_after=2024-06-28T00:07:00+00:00 2024-06-28T00:06:05.702612777Z [2024-06-28T00:06:05.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:05:00+00:00 exited with status success for try_number 1 2024-06-28T00:06:05.702633912Z [2024-06-28T00:06:05.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:05:00+00:00 exited with status success for try_number 1 2024-06-28T00:06:05.711394494Z [2024-06-28T00:06:05.711+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:05:00+00:00, map_index=-1, run_start_date=2024-06-28 00:06:03.402057+00:00, run_end_date=2024-06-28 00:06:05.368117+00:00, run_duration=1.96606, state=success, executor_state=success, try_number=1, max_tries=1, job_id=424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:06:00.832584+00:00, queued_by_job_id=2, pid=6200 2024-06-28T00:06:05.711511005Z [2024-06-28T00:06:05.711+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:05:00+00:00, map_index=-1, run_start_date=2024-06-28 00:06:03.184374+00:00, run_end_date=2024-06-28 00:06:04.597022+00:00, run_duration=1.412648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=423, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:06:00.832584+00:00, queued_by_job_id=2, pid=6194 2024-06-28T00:06:45.279616507Z [2024-06-28T00:06:45.279+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T00:07:00.453947933Z [2024-06-28T00:07:00.453+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:07:00+00:00, run_after=2024-06-28T00:08:00+00:00 2024-06-28T00:07:00.462632340Z [2024-06-28T00:07:00.462+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:07:00.473554261Z [2024-06-28T00:07:00.473+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:07:00+00:00, run_after=2024-06-28T00:08:00+00:00 2024-06-28T00:07:00.535528033Z [2024-06-28T00:07:00.535+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:07:00.535547894Z 2024-06-28T00:07:00.535553599Z 2024-06-28T00:07:00.535558383Z 2024-06-28T00:07:00.536011601Z [2024-06-28T00:07:00.535+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:07:00.536335386Z [2024-06-28T00:07:00.536+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:07:00.536608424Z [2024-06-28T00:07:00.536+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:07:00.537706299Z [2024-06-28T00:07:00.537+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:07:00.537722257Z 2024-06-28T00:07:00.537727996Z 2024-06-28T00:07:00.537768967Z 2024-06-28T00:07:00.543579708Z [2024-06-28T00:07:00.543+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:07:00.543809446Z [2024-06-28T00:07:00.543+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:07:00.544116130Z [2024-06-28T00:07:00.543+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:07:00.544306729Z [2024-06-28T00:07:00.544+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:07:00.544723989Z [2024-06-28T00:07:00.544+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:07:00.544908597Z [2024-06-28T00:07:00.544+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:07:00.819993747Z [2024-06-28T00:07:00.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:06:00+00:00 exited with status queued for try_number 1 2024-06-28T00:07:00.820172959Z [2024-06-28T00:07:00.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:06:00+00:00 exited with status queued for try_number 1 2024-06-28T00:07:00.821257828Z [2024-06-28T00:07:00.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:06:00+00:00 exited with status queued for try_number 1 2024-06-28T00:07:00.830148920Z [2024-06-28T00:07:00.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08e8f728-123f-43d1-bece-63c76c99f053 2024-06-28T00:07:00.830722984Z [2024-06-28T00:07:00.830+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed07f8c3-eacc-45e4-814c-53dbe3a19b20 2024-06-28T00:07:00.831110151Z [2024-06-28T00:07:00.830+0000] {scheduler_job.py:635} INFO - Setting external_id for to 587a6d18-cfc7-4f63-b0f6-3ebeafd2ea35 2024-06-28T00:07:02.155736528Z [2024-06-28T00:07:02.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:07:02.155952022Z [2024-06-28T00:07:02.155+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:06:00+00:00, run_id=scheduled__2024-06-28T00:06:00+00:00, run_start_date=2024-06-28 00:07:00.483130+00:00, run_end_date=2024-06-28 00:07:02.155652+00:00, run_duration=1.672522, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:06:00+00:00, data_interval_end=2024-06-28 00:07:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:07:02.166777706Z [2024-06-28T00:07:02.166+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:07:00+00:00, run_after=2024-06-28T00:08:00+00:00 2024-06-28T00:07:03.291008632Z [2024-06-28T00:07:03.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:06:00+00:00 exited with status success for try_number 1 2024-06-28T00:07:03.305735160Z [2024-06-28T00:07:03.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:06:00+00:00, map_index=-1, run_start_date=2024-06-28 00:07:01.625972+00:00, run_end_date=2024-06-28 00:07:02.092197+00:00, run_duration=0.466225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=425, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:07:00.539668+00:00, queued_by_job_id=2, pid=6231 2024-06-28T00:07:04.391711067Z [2024-06-28T00:07:04.391+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:07:04.392105635Z [2024-06-28T00:07:04.391+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:06:00+00:00, run_id=scheduled__2024-06-28T00:06:00+00:00, run_start_date=2024-06-28 00:07:00.484523+00:00, run_end_date=2024-06-28 00:07:04.391755+00:00, run_duration=3.907232, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:06:00+00:00, data_interval_end=2024-06-28 00:07:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:07:04.401053891Z [2024-06-28T00:07:04.400+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:07:00+00:00, run_after=2024-06-28T00:08:00+00:00 2024-06-28T00:07:04.467862528Z [2024-06-28T00:07:04.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:06:00+00:00 exited with status success for try_number 1 2024-06-28T00:07:04.473619361Z [2024-06-28T00:07:04.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:06:00+00:00, map_index=-1, run_start_date=2024-06-28 00:07:02.674974+00:00, run_end_date=2024-06-28 00:07:04.010325+00:00, run_duration=1.335351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:07:00.539668+00:00, queued_by_job_id=2, pid=6249 2024-06-28T00:07:05.570361494Z [2024-06-28T00:07:05.569+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:07:05.573474738Z [2024-06-28T00:07:05.571+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:06:00+00:00, run_id=scheduled__2024-06-28T00:06:00+00:00, run_start_date=2024-06-28 00:07:00.485593+00:00, run_end_date=2024-06-28 00:07:05.571089+00:00, run_duration=5.085496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:06:00+00:00, data_interval_end=2024-06-28 00:07:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:07:05.587682128Z [2024-06-28T00:07:05.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:07:00+00:00, run_after=2024-06-28T00:08:00+00:00 2024-06-28T00:07:05.652170594Z [2024-06-28T00:07:05.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:06:00+00:00 exited with status success for try_number 1 2024-06-28T00:07:05.667291011Z [2024-06-28T00:07:05.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:06:00+00:00, map_index=-1, run_start_date=2024-06-28 00:07:02.759841+00:00, run_end_date=2024-06-28 00:07:04.655976+00:00, run_duration=1.896135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=427, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:07:00.539668+00:00, queued_by_job_id=2, pid=6250 2024-06-28T00:08:00.229322758Z [2024-06-28T00:08:00.228+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:08:00.237122242Z [2024-06-28T00:08:00.236+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:08:00.249359837Z [2024-06-28T00:08:00.248+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:08:00+00:00, run_after=2024-06-28T00:09:00+00:00 2024-06-28T00:08:00.261629240Z [2024-06-28T00:08:00.261+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:08:00+00:00, run_after=2024-06-28T00:09:00+00:00 2024-06-28T00:08:00.357115693Z [2024-06-28T00:08:00.356+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:08:00.357185912Z 2024-06-28T00:08:00.357190711Z 2024-06-28T00:08:00.357194086Z 2024-06-28T00:08:00.357202085Z 2024-06-28T00:08:00.357705601Z [2024-06-28T00:08:00.357+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:08:00.357961195Z [2024-06-28T00:08:00.357+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:08:00.358169295Z [2024-06-28T00:08:00.358+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:08:00.358374350Z [2024-06-28T00:08:00.358+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:08:00.360533548Z [2024-06-28T00:08:00.360+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:08:00.360544012Z 2024-06-28T00:08:00.360548188Z 2024-06-28T00:08:00.360551799Z 2024-06-28T00:08:00.360555246Z 2024-06-28T00:08:00.366879906Z [2024-06-28T00:08:00.366+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:08:00.367643097Z [2024-06-28T00:08:00.367+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:08:00.368183461Z [2024-06-28T00:08:00.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:08:00.368487300Z [2024-06-28T00:08:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:08:00.369009685Z [2024-06-28T00:08:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:08:00.369383218Z [2024-06-28T00:08:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:08:00.369839908Z [2024-06-28T00:08:00.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:08:00.370224730Z [2024-06-28T00:08:00.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:08:00.883789255Z [2024-06-28T00:08:00.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:06:00+00:00 exited with status queued for try_number 1 2024-06-28T00:08:00.883967325Z [2024-06-28T00:08:00.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:07:00+00:00 exited with status queued for try_number 1 2024-06-28T00:08:00.884104768Z [2024-06-28T00:08:00.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:07:00+00:00 exited with status queued for try_number 1 2024-06-28T00:08:00.884241057Z [2024-06-28T00:08:00.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:07:00+00:00 exited with status queued for try_number 1 2024-06-28T00:08:00.899231481Z [2024-06-28T00:08:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d88437e-dcc5-433c-832d-ddab79f35339 2024-06-28T00:08:00.899551272Z [2024-06-28T00:08:00.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to 803466ba-985c-4478-9878-fa41156e020f 2024-06-28T00:08:00.899858876Z [2024-06-28T00:08:00.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a96e2f1-f940-4316-b030-1fc405ab9845 2024-06-28T00:08:00.900142960Z [2024-06-28T00:08:00.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c05c0d8-9afe-4309-8676-fdaa32b35266 2024-06-28T00:08:01.898312271Z [2024-06-28T00:08:01.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:08:01.898570304Z [2024-06-28T00:08:01.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:06:00+00:00, run_id=scheduled__2024-06-28T00:06:00+00:00, run_start_date=2024-06-28 00:08:00.272519+00:00, run_end_date=2024-06-28 00:08:01.898211+00:00, run_duration=1.625692, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:06:00+00:00, data_interval_end=2024-06-28 00:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:08:01.917861811Z [2024-06-28T00:08:01.913+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:08:00+00:00, run_after=2024-06-28T00:10:00+00:00 2024-06-28T00:08:03.124286605Z [2024-06-28T00:08:03.123+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:08:03.126082362Z [2024-06-28T00:08:03.125+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:07:00+00:00, run_id=scheduled__2024-06-28T00:07:00+00:00, run_start_date=2024-06-28 00:08:00.273683+00:00, run_end_date=2024-06-28 00:08:03.125710+00:00, run_duration=2.852027, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:07:00+00:00, data_interval_end=2024-06-28 00:08:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:08:03.139103485Z [2024-06-28T00:08:03.138+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:08:00+00:00, run_after=2024-06-28T00:09:00+00:00 2024-06-28T00:08:03.210493156Z [2024-06-28T00:08:03.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:06:00+00:00 exited with status success for try_number 1 2024-06-28T00:08:03.210594762Z [2024-06-28T00:08:03.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:07:00+00:00 exited with status success for try_number 1 2024-06-28T00:08:03.219104360Z [2024-06-28T00:08:03.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:06:00+00:00, map_index=-1, run_start_date=2024-06-28 00:08:01.340842+00:00, run_end_date=2024-06-28 00:08:01.832335+00:00, run_duration=0.491493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=428, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:08:00.362144+00:00, queued_by_job_id=2, pid=6283 2024-06-28T00:08:03.219379863Z [2024-06-28T00:08:03.219+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:07:00+00:00, map_index=-1, run_start_date=2024-06-28 00:08:01.610918+00:00, run_end_date=2024-06-28 00:08:02.113265+00:00, run_duration=0.502347, state=success, executor_state=success, try_number=1, max_tries=1, job_id=429, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:08:00.362144+00:00, queued_by_job_id=2, pid=6284 2024-06-28T00:08:05.477775002Z [2024-06-28T00:08:05.477+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:08:05.477953747Z [2024-06-28T00:08:05.477+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:07:00+00:00, run_id=scheduled__2024-06-28T00:07:00+00:00, run_start_date=2024-06-28 00:08:00.274647+00:00, run_end_date=2024-06-28 00:08:05.477696+00:00, run_duration=5.203049, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:07:00+00:00, data_interval_end=2024-06-28 00:08:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:08:05.487486597Z [2024-06-28T00:08:05.487+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:08:00+00:00, run_after=2024-06-28T00:09:00+00:00 2024-06-28T00:08:05.495022336Z [2024-06-28T00:08:05.493+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:08:05.495047700Z [2024-06-28T00:08:05.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:07:00+00:00, run_id=scheduled__2024-06-28T00:07:00+00:00, run_start_date=2024-06-28 00:08:00.275698+00:00, run_end_date=2024-06-28 00:08:05.493779+00:00, run_duration=5.218081, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:07:00+00:00, data_interval_end=2024-06-28 00:08:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:08:05.510835439Z [2024-06-28T00:08:05.508+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:08:00+00:00, run_after=2024-06-28T00:09:00+00:00 2024-06-28T00:08:05.604766667Z [2024-06-28T00:08:05.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:07:00+00:00 exited with status success for try_number 1 2024-06-28T00:08:05.604807966Z [2024-06-28T00:08:05.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:07:00+00:00 exited with status success for try_number 1 2024-06-28T00:08:05.611506005Z [2024-06-28T00:08:05.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:07:00+00:00, map_index=-1, run_start_date=2024-06-28 00:08:02.741518+00:00, run_end_date=2024-06-28 00:08:04.436101+00:00, run_duration=1.694583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=430, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:08:00.362144+00:00, queued_by_job_id=2, pid=6307 2024-06-28T00:08:05.611681553Z [2024-06-28T00:08:05.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:07:00+00:00, map_index=-1, run_start_date=2024-06-28 00:08:02.898030+00:00, run_end_date=2024-06-28 00:08:05.176379+00:00, run_duration=2.278349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=431, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:08:00.362144+00:00, queued_by_job_id=2, pid=6308 2024-06-28T00:09:00.907785134Z [2024-06-28T00:09:00.907+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:09:00+00:00, run_after=2024-06-28T00:10:00+00:00 2024-06-28T00:09:00.924761330Z [2024-06-28T00:09:00.924+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:09:00+00:00, run_after=2024-06-28T00:10:00+00:00 2024-06-28T00:09:00.932888941Z [2024-06-28T00:09:00.932+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:09:01.025250008Z [2024-06-28T00:09:01.024+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:09:01.025293682Z 2024-06-28T00:09:01.025303590Z 2024-06-28T00:09:01.025319030Z 2024-06-28T00:09:01.025372885Z [2024-06-28T00:09:01.024+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:09:01.025490941Z [2024-06-28T00:09:01.024+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:09:01.025581500Z [2024-06-28T00:09:01.024+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:09:01.026787053Z [2024-06-28T00:09:01.026+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:09:01.026811031Z 2024-06-28T00:09:01.026820140Z 2024-06-28T00:09:01.026828539Z 2024-06-28T00:09:01.036505356Z [2024-06-28T00:09:01.036+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:09:01.036720365Z [2024-06-28T00:09:01.036+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:09:01.036988946Z [2024-06-28T00:09:01.036+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:09:01.038040769Z [2024-06-28T00:09:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:09:01.038308988Z [2024-06-28T00:09:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:09:01.038480555Z [2024-06-28T00:09:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:09:01.375782815Z [2024-06-28T00:09:01.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:08:00+00:00 exited with status queued for try_number 1 2024-06-28T00:09:01.375987847Z [2024-06-28T00:09:01.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:08:00+00:00 exited with status queued for try_number 1 2024-06-28T00:09:01.376174877Z [2024-06-28T00:09:01.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:08:00+00:00 exited with status queued for try_number 1 2024-06-28T00:09:01.395228621Z [2024-06-28T00:09:01.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18aec6e9-2f45-4fed-8ea0-aaf4d8581d51 2024-06-28T00:09:01.395608608Z [2024-06-28T00:09:01.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fd9541d-cd0f-402e-87d3-fcd5fbc6434c 2024-06-28T00:09:01.395975971Z [2024-06-28T00:09:01.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc32d3b4-3d11-4c6d-919a-7f1072523beb 2024-06-28T00:09:02.621840468Z [2024-06-28T00:09:02.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:09:02.622141784Z [2024-06-28T00:09:02.621+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:08:00+00:00, run_id=scheduled__2024-06-28T00:08:00+00:00, run_start_date=2024-06-28 00:09:00.958490+00:00, run_end_date=2024-06-28 00:09:02.621813+00:00, run_duration=1.663323, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:08:00+00:00, data_interval_end=2024-06-28 00:09:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:09:02.633173427Z [2024-06-28T00:09:02.632+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:09:00+00:00, run_after=2024-06-28T00:10:00+00:00 2024-06-28T00:09:02.678877481Z [2024-06-28T00:09:02.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:08:00+00:00 exited with status success for try_number 1 2024-06-28T00:09:02.686150968Z [2024-06-28T00:09:02.685+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:08:00+00:00, map_index=-1, run_start_date=2024-06-28 00:09:01.973652+00:00, run_end_date=2024-06-28 00:09:02.397656+00:00, run_duration=0.424004, state=success, executor_state=success, try_number=1, max_tries=1, job_id=432, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:09:01.027969+00:00, queued_by_job_id=2, pid=6339 2024-06-28T00:09:04.985477714Z [2024-06-28T00:09:04.985+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:09:04.985688712Z [2024-06-28T00:09:04.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:08:00+00:00, run_id=scheduled__2024-06-28T00:08:00+00:00, run_start_date=2024-06-28 00:09:00.960058+00:00, run_end_date=2024-06-28 00:09:04.985392+00:00, run_duration=4.025334, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:08:00+00:00, data_interval_end=2024-06-28 00:09:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:09:04.993605883Z [2024-06-28T00:09:04.993+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:09:00+00:00, run_after=2024-06-28T00:10:00+00:00 2024-06-28T00:09:05.059767236Z [2024-06-28T00:09:05.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:08:00+00:00 exited with status success for try_number 1 2024-06-28T00:09:05.068445920Z [2024-06-28T00:09:05.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:08:00+00:00, map_index=-1, run_start_date=2024-06-28 00:09:03.011453+00:00, run_end_date=2024-06-28 00:09:04.810042+00:00, run_duration=1.798589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=434, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:09:01.027969+00:00, queued_by_job_id=2, pid=6358 2024-06-28T00:09:06.123727566Z [2024-06-28T00:09:06.123+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:09:06.124108007Z [2024-06-28T00:09:06.123+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:08:00+00:00, run_id=scheduled__2024-06-28T00:08:00+00:00, run_start_date=2024-06-28 00:09:00.961958+00:00, run_end_date=2024-06-28 00:09:06.123684+00:00, run_duration=5.161726, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:08:00+00:00, data_interval_end=2024-06-28 00:09:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:09:06.132041314Z [2024-06-28T00:09:06.131+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:09:00+00:00, run_after=2024-06-28T00:10:00+00:00 2024-06-28T00:09:06.171734928Z [2024-06-28T00:09:06.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:08:00+00:00 exited with status success for try_number 1 2024-06-28T00:09:06.177363167Z [2024-06-28T00:09:06.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:08:00+00:00, map_index=-1, run_start_date=2024-06-28 00:09:02.981371+00:00, run_end_date=2024-06-28 00:09:05.121997+00:00, run_duration=2.140626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=433, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:09:01.027969+00:00, queued_by_job_id=2, pid=6357 2024-06-28T00:10:00.691849726Z [2024-06-28T00:10:00.690+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:10:00+00:00, run_after=2024-06-28T00:15:00+00:00 2024-06-28T00:10:00.708172332Z [2024-06-28T00:10:00.707+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:10:00+00:00, run_after=2024-06-28T00:11:00+00:00 2024-06-28T00:10:00.715453858Z [2024-06-28T00:10:00.715+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:10:00.722148516Z [2024-06-28T00:10:00.721+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:10:00.735317616Z [2024-06-28T00:10:00.734+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:10:00+00:00, run_after=2024-06-28T00:11:00+00:00 2024-06-28T00:10:00.852574242Z [2024-06-28T00:10:00.852+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-28T00:10:00.852618180Z 2024-06-28T00:10:00.852623328Z 2024-06-28T00:10:00.852628405Z 2024-06-28T00:10:00.852632660Z 2024-06-28T00:10:00.852637276Z 2024-06-28T00:10:00.852650098Z [2024-06-28T00:10:00.852+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:10:00.852821100Z [2024-06-28T00:10:00.852+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:10:00.852949863Z [2024-06-28T00:10:00.852+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:10:00.853084997Z [2024-06-28T00:10:00.852+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:10:00.853205973Z [2024-06-28T00:10:00.853+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:10:00.853895927Z [2024-06-28T00:10:00.853+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:10:00.853902822Z 2024-06-28T00:10:00.853907904Z 2024-06-28T00:10:00.853912108Z 2024-06-28T00:10:00.853916341Z 2024-06-28T00:10:00.853920840Z 2024-06-28T00:10:00.860653184Z [2024-06-28T00:10:00.860+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T00:10:00.860926858Z [2024-06-28T00:10:00.860+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:10:00.861447512Z [2024-06-28T00:10:00.861+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:10:00.861667861Z [2024-06-28T00:10:00.861+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:10:00.862065471Z [2024-06-28T00:10:00.861+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:10:00.862288216Z [2024-06-28T00:10:00.862+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:10:00.862789288Z [2024-06-28T00:10:00.862+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:10:00.863037073Z [2024-06-28T00:10:00.862+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:10:00.863404308Z [2024-06-28T00:10:00.863+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:10:00.863591494Z [2024-06-28T00:10:00.863+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:10:01.365763609Z [2024-06-28T00:10:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:05:00+00:00 exited with status queued for try_number 1 2024-06-28T00:10:01.367006169Z [2024-06-28T00:10:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:08:00+00:00 exited with status queued for try_number 1 2024-06-28T00:10:01.367508914Z [2024-06-28T00:10:01.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:09:00+00:00 exited with status queued for try_number 1 2024-06-28T00:10:01.368570702Z [2024-06-28T00:10:01.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:09:00+00:00 exited with status queued for try_number 1 2024-06-28T00:10:01.368689367Z [2024-06-28T00:10:01.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:09:00+00:00 exited with status queued for try_number 1 2024-06-28T00:10:01.423795399Z [2024-06-28T00:10:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59126ecd-146b-46ec-9aa7-d59b4f7624ef 2024-06-28T00:10:01.423837798Z [2024-06-28T00:10:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e23a2eb-7a1c-4867-855c-add7901b8124 2024-06-28T00:10:01.423958861Z [2024-06-28T00:10:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3fa944e6-8103-4554-b299-6cecc35e6036 2024-06-28T00:10:01.424055838Z [2024-06-28T00:10:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa3289a3-04a1-4aab-a14a-c06051176045 2024-06-28T00:10:01.424140924Z [2024-06-28T00:10:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to e295bf10-7e62-4eb6-9b6d-d06c970a9a07 2024-06-28T00:10:02.822115845Z [2024-06-28T00:10:02.821+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:10:02.823079012Z [2024-06-28T00:10:02.822+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:08:00+00:00, run_id=scheduled__2024-06-28T00:08:00+00:00, run_start_date=2024-06-28 00:10:00.749116+00:00, run_end_date=2024-06-28 00:10:02.822120+00:00, run_duration=2.073004, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:08:00+00:00, data_interval_end=2024-06-28 00:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:10:02.839236125Z [2024-06-28T00:10:02.838+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:10:00+00:00, run_after=2024-06-28T00:12:00+00:00 2024-06-28T00:10:02.944192745Z [2024-06-28T00:10:02.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:08:00+00:00 exited with status success for try_number 1 2024-06-28T00:10:02.957349592Z [2024-06-28T00:10:02.956+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:08:00+00:00, map_index=-1, run_start_date=2024-06-28 00:10:01.957989+00:00, run_end_date=2024-06-28 00:10:02.391938+00:00, run_duration=0.433949, state=success, executor_state=success, try_number=1, max_tries=1, job_id=435, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:10:00.856491+00:00, queued_by_job_id=2, pid=6387 2024-06-28T00:10:03.617489097Z [2024-06-28T00:10:03.617+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:10:03.617722250Z [2024-06-28T00:10:03.617+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:09:00+00:00, run_id=scheduled__2024-06-28T00:09:00+00:00, run_start_date=2024-06-28 00:10:00.750158+00:00, run_end_date=2024-06-28 00:10:03.617420+00:00, run_duration=2.867262, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:09:00+00:00, data_interval_end=2024-06-28 00:10:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:10:03.636042113Z [2024-06-28T00:10:03.635+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:10:00+00:00, run_after=2024-06-28T00:11:00+00:00 2024-06-28T00:10:03.767911610Z [2024-06-28T00:10:03.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:09:00+00:00 exited with status success for try_number 1 2024-06-28T00:10:03.774227640Z [2024-06-28T00:10:03.773+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:09:00+00:00, map_index=-1, run_start_date=2024-06-28 00:10:02.377776+00:00, run_end_date=2024-06-28 00:10:02.885716+00:00, run_duration=0.50794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=436, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:10:00.856491+00:00, queued_by_job_id=2, pid=6398 2024-06-28T00:10:04.930130660Z [2024-06-28T00:10:04.929+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:10:04.930139771Z 2024-06-28T00:10:04.930229651Z [2024-06-28T00:10:04.930+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:10:04.930885083Z [2024-06-28T00:10:04.930+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:10:04.930893655Z 2024-06-28T00:10:04.933032197Z [2024-06-28T00:10:04.932+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T00:10:04.933176676Z [2024-06-28T00:10:04.932+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:10:05.011883643Z [2024-06-28T00:10:05.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:05:00+00:00 exited with status queued for try_number 1 2024-06-28T00:10:05.011958704Z [2024-06-28T00:10:05.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:05:00+00:00 exited with status success for try_number 1 2024-06-28T00:10:05.018080779Z [2024-06-28T00:10:05.017+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8f7ab2b-0f7d-4c47-9c8d-16f8a2013844 2024-06-28T00:10:05.018290371Z [2024-06-28T00:10:05.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T00:05:00+00:00, map_index=-1, run_start_date=2024-06-28 00:10:03.934903+00:00, run_end_date=2024-06-28 00:10:04.655869+00:00, run_duration=0.720966, state=success, executor_state=success, try_number=1, max_tries=1, job_id=439, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:10:00.856491+00:00, queued_by_job_id=2, pid=6427 2024-06-28T00:10:06.338320718Z [2024-06-28T00:10:06.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:10:06.338815310Z [2024-06-28T00:10:06.338+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:09:00+00:00, run_id=scheduled__2024-06-28T00:09:00+00:00, run_start_date=2024-06-28 00:10:00.751167+00:00, run_end_date=2024-06-28 00:10:06.338231+00:00, run_duration=5.587064, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:09:00+00:00, data_interval_end=2024-06-28 00:10:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:10:06.348363594Z [2024-06-28T00:10:06.348+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:10:00+00:00, run_after=2024-06-28T00:11:00+00:00 2024-06-28T00:10:06.355174453Z [2024-06-28T00:10:06.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:10:06.355526607Z [2024-06-28T00:10:06.355+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:09:00+00:00, run_id=scheduled__2024-06-28T00:09:00+00:00, run_start_date=2024-06-28 00:10:00.752065+00:00, run_end_date=2024-06-28 00:10:06.355079+00:00, run_duration=5.603014, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:09:00+00:00, data_interval_end=2024-06-28 00:10:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:10:06.364719947Z [2024-06-28T00:10:06.364+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:10:00+00:00, run_after=2024-06-28T00:11:00+00:00 2024-06-28T00:10:06.431467754Z [2024-06-28T00:10:06.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:09:00+00:00 exited with status success for try_number 1 2024-06-28T00:10:06.431496272Z [2024-06-28T00:10:06.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:09:00+00:00 exited with status success for try_number 1 2024-06-28T00:10:06.440703029Z [2024-06-28T00:10:06.438+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:09:00+00:00, map_index=-1, run_start_date=2024-06-28 00:10:03.495031+00:00, run_end_date=2024-06-28 00:10:05.336815+00:00, run_duration=1.841784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=437, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:10:00.856491+00:00, queued_by_job_id=2, pid=6412 2024-06-28T00:10:06.440721179Z [2024-06-28T00:10:06.439+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:09:00+00:00, map_index=-1, run_start_date=2024-06-28 00:10:03.916321+00:00, run_end_date=2024-06-28 00:10:06.007895+00:00, run_duration=2.091574, state=success, executor_state=success, try_number=1, max_tries=1, job_id=438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:10:00.856491+00:00, queued_by_job_id=2, pid=6423 2024-06-28T00:10:08.223070443Z [2024-06-28T00:10:08.222+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:10:08.223099341Z 2024-06-28T00:10:08.223234839Z [2024-06-28T00:10:08.223+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:10:08.223975512Z [2024-06-28T00:10:08.223+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:10:08.223982631Z 2024-06-28T00:10:08.227264272Z [2024-06-28T00:10:08.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T00:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T00:10:08.227569221Z [2024-06-28T00:10:08.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T00:10:08.302050470Z [2024-06-28T00:10:08.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:05:00+00:00 exited with status queued for try_number 1 2024-06-28T00:10:08.302191669Z [2024-06-28T00:10:08.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:05:00+00:00 exited with status success for try_number 1 2024-06-28T00:10:08.309690450Z [2024-06-28T00:10:08.309+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53af901e-4d15-4aa8-be9a-d8118b7fd60b 2024-06-28T00:10:08.309829627Z [2024-06-28T00:10:08.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T00:05:00+00:00, map_index=-1, run_start_date=2024-06-28 00:10:07.273664+00:00, run_end_date=2024-06-28 00:10:07.644444+00:00, run_duration=0.37078, state=success, executor_state=success, try_number=1, max_tries=1, job_id=440, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:10:04.931234+00:00, queued_by_job_id=2, pid=6447 2024-06-28T00:10:11.095178790Z [2024-06-28T00:10:11.094+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:10:11.095202503Z 2024-06-28T00:10:11.095357900Z [2024-06-28T00:10:11.095+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:10:11.096096781Z [2024-06-28T00:10:11.095+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:10:11.096107026Z 2024-06-28T00:10:11.102182597Z [2024-06-28T00:10:11.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:10:11.102499187Z [2024-06-28T00:10:11.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:10:11.158443553Z [2024-06-28T00:10:11.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:05:00+00:00 exited with status queued for try_number 1 2024-06-28T00:10:11.158506545Z [2024-06-28T00:10:11.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:05:00+00:00 exited with status success for try_number 1 2024-06-28T00:10:11.166634544Z [2024-06-28T00:10:11.166+0000] {scheduler_job.py:635} INFO - Setting external_id for to d86de2dd-8330-4371-bfc9-fb22278357c1 2024-06-28T00:10:11.167128944Z [2024-06-28T00:10:11.166+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T00:05:00+00:00, map_index=0, run_start_date=2024-06-28 00:10:09.903864+00:00, run_end_date=2024-06-28 00:10:10.253301+00:00, run_duration=0.349437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=441, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:10:08.224439+00:00, queued_by_job_id=2, pid=6455 2024-06-28T00:10:13.436204088Z [2024-06-28T00:10:13.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:10:13.436789281Z [2024-06-28T00:10:13.436+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:05:00+00:00, run_id=scheduled__2024-06-28T00:05:00+00:00, run_start_date=2024-06-28 00:10:00.747574+00:00, run_end_date=2024-06-28 00:10:13.436332+00:00, run_duration=12.688758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:05:00+00:00, data_interval_end=2024-06-28 00:10:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T00:10:13.445096625Z [2024-06-28T00:10:13.444+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:10:00+00:00, run_after=2024-06-28T00:15:00+00:00 2024-06-28T00:10:13.972124779Z [2024-06-28T00:10:13.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:05:00+00:00 exited with status success for try_number 1 2024-06-28T00:10:13.977673319Z [2024-06-28T00:10:13.977+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T00:05:00+00:00, map_index=-1, run_start_date=2024-06-28 00:10:13.047879+00:00, run_end_date=2024-06-28 00:10:13.416960+00:00, run_duration=0.369081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=442, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:10:11.096769+00:00, queued_by_job_id=2, pid=6463 2024-06-28T00:11:00.673397482Z [2024-06-28T00:11:00.672+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:11:00.686863806Z [2024-06-28T00:11:00.686+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:11:00+00:00, run_after=2024-06-28T00:12:00+00:00 2024-06-28T00:11:00.700272409Z [2024-06-28T00:11:00.700+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:11:00+00:00, run_after=2024-06-28T00:12:00+00:00 2024-06-28T00:11:00.802903693Z [2024-06-28T00:11:00.802+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:11:00.802920536Z 2024-06-28T00:11:00.802924322Z 2024-06-28T00:11:00.802927781Z 2024-06-28T00:11:00.803290099Z [2024-06-28T00:11:00.802+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:11:00.803550108Z [2024-06-28T00:11:00.803+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:11:00.803928660Z [2024-06-28T00:11:00.803+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:11:00.804834191Z [2024-06-28T00:11:00.804+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:11:00.804849443Z 2024-06-28T00:11:00.804861802Z 2024-06-28T00:11:00.804865022Z 2024-06-28T00:11:00.808421062Z [2024-06-28T00:11:00.808+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:11:00.808692164Z [2024-06-28T00:11:00.808+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:11:00.809255677Z [2024-06-28T00:11:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:11:00.809407240Z [2024-06-28T00:11:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:11:00.809742510Z [2024-06-28T00:11:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:11:00.809922067Z [2024-06-28T00:11:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:11:01.119564828Z [2024-06-28T00:11:01.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:10:00+00:00 exited with status queued for try_number 1 2024-06-28T00:11:01.119717054Z [2024-06-28T00:11:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:10:00+00:00 exited with status queued for try_number 1 2024-06-28T00:11:01.119869277Z [2024-06-28T00:11:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:10:00+00:00 exited with status queued for try_number 1 2024-06-28T00:11:01.128359942Z [2024-06-28T00:11:01.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdcc20d0-4298-4daa-bc29-2fe8f395e0ac 2024-06-28T00:11:01.128570921Z [2024-06-28T00:11:01.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90732442-3648-4b35-ab50-7b28185e1e98 2024-06-28T00:11:01.128798075Z [2024-06-28T00:11:01.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to c36a5bd9-da57-455f-8712-6b58dd55e4ba 2024-06-28T00:11:04.400590797Z [2024-06-28T00:11:04.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:11:04.401648581Z [2024-06-28T00:11:04.401+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:10:00+00:00, run_id=scheduled__2024-06-28T00:10:00+00:00, run_start_date=2024-06-28 00:11:00.713768+00:00, run_end_date=2024-06-28 00:11:04.400508+00:00, run_duration=3.68674, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:10:00+00:00, data_interval_end=2024-06-28 00:11:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:11:04.423862762Z [2024-06-28T00:11:04.423+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:11:00+00:00, run_after=2024-06-28T00:12:00+00:00 2024-06-28T00:11:04.574955789Z [2024-06-28T00:11:04.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:10:00+00:00 exited with status success for try_number 1 2024-06-28T00:11:04.582938990Z [2024-06-28T00:11:04.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:10:00+00:00, map_index=-1, run_start_date=2024-06-28 00:11:02.190650+00:00, run_end_date=2024-06-28 00:11:03.332555+00:00, run_duration=1.141905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=443, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:11:00.805927+00:00, queued_by_job_id=2, pid=6486 2024-06-28T00:11:07.016530385Z [2024-06-28T00:11:07.016+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:11:07.017091660Z [2024-06-28T00:11:07.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:10:00+00:00, run_id=scheduled__2024-06-28T00:10:00+00:00, run_start_date=2024-06-28 00:11:00.726878+00:00, run_end_date=2024-06-28 00:11:07.016450+00:00, run_duration=6.289572, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:10:00+00:00, data_interval_end=2024-06-28 00:11:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:11:07.026339490Z [2024-06-28T00:11:07.026+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:11:00+00:00, run_after=2024-06-28T00:12:00+00:00 2024-06-28T00:11:07.032783873Z [2024-06-28T00:11:07.032+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:11:07.033187363Z [2024-06-28T00:11:07.032+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:10:00+00:00, run_id=scheduled__2024-06-28T00:10:00+00:00, run_start_date=2024-06-28 00:11:00.728945+00:00, run_end_date=2024-06-28 00:11:07.032710+00:00, run_duration=6.303765, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:10:00+00:00, data_interval_end=2024-06-28 00:11:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:11:07.042199028Z [2024-06-28T00:11:07.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:11:00+00:00, run_after=2024-06-28T00:12:00+00:00 2024-06-28T00:11:07.076385685Z [2024-06-28T00:11:07.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:10:00+00:00 exited with status success for try_number 1 2024-06-28T00:11:07.077343617Z [2024-06-28T00:11:07.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:10:00+00:00 exited with status success for try_number 1 2024-06-28T00:11:07.098314060Z [2024-06-28T00:11:07.097+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:10:00+00:00, map_index=-1, run_start_date=2024-06-28 00:11:04.133128+00:00, run_end_date=2024-06-28 00:11:06.419565+00:00, run_duration=2.286437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=445, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:11:00.805927+00:00, queued_by_job_id=2, pid=6505 2024-06-28T00:11:07.098731511Z [2024-06-28T00:11:07.098+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:10:00+00:00, map_index=-1, run_start_date=2024-06-28 00:11:03.961192+00:00, run_end_date=2024-06-28 00:11:06.015925+00:00, run_duration=2.054733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=444, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:11:00.805927+00:00, queued_by_job_id=2, pid=6504 2024-06-28T00:11:45.384766002Z [2024-06-28T00:11:45.384+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T00:12:00.173895856Z [2024-06-28T00:12:00.173+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:12:00.207802197Z [2024-06-28T00:12:00.207+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:12:00+00:00, run_after=2024-06-28T00:13:00+00:00 2024-06-28T00:12:00.220966275Z [2024-06-28T00:12:00.220+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:12:00.235364456Z [2024-06-28T00:12:00.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:12:00+00:00, run_after=2024-06-28T00:13:00+00:00 2024-06-28T00:12:00.350447315Z [2024-06-28T00:12:00.349+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:12:00.350471103Z 2024-06-28T00:12:00.350475798Z 2024-06-28T00:12:00.350478916Z 2024-06-28T00:12:00.350482168Z 2024-06-28T00:12:00.350870835Z [2024-06-28T00:12:00.350+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:12:00.352115539Z [2024-06-28T00:12:00.351+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:12:00.352730403Z [2024-06-28T00:12:00.352+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:12:00.353230098Z [2024-06-28T00:12:00.352+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:12:00.359323709Z [2024-06-28T00:12:00.357+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:12:00.359347692Z 2024-06-28T00:12:00.359354699Z 2024-06-28T00:12:00.359360256Z 2024-06-28T00:12:00.359365990Z 2024-06-28T00:12:00.370369561Z [2024-06-28T00:12:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:12:00.370849019Z [2024-06-28T00:12:00.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:12:00.371311603Z [2024-06-28T00:12:00.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:12:00.371536695Z [2024-06-28T00:12:00.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:12:00.371939830Z [2024-06-28T00:12:00.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:12:00.372179425Z [2024-06-28T00:12:00.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:12:00.372592034Z [2024-06-28T00:12:00.372+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:12:00.372947661Z [2024-06-28T00:12:00.372+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:12:00.851251377Z [2024-06-28T00:12:00.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:10:00+00:00 exited with status queued for try_number 1 2024-06-28T00:12:00.851446464Z [2024-06-28T00:12:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:11:00+00:00 exited with status queued for try_number 1 2024-06-28T00:12:00.851587376Z [2024-06-28T00:12:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:11:00+00:00 exited with status queued for try_number 1 2024-06-28T00:12:00.852511217Z [2024-06-28T00:12:00.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:11:00+00:00 exited with status queued for try_number 1 2024-06-28T00:12:00.876714779Z [2024-06-28T00:12:00.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0fc5931f-b123-4dc7-8b98-69bb19cdae04 2024-06-28T00:12:00.877327590Z [2024-06-28T00:12:00.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to a99c2b41-0077-4626-9123-19f06cb60db0 2024-06-28T00:12:00.879393020Z [2024-06-28T00:12:00.878+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c67acbf-eca7-46a3-8744-24b9aadd9134 2024-06-28T00:12:00.879641380Z [2024-06-28T00:12:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69df11f8-bea4-434c-80a9-4d62083c638f 2024-06-28T00:12:02.215625305Z [2024-06-28T00:12:02.215+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:12:02.216044086Z [2024-06-28T00:12:02.215+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:10:00+00:00, run_id=scheduled__2024-06-28T00:10:00+00:00, run_start_date=2024-06-28 00:12:00.257223+00:00, run_end_date=2024-06-28 00:12:02.215611+00:00, run_duration=1.958388, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:10:00+00:00, data_interval_end=2024-06-28 00:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:12:02.222739025Z [2024-06-28T00:12:02.222+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:12:00+00:00, run_after=2024-06-28T00:14:00+00:00 2024-06-28T00:12:02.229541588Z [2024-06-28T00:12:02.229+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:12:02.229858241Z [2024-06-28T00:12:02.229+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:11:00+00:00, run_id=scheduled__2024-06-28T00:11:00+00:00, run_start_date=2024-06-28 00:12:00.259444+00:00, run_end_date=2024-06-28 00:12:02.229572+00:00, run_duration=1.970128, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:11:00+00:00, data_interval_end=2024-06-28 00:12:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:12:02.241929945Z [2024-06-28T00:12:02.241+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:12:00+00:00, run_after=2024-06-28T00:13:00+00:00 2024-06-28T00:12:02.311350812Z [2024-06-28T00:12:02.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:10:00+00:00 exited with status success for try_number 1 2024-06-28T00:12:02.311644626Z [2024-06-28T00:12:02.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:11:00+00:00 exited with status success for try_number 1 2024-06-28T00:12:02.317958239Z [2024-06-28T00:12:02.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:10:00+00:00, map_index=-1, run_start_date=2024-06-28 00:12:01.372334+00:00, run_end_date=2024-06-28 00:12:02.061742+00:00, run_duration=0.689408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=447, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:12:00.364650+00:00, queued_by_job_id=2, pid=6539 2024-06-28T00:12:02.318285369Z [2024-06-28T00:12:02.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:11:00+00:00, map_index=-1, run_start_date=2024-06-28 00:12:01.354163+00:00, run_end_date=2024-06-28 00:12:01.935058+00:00, run_duration=0.580895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=446, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:12:00.364650+00:00, queued_by_job_id=2, pid=6538 2024-06-28T00:12:05.657811160Z [2024-06-28T00:12:05.657+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:12:05.658184928Z [2024-06-28T00:12:05.657+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:11:00+00:00, run_id=scheduled__2024-06-28T00:11:00+00:00, run_start_date=2024-06-28 00:12:00.263177+00:00, run_end_date=2024-06-28 00:12:05.657723+00:00, run_duration=5.394546, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:11:00+00:00, data_interval_end=2024-06-28 00:12:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:12:05.667756927Z [2024-06-28T00:12:05.667+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:12:00+00:00, run_after=2024-06-28T00:13:00+00:00 2024-06-28T00:12:05.675559403Z [2024-06-28T00:12:05.675+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:12:05.676019716Z [2024-06-28T00:12:05.675+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:11:00+00:00, run_id=scheduled__2024-06-28T00:11:00+00:00, run_start_date=2024-06-28 00:12:00.261820+00:00, run_end_date=2024-06-28 00:12:05.675558+00:00, run_duration=5.413738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:11:00+00:00, data_interval_end=2024-06-28 00:12:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:12:05.686072513Z [2024-06-28T00:12:05.685+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:12:00+00:00, run_after=2024-06-28T00:13:00+00:00 2024-06-28T00:12:05.719294482Z [2024-06-28T00:12:05.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:11:00+00:00 exited with status success for try_number 1 2024-06-28T00:12:05.719402100Z [2024-06-28T00:12:05.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:11:00+00:00 exited with status success for try_number 1 2024-06-28T00:12:05.724924913Z [2024-06-28T00:12:05.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:11:00+00:00, map_index=-1, run_start_date=2024-06-28 00:12:03.435464+00:00, run_end_date=2024-06-28 00:12:05.399649+00:00, run_duration=1.964185, state=success, executor_state=success, try_number=1, max_tries=1, job_id=449, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:12:00.364650+00:00, queued_by_job_id=2, pid=6563 2024-06-28T00:12:05.725140177Z [2024-06-28T00:12:05.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:11:00+00:00, map_index=-1, run_start_date=2024-06-28 00:12:03.224432+00:00, run_end_date=2024-06-28 00:12:04.815835+00:00, run_duration=1.591403, state=success, executor_state=success, try_number=1, max_tries=1, job_id=448, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:12:00.364650+00:00, queued_by_job_id=2, pid=6562 2024-06-28T00:13:00.627027521Z [2024-06-28T00:13:00.626+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:13:00.640485307Z [2024-06-28T00:13:00.640+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:13:00+00:00, run_after=2024-06-28T00:14:00+00:00 2024-06-28T00:13:00.662317209Z [2024-06-28T00:13:00.662+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:13:00+00:00, run_after=2024-06-28T00:14:00+00:00 2024-06-28T00:13:00.724611606Z [2024-06-28T00:13:00.724+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:13:00.724640351Z 2024-06-28T00:13:00.724644100Z 2024-06-28T00:13:00.724647743Z 2024-06-28T00:13:00.724806085Z [2024-06-28T00:13:00.724+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:13:00.724940505Z [2024-06-28T00:13:00.724+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:13:00.725069137Z [2024-06-28T00:13:00.724+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:13:00.725744458Z [2024-06-28T00:13:00.725+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:13:00.725788439Z 2024-06-28T00:13:00.725796954Z 2024-06-28T00:13:00.725803779Z 2024-06-28T00:13:00.728853943Z [2024-06-28T00:13:00.728+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:13:00.728993912Z [2024-06-28T00:13:00.728+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:13:00.729258346Z [2024-06-28T00:13:00.729+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:13:00.729352336Z [2024-06-28T00:13:00.729+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:13:00.729595506Z [2024-06-28T00:13:00.729+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:13:00.729697168Z [2024-06-28T00:13:00.729+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:13:01.186905185Z [2024-06-28T00:13:01.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:12:00+00:00 exited with status queued for try_number 1 2024-06-28T00:13:01.187145082Z [2024-06-28T00:13:01.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:12:00+00:00 exited with status queued for try_number 1 2024-06-28T00:13:01.187267149Z [2024-06-28T00:13:01.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:12:00+00:00 exited with status queued for try_number 1 2024-06-28T00:13:01.197156847Z [2024-06-28T00:13:01.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2772b05d-902d-412f-acf1-3f6e16a424ff 2024-06-28T00:13:01.197730882Z [2024-06-28T00:13:01.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9468224c-f2e0-455a-bfa3-dc2c11631de0 2024-06-28T00:13:01.197941596Z [2024-06-28T00:13:01.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c53708d-5497-4af7-a310-602cd3ed84e0 2024-06-28T00:13:02.537252218Z [2024-06-28T00:13:02.536+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:13:02.539121612Z [2024-06-28T00:13:02.537+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:12:00+00:00, run_id=scheduled__2024-06-28T00:12:00+00:00, run_start_date=2024-06-28 00:13:00.673838+00:00, run_end_date=2024-06-28 00:13:02.537192+00:00, run_duration=1.863354, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:12:00+00:00, data_interval_end=2024-06-28 00:13:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:13:02.554739428Z [2024-06-28T00:13:02.554+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:13:00+00:00, run_after=2024-06-28T00:14:00+00:00 2024-06-28T00:13:02.616933995Z [2024-06-28T00:13:02.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:12:00+00:00 exited with status success for try_number 1 2024-06-28T00:13:02.626515801Z [2024-06-28T00:13:02.626+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:12:00+00:00, map_index=-1, run_start_date=2024-06-28 00:13:01.789804+00:00, run_end_date=2024-06-28 00:13:02.237141+00:00, run_duration=0.447337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=450, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:13:00.726405+00:00, queued_by_job_id=2, pid=6596 2024-06-28T00:13:04.781692898Z [2024-06-28T00:13:04.781+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:13:04.782202693Z [2024-06-28T00:13:04.781+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:12:00+00:00, run_id=scheduled__2024-06-28T00:12:00+00:00, run_start_date=2024-06-28 00:13:00.676283+00:00, run_end_date=2024-06-28 00:13:04.781854+00:00, run_duration=4.105571, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:12:00+00:00, data_interval_end=2024-06-28 00:13:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:13:04.791019329Z [2024-06-28T00:13:04.790+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:13:00+00:00, run_after=2024-06-28T00:14:00+00:00 2024-06-28T00:13:04.798784050Z [2024-06-28T00:13:04.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:13:04.798812632Z [2024-06-28T00:13:04.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:12:00+00:00, run_id=scheduled__2024-06-28T00:12:00+00:00, run_start_date=2024-06-28 00:13:00.675221+00:00, run_end_date=2024-06-28 00:13:04.798253+00:00, run_duration=4.123032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:12:00+00:00, data_interval_end=2024-06-28 00:13:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:13:04.811872657Z [2024-06-28T00:13:04.811+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:13:00+00:00, run_after=2024-06-28T00:14:00+00:00 2024-06-28T00:13:04.865094561Z [2024-06-28T00:13:04.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:12:00+00:00 exited with status success for try_number 1 2024-06-28T00:13:04.865282583Z [2024-06-28T00:13:04.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:12:00+00:00 exited with status success for try_number 1 2024-06-28T00:13:04.875817857Z [2024-06-28T00:13:04.875+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:12:00+00:00, map_index=-1, run_start_date=2024-06-28 00:13:02.769393+00:00, run_end_date=2024-06-28 00:13:04.615362+00:00, run_duration=1.845969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=452, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:13:00.726405+00:00, queued_by_job_id=2, pid=6615 2024-06-28T00:13:04.876131046Z [2024-06-28T00:13:04.875+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:12:00+00:00, map_index=-1, run_start_date=2024-06-28 00:13:02.732039+00:00, run_end_date=2024-06-28 00:13:04.125057+00:00, run_duration=1.393018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=451, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:13:00.726405+00:00, queued_by_job_id=2, pid=6614 2024-06-28T00:14:01.053780662Z [2024-06-28T00:14:01.053+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:14:00+00:00, run_after=2024-06-28T00:15:00+00:00 2024-06-28T00:14:01.061993230Z [2024-06-28T00:14:01.061+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:14:01.077500254Z [2024-06-28T00:14:01.077+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:14:00+00:00, run_after=2024-06-28T00:15:00+00:00 2024-06-28T00:14:01.086666755Z [2024-06-28T00:14:01.086+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:14:01.203780971Z [2024-06-28T00:14:01.203+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:14:01.203836018Z 2024-06-28T00:14:01.203852423Z 2024-06-28T00:14:01.203862610Z 2024-06-28T00:14:01.203871441Z 2024-06-28T00:14:01.203972095Z [2024-06-28T00:14:01.203+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:14:01.204220422Z [2024-06-28T00:14:01.203+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:14:01.204473936Z [2024-06-28T00:14:01.204+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:14:01.204698222Z [2024-06-28T00:14:01.204+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:14:01.205988337Z [2024-06-28T00:14:01.205+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:14:01.206012715Z 2024-06-28T00:14:01.206022341Z 2024-06-28T00:14:01.206031516Z 2024-06-28T00:14:01.206068221Z 2024-06-28T00:14:01.214122999Z [2024-06-28T00:14:01.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:14:01.214179570Z [2024-06-28T00:14:01.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:14:01.216285396Z [2024-06-28T00:14:01.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:14:01.216475934Z [2024-06-28T00:14:01.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:14:01.216851698Z [2024-06-28T00:14:01.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:14:01.217040492Z [2024-06-28T00:14:01.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:14:01.217363018Z [2024-06-28T00:14:01.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:14:01.217499034Z [2024-06-28T00:14:01.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:14:01.781462602Z [2024-06-28T00:14:01.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:12:00+00:00 exited with status queued for try_number 1 2024-06-28T00:14:01.782160153Z [2024-06-28T00:14:01.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:13:00+00:00 exited with status queued for try_number 1 2024-06-28T00:14:01.782353331Z [2024-06-28T00:14:01.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:13:00+00:00 exited with status queued for try_number 1 2024-06-28T00:14:01.782512646Z [2024-06-28T00:14:01.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:13:00+00:00 exited with status queued for try_number 1 2024-06-28T00:14:01.800305384Z [2024-06-28T00:14:01.799+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c94e780-30e7-4797-90bc-e81184946471 2024-06-28T00:14:01.800626509Z [2024-06-28T00:14:01.800+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5db318cf-2180-4902-8f0d-d4e465c9c72c 2024-06-28T00:14:01.800809279Z [2024-06-28T00:14:01.800+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8441462a-9c88-4a33-bd7f-786d849c3253 2024-06-28T00:14:01.800947689Z [2024-06-28T00:14:01.800+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c5f5e1a-94bd-4a57-b58e-5148fa59f9b6 2024-06-28T00:14:02.931897992Z [2024-06-28T00:14:02.931+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:14:02.932140803Z [2024-06-28T00:14:02.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:12:00+00:00, run_id=scheduled__2024-06-28T00:12:00+00:00, run_start_date=2024-06-28 00:14:01.106574+00:00, run_end_date=2024-06-28 00:14:02.931826+00:00, run_duration=1.825252, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:12:00+00:00, data_interval_end=2024-06-28 00:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:14:02.940004018Z [2024-06-28T00:14:02.939+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:14:00+00:00, run_after=2024-06-28T00:16:00+00:00 2024-06-28T00:14:03.042556110Z [2024-06-28T00:14:03.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:12:00+00:00 exited with status success for try_number 1 2024-06-28T00:14:03.051009244Z [2024-06-28T00:14:03.050+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:12:00+00:00, map_index=-1, run_start_date=2024-06-28 00:14:02.285500+00:00, run_end_date=2024-06-28 00:14:02.822036+00:00, run_duration=0.536536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=453, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:14:01.208085+00:00, queued_by_job_id=2, pid=6648 2024-06-28T00:14:04.278112849Z [2024-06-28T00:14:04.277+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:14:04.280464122Z [2024-06-28T00:14:04.279+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:13:00+00:00, run_id=scheduled__2024-06-28T00:13:00+00:00, run_start_date=2024-06-28 00:14:01.108046+00:00, run_end_date=2024-06-28 00:14:04.279669+00:00, run_duration=3.171623, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:13:00+00:00, data_interval_end=2024-06-28 00:14:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:14:04.313114905Z [2024-06-28T00:14:04.306+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:14:00+00:00, run_after=2024-06-28T00:15:00+00:00 2024-06-28T00:14:04.504582487Z [2024-06-28T00:14:04.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:13:00+00:00 exited with status success for try_number 1 2024-06-28T00:14:04.546520512Z [2024-06-28T00:14:04.543+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:13:00+00:00, map_index=-1, run_start_date=2024-06-28 00:14:02.379905+00:00, run_end_date=2024-06-28 00:14:03.012135+00:00, run_duration=0.63223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=454, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:14:01.208085+00:00, queued_by_job_id=2, pid=6649 2024-06-28T00:14:05.630785441Z [2024-06-28T00:14:05.630+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:14:05.630829598Z [2024-06-28T00:14:05.630+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:13:00+00:00, run_id=scheduled__2024-06-28T00:13:00+00:00, run_start_date=2024-06-28 00:14:01.109226+00:00, run_end_date=2024-06-28 00:14:05.630391+00:00, run_duration=4.521165, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:13:00+00:00, data_interval_end=2024-06-28 00:14:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:14:05.650811955Z [2024-06-28T00:14:05.650+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:14:00+00:00, run_after=2024-06-28T00:15:00+00:00 2024-06-28T00:14:05.694546237Z [2024-06-28T00:14:05.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:13:00+00:00 exited with status success for try_number 1 2024-06-28T00:14:05.715214367Z [2024-06-28T00:14:05.714+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:13:00+00:00, map_index=-1, run_start_date=2024-06-28 00:14:03.701957+00:00, run_end_date=2024-06-28 00:14:05.187096+00:00, run_duration=1.485139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=456, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:14:01.208085+00:00, queued_by_job_id=2, pid=6673 2024-06-28T00:14:06.765285744Z [2024-06-28T00:14:06.764+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:14:06.766636557Z [2024-06-28T00:14:06.765+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:13:00+00:00, run_id=scheduled__2024-06-28T00:13:00+00:00, run_start_date=2024-06-28 00:14:01.110367+00:00, run_end_date=2024-06-28 00:14:06.765213+00:00, run_duration=5.654846, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:13:00+00:00, data_interval_end=2024-06-28 00:14:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:14:06.776516731Z [2024-06-28T00:14:06.776+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:14:00+00:00, run_after=2024-06-28T00:15:00+00:00 2024-06-28T00:14:06.817476990Z [2024-06-28T00:14:06.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:13:00+00:00 exited with status success for try_number 1 2024-06-28T00:14:06.824038760Z [2024-06-28T00:14:06.823+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:13:00+00:00, map_index=-1, run_start_date=2024-06-28 00:14:03.660164+00:00, run_end_date=2024-06-28 00:14:05.605548+00:00, run_duration=1.945384, state=success, executor_state=success, try_number=1, max_tries=1, job_id=455, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:14:01.208085+00:00, queued_by_job_id=2, pid=6672 2024-06-28T00:15:00.457763627Z [2024-06-28T00:15:00.457+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:15:00+00:00, run_after=2024-06-28T00:16:00+00:00 2024-06-28T00:15:00.470328828Z [2024-06-28T00:15:00.469+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:15:00+00:00, run_after=2024-06-28T00:20:00+00:00 2024-06-28T00:15:00.498885750Z [2024-06-28T00:15:00.498+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:15:00+00:00, run_after=2024-06-28T00:16:00+00:00 2024-06-28T00:15:00.507033041Z [2024-06-28T00:15:00.506+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:15:00.603305492Z [2024-06-28T00:15:00.602+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:15:00.603332956Z 2024-06-28T00:15:00.603352614Z 2024-06-28T00:15:00.603361932Z 2024-06-28T00:15:00.603369975Z 2024-06-28T00:15:00.604061631Z [2024-06-28T00:15:00.603+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:15:00.604461710Z [2024-06-28T00:15:00.604+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:15:00.604794659Z [2024-06-28T00:15:00.604+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:15:00.605165330Z [2024-06-28T00:15:00.604+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:15:00.606432787Z [2024-06-28T00:15:00.605+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:15:00.606452605Z 2024-06-28T00:15:00.606461646Z 2024-06-28T00:15:00.606492401Z 2024-06-28T00:15:00.606500289Z 2024-06-28T00:15:00.617709990Z [2024-06-28T00:15:00.617+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T00:15:00.618033815Z [2024-06-28T00:15:00.617+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:15:00.618721277Z [2024-06-28T00:15:00.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:15:00.619138085Z [2024-06-28T00:15:00.618+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:15:00.619639629Z [2024-06-28T00:15:00.619+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:15:00.619959804Z [2024-06-28T00:15:00.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:15:00.620420666Z [2024-06-28T00:15:00.620+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:15:00.620674347Z [2024-06-28T00:15:00.620+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:15:01.089909870Z [2024-06-28T00:15:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:10:00+00:00 exited with status queued for try_number 1 2024-06-28T00:15:01.090069784Z [2024-06-28T00:15:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:14:00+00:00 exited with status queued for try_number 1 2024-06-28T00:15:01.090273697Z [2024-06-28T00:15:01.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:14:00+00:00 exited with status queued for try_number 1 2024-06-28T00:15:01.090419868Z [2024-06-28T00:15:01.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:14:00+00:00 exited with status queued for try_number 1 2024-06-28T00:15:01.100556969Z [2024-06-28T00:15:01.100+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6c4a522-0a7f-4c63-8824-4ab5c7e40fa0 2024-06-28T00:15:01.100754402Z [2024-06-28T00:15:01.100+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0eb78fce-15c9-48e1-85bd-2d98fdd04168 2024-06-28T00:15:01.100953178Z [2024-06-28T00:15:01.100+0000] {scheduler_job.py:635} INFO - Setting external_id for to f36ad8c7-ffcd-4672-a6b8-e402c2e04708 2024-06-28T00:15:01.101236647Z [2024-06-28T00:15:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2812d819-5385-4030-8970-ac8a2bff58fa 2024-06-28T00:15:03.363647872Z [2024-06-28T00:15:03.361+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:15:03.364105721Z [2024-06-28T00:15:03.363+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:14:00+00:00, run_id=scheduled__2024-06-28T00:14:00+00:00, run_start_date=2024-06-28 00:15:00.518736+00:00, run_end_date=2024-06-28 00:15:03.363726+00:00, run_duration=2.84499, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:14:00+00:00, data_interval_end=2024-06-28 00:15:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:15:03.381995987Z [2024-06-28T00:15:03.381+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:15:00+00:00, run_after=2024-06-28T00:16:00+00:00 2024-06-28T00:15:03.454427199Z [2024-06-28T00:15:03.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:14:00+00:00 exited with status success for try_number 1 2024-06-28T00:15:03.482132725Z [2024-06-28T00:15:03.479+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:14:00+00:00, map_index=-1, run_start_date=2024-06-28 00:15:01.875104+00:00, run_end_date=2024-06-28 00:15:02.464764+00:00, run_duration=0.58966, state=success, executor_state=success, try_number=1, max_tries=1, job_id=457, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:15:00.611792+00:00, queued_by_job_id=2, pid=6705 2024-06-28T00:15:05.278569374Z [2024-06-28T00:15:05.278+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:15:05.278824438Z [2024-06-28T00:15:05.278+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:14:00+00:00, run_id=scheduled__2024-06-28T00:14:00+00:00, run_start_date=2024-06-28 00:15:00.519816+00:00, run_end_date=2024-06-28 00:15:05.278436+00:00, run_duration=4.75862, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:14:00+00:00, data_interval_end=2024-06-28 00:15:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:15:05.289936264Z [2024-06-28T00:15:05.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:15:00+00:00, run_after=2024-06-28T00:16:00+00:00 2024-06-28T00:15:05.330337893Z [2024-06-28T00:15:05.330+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:15:05.330353226Z 2024-06-28T00:15:05.330534973Z [2024-06-28T00:15:05.330+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:15:05.332777010Z [2024-06-28T00:15:05.331+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:15:05.332790300Z 2024-06-28T00:15:05.339505970Z [2024-06-28T00:15:05.339+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T00:15:05.339561269Z [2024-06-28T00:15:05.339+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:15:05.432154880Z [2024-06-28T00:15:05.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:10:00+00:00 exited with status queued for try_number 1 2024-06-28T00:15:05.432173431Z [2024-06-28T00:15:05.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:10:00+00:00 exited with status success for try_number 1 2024-06-28T00:15:05.432274925Z [2024-06-28T00:15:05.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:14:00+00:00 exited with status success for try_number 1 2024-06-28T00:15:05.444844751Z [2024-06-28T00:15:05.444+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6414997-7832-453e-8612-e97a864ffe12 2024-06-28T00:15:05.444987781Z [2024-06-28T00:15:05.444+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T00:10:00+00:00, map_index=-1, run_start_date=2024-06-28 00:15:03.516762+00:00, run_end_date=2024-06-28 00:15:04.377342+00:00, run_duration=0.86058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=460, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:15:00.611792+00:00, queued_by_job_id=2, pid=6736 2024-06-28T00:15:05.445182958Z [2024-06-28T00:15:05.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:14:00+00:00, map_index=-1, run_start_date=2024-06-28 00:15:03.022122+00:00, run_end_date=2024-06-28 00:15:04.432736+00:00, run_duration=1.410614, state=success, executor_state=success, try_number=1, max_tries=1, job_id=458, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:15:00.611792+00:00, queued_by_job_id=2, pid=6724 2024-06-28T00:15:05.550828311Z [2024-06-28T00:15:05.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:15:05.550855665Z [2024-06-28T00:15:05.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:14:00+00:00, run_id=scheduled__2024-06-28T00:14:00+00:00, run_start_date=2024-06-28 00:15:00.520751+00:00, run_end_date=2024-06-28 00:15:05.548183+00:00, run_duration=5.027432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:14:00+00:00, data_interval_end=2024-06-28 00:15:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:15:05.567457769Z [2024-06-28T00:15:05.566+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:15:00+00:00, run_after=2024-06-28T00:16:00+00:00 2024-06-28T00:15:05.677903944Z [2024-06-28T00:15:05.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:14:00+00:00 exited with status success for try_number 1 2024-06-28T00:15:05.684841962Z [2024-06-28T00:15:05.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:14:00+00:00, map_index=-1, run_start_date=2024-06-28 00:15:03.222083+00:00, run_end_date=2024-06-28 00:15:05.320886+00:00, run_duration=2.098803, state=success, executor_state=success, try_number=1, max_tries=1, job_id=459, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:15:00.611792+00:00, queued_by_job_id=2, pid=6730 2024-06-28T00:15:08.997844222Z [2024-06-28T00:15:08.997+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:15:08.997870542Z 2024-06-28T00:15:08.997965211Z [2024-06-28T00:15:08.997+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:15:08.998772178Z [2024-06-28T00:15:08.998+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:15:08.998797243Z 2024-06-28T00:15:09.009577376Z [2024-06-28T00:15:09.009+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T00:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T00:15:09.009614340Z [2024-06-28T00:15:09.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T00:15:09.072306495Z [2024-06-28T00:15:09.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:10:00+00:00 exited with status queued for try_number 1 2024-06-28T00:15:09.072717737Z [2024-06-28T00:15:09.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:10:00+00:00 exited with status success for try_number 1 2024-06-28T00:15:09.079920817Z [2024-06-28T00:15:09.079+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7efad3b-89d0-4b73-99ba-308c5dba2245 2024-06-28T00:15:09.080216747Z [2024-06-28T00:15:09.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T00:10:00+00:00, map_index=-1, run_start_date=2024-06-28 00:15:07.686879+00:00, run_end_date=2024-06-28 00:15:08.149302+00:00, run_duration=0.462423, state=success, executor_state=success, try_number=1, max_tries=1, job_id=461, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:15:05.333237+00:00, queued_by_job_id=2, pid=6754 2024-06-28T00:15:12.307295468Z [2024-06-28T00:15:12.306+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:15:12.307322078Z 2024-06-28T00:15:12.307756275Z [2024-06-28T00:15:12.307+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:15:12.309195691Z [2024-06-28T00:15:12.308+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:15:12.309205305Z 2024-06-28T00:15:12.313486673Z [2024-06-28T00:15:12.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:15:12.313896016Z [2024-06-28T00:15:12.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:15:12.399639539Z [2024-06-28T00:15:12.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:10:00+00:00 exited with status queued for try_number 1 2024-06-28T00:15:12.399894861Z [2024-06-28T00:15:12.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:10:00+00:00 exited with status success for try_number 1 2024-06-28T00:15:12.413980174Z [2024-06-28T00:15:12.413+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3e3b250-d9c2-44bb-835a-c1717121f260 2024-06-28T00:15:12.414148745Z [2024-06-28T00:15:12.413+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T00:10:00+00:00, map_index=0, run_start_date=2024-06-28 00:15:10.857643+00:00, run_end_date=2024-06-28 00:15:11.181611+00:00, run_duration=0.323968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=462, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:15:08.999273+00:00, queued_by_job_id=2, pid=6762 2024-06-28T00:15:15.440209291Z [2024-06-28T00:15:15.439+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:15:15.440521982Z [2024-06-28T00:15:15.440+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:10:00+00:00, run_id=scheduled__2024-06-28T00:10:00+00:00, run_start_date=2024-06-28 00:15:00.517429+00:00, run_end_date=2024-06-28 00:15:15.440055+00:00, run_duration=14.922626, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:10:00+00:00, data_interval_end=2024-06-28 00:15:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T00:15:15.447007204Z [2024-06-28T00:15:15.446+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:15:00+00:00, run_after=2024-06-28T00:20:00+00:00 2024-06-28T00:15:15.483424960Z [2024-06-28T00:15:15.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:10:00+00:00 exited with status success for try_number 1 2024-06-28T00:15:15.499461111Z [2024-06-28T00:15:15.499+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T00:10:00+00:00, map_index=-1, run_start_date=2024-06-28 00:15:14.198678+00:00, run_end_date=2024-06-28 00:15:14.608221+00:00, run_duration=0.409543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=463, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:15:12.310138+00:00, queued_by_job_id=2, pid=6770 2024-06-28T00:16:00.136727834Z [2024-06-28T00:16:00.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:16:00+00:00, run_after=2024-06-28T00:17:00+00:00 2024-06-28T00:16:00.144752322Z [2024-06-28T00:16:00.144+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:16:00.159255847Z [2024-06-28T00:16:00.158+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:16:00+00:00, run_after=2024-06-28T00:17:00+00:00 2024-06-28T00:16:00.167728207Z [2024-06-28T00:16:00.167+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:16:00.259735631Z [2024-06-28T00:16:00.259+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:16:00.259746703Z 2024-06-28T00:16:00.259750881Z 2024-06-28T00:16:00.259754439Z 2024-06-28T00:16:00.259772443Z 2024-06-28T00:16:00.259956159Z [2024-06-28T00:16:00.259+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:16:00.260313500Z [2024-06-28T00:16:00.260+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:16:00.260558318Z [2024-06-28T00:16:00.260+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:16:00.261225985Z [2024-06-28T00:16:00.260+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:16:00.262909274Z [2024-06-28T00:16:00.262+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:16:00.262970399Z 2024-06-28T00:16:00.262981849Z 2024-06-28T00:16:00.262990321Z 2024-06-28T00:16:00.263031094Z 2024-06-28T00:16:00.268625504Z [2024-06-28T00:16:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:16:00.269274931Z [2024-06-28T00:16:00.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:16:00.269745203Z [2024-06-28T00:16:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:16:00.271044852Z [2024-06-28T00:16:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:16:00.271541440Z [2024-06-28T00:16:00.271+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:16:00.271796701Z [2024-06-28T00:16:00.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:16:00.272261184Z [2024-06-28T00:16:00.271+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:16:00.272506405Z [2024-06-28T00:16:00.272+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:16:00.684534467Z [2024-06-28T00:16:00.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:14:00+00:00 exited with status queued for try_number 1 2024-06-28T00:16:00.685838287Z [2024-06-28T00:16:00.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:15:00+00:00 exited with status queued for try_number 1 2024-06-28T00:16:00.686056693Z [2024-06-28T00:16:00.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:15:00+00:00 exited with status queued for try_number 1 2024-06-28T00:16:00.686212551Z [2024-06-28T00:16:00.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:15:00+00:00 exited with status queued for try_number 1 2024-06-28T00:16:00.708399545Z [2024-06-28T00:16:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8723065-5b62-44f0-a6ae-63399c80078c 2024-06-28T00:16:00.708679143Z [2024-06-28T00:16:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to d40a830a-bf64-4607-aec8-a4aad69338cb 2024-06-28T00:16:00.708910307Z [2024-06-28T00:16:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to 308f3b77-7801-470b-bddd-5084ddd1ec78 2024-06-28T00:16:00.710502016Z [2024-06-28T00:16:00.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a336807-e128-4180-8b89-3be917ebfbfc 2024-06-28T00:16:02.669008348Z [2024-06-28T00:16:02.668+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:16:02.669673749Z [2024-06-28T00:16:02.669+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:14:00+00:00, run_id=scheduled__2024-06-28T00:14:00+00:00, run_start_date=2024-06-28 00:16:00.178744+00:00, run_end_date=2024-06-28 00:16:02.668957+00:00, run_duration=2.490213, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:14:00+00:00, data_interval_end=2024-06-28 00:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:16:02.683126607Z [2024-06-28T00:16:02.682+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:16:00+00:00, run_after=2024-06-28T00:18:00+00:00 2024-06-28T00:16:02.691456097Z [2024-06-28T00:16:02.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:16:02.692519878Z [2024-06-28T00:16:02.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:15:00+00:00, run_id=scheduled__2024-06-28T00:15:00+00:00, run_start_date=2024-06-28 00:16:00.180034+00:00, run_end_date=2024-06-28 00:16:02.691385+00:00, run_duration=2.511351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:15:00+00:00, data_interval_end=2024-06-28 00:16:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:16:02.705445181Z [2024-06-28T00:16:02.705+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:16:00+00:00, run_after=2024-06-28T00:17:00+00:00 2024-06-28T00:16:02.771563494Z [2024-06-28T00:16:02.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:14:00+00:00 exited with status success for try_number 1 2024-06-28T00:16:02.771712134Z [2024-06-28T00:16:02.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:15:00+00:00 exited with status success for try_number 1 2024-06-28T00:16:02.777799481Z [2024-06-28T00:16:02.777+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:14:00+00:00, map_index=-1, run_start_date=2024-06-28 00:16:01.213504+00:00, run_end_date=2024-06-28 00:16:01.765760+00:00, run_duration=0.552256, state=success, executor_state=success, try_number=1, max_tries=1, job_id=464, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:16:00.264600+00:00, queued_by_job_id=2, pid=6788 2024-06-28T00:16:02.778173680Z [2024-06-28T00:16:02.777+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:15:00+00:00, map_index=-1, run_start_date=2024-06-28 00:16:01.791685+00:00, run_end_date=2024-06-28 00:16:02.214522+00:00, run_duration=0.422837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=465, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:16:00.264600+00:00, queued_by_job_id=2, pid=6800 2024-06-28T00:16:04.930112401Z [2024-06-28T00:16:04.929+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:16:04.930285872Z [2024-06-28T00:16:04.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:15:00+00:00, run_id=scheduled__2024-06-28T00:15:00+00:00, run_start_date=2024-06-28 00:16:00.181032+00:00, run_end_date=2024-06-28 00:16:04.930033+00:00, run_duration=4.749001, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:15:00+00:00, data_interval_end=2024-06-28 00:16:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:16:04.940923729Z [2024-06-28T00:16:04.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:16:00+00:00, run_after=2024-06-28T00:17:00+00:00 2024-06-28T00:16:05.024041428Z [2024-06-28T00:16:05.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:15:00+00:00 exited with status success for try_number 1 2024-06-28T00:16:05.044777437Z [2024-06-28T00:16:05.044+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:15:00+00:00, map_index=-1, run_start_date=2024-06-28 00:16:02.948015+00:00, run_end_date=2024-06-28 00:16:04.511333+00:00, run_duration=1.563318, state=success, executor_state=success, try_number=1, max_tries=1, job_id=467, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:16:00.264600+00:00, queued_by_job_id=2, pid=6818 2024-06-28T00:16:05.810172356Z [2024-06-28T00:16:05.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:16:05.810904897Z [2024-06-28T00:16:05.810+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:15:00+00:00, run_id=scheduled__2024-06-28T00:15:00+00:00, run_start_date=2024-06-28 00:16:00.181982+00:00, run_end_date=2024-06-28 00:16:05.809989+00:00, run_duration=5.628007, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:15:00+00:00, data_interval_end=2024-06-28 00:16:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:16:05.833452810Z [2024-06-28T00:16:05.825+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:16:00+00:00, run_after=2024-06-28T00:17:00+00:00 2024-06-28T00:16:05.877873223Z [2024-06-28T00:16:05.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:15:00+00:00 exited with status success for try_number 1 2024-06-28T00:16:05.882871687Z [2024-06-28T00:16:05.882+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:15:00+00:00, map_index=-1, run_start_date=2024-06-28 00:16:02.764473+00:00, run_end_date=2024-06-28 00:16:04.995837+00:00, run_duration=2.231364, state=success, executor_state=success, try_number=1, max_tries=1, job_id=466, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:16:00.264600+00:00, queued_by_job_id=2, pid=6817 2024-06-28T00:16:45.474561100Z [2024-06-28T00:16:45.474+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T00:17:00.938390376Z [2024-06-28T00:17:00.938+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:17:00.950453659Z [2024-06-28T00:17:00.950+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:17:00+00:00, run_after=2024-06-28T00:18:00+00:00 2024-06-28T00:17:00.961665017Z [2024-06-28T00:17:00.961+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:17:00+00:00, run_after=2024-06-28T00:18:00+00:00 2024-06-28T00:17:01.025645491Z [2024-06-28T00:17:01.025+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:17:01.025669935Z 2024-06-28T00:17:01.025674995Z 2024-06-28T00:17:01.025679836Z 2024-06-28T00:17:01.026217463Z [2024-06-28T00:17:01.025+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:17:01.026464808Z [2024-06-28T00:17:01.026+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:17:01.026665915Z [2024-06-28T00:17:01.026+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:17:01.027590662Z [2024-06-28T00:17:01.027+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:17:01.027647078Z 2024-06-28T00:17:01.027655674Z 2024-06-28T00:17:01.027662262Z 2024-06-28T00:17:01.033338687Z [2024-06-28T00:17:01.032+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:17:01.033582676Z [2024-06-28T00:17:01.033+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:17:01.033957302Z [2024-06-28T00:17:01.033+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:17:01.034150604Z [2024-06-28T00:17:01.033+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:17:01.034683063Z [2024-06-28T00:17:01.034+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:17:01.035144710Z [2024-06-28T00:17:01.034+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:17:01.283963398Z [2024-06-28T00:17:01.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:16:00+00:00 exited with status queued for try_number 1 2024-06-28T00:17:01.283987337Z [2024-06-28T00:17:01.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:16:00+00:00 exited with status queued for try_number 1 2024-06-28T00:17:01.284134102Z [2024-06-28T00:17:01.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:16:00+00:00 exited with status queued for try_number 1 2024-06-28T00:17:01.304288840Z [2024-06-28T00:17:01.303+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67c79a45-74c4-4230-a9a7-f089fb352694 2024-06-28T00:17:01.305597692Z [2024-06-28T00:17:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6887f9f0-b1be-4232-9d7e-2cf761950fb8 2024-06-28T00:17:01.305832825Z [2024-06-28T00:17:01.305+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79e18600-f338-4605-8711-50f190027cdb 2024-06-28T00:17:03.365392208Z [2024-06-28T00:17:03.364+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:17:03.365717549Z [2024-06-28T00:17:03.365+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:16:00+00:00, run_id=scheduled__2024-06-28T00:16:00+00:00, run_start_date=2024-06-28 00:17:00.970513+00:00, run_end_date=2024-06-28 00:17:03.365327+00:00, run_duration=2.394814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:16:00+00:00, data_interval_end=2024-06-28 00:17:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:17:03.398175418Z [2024-06-28T00:17:03.397+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:17:00+00:00, run_after=2024-06-28T00:18:00+00:00 2024-06-28T00:17:03.452059568Z [2024-06-28T00:17:03.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:16:00+00:00 exited with status success for try_number 1 2024-06-28T00:17:03.457672295Z [2024-06-28T00:17:03.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:16:00+00:00, map_index=-1, run_start_date=2024-06-28 00:17:02.078153+00:00, run_end_date=2024-06-28 00:17:02.521630+00:00, run_duration=0.443477, state=success, executor_state=success, try_number=1, max_tries=1, job_id=468, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:17:01.029200+00:00, queued_by_job_id=2, pid=6850 2024-06-28T00:17:05.249637486Z [2024-06-28T00:17:05.249+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:17:05.250051648Z [2024-06-28T00:17:05.249+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:16:00+00:00, run_id=scheduled__2024-06-28T00:16:00+00:00, run_start_date=2024-06-28 00:17:00.971714+00:00, run_end_date=2024-06-28 00:17:05.249526+00:00, run_duration=4.277812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:16:00+00:00, data_interval_end=2024-06-28 00:17:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:17:05.259119888Z [2024-06-28T00:17:05.258+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:17:00+00:00, run_after=2024-06-28T00:18:00+00:00 2024-06-28T00:17:05.323172953Z [2024-06-28T00:17:05.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:16:00+00:00 exited with status success for try_number 1 2024-06-28T00:17:05.329168109Z [2024-06-28T00:17:05.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:16:00+00:00, map_index=-1, run_start_date=2024-06-28 00:17:03.155530+00:00, run_end_date=2024-06-28 00:17:05.005113+00:00, run_duration=1.849583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=469, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:17:01.029200+00:00, queued_by_job_id=2, pid=6868 2024-06-28T00:17:06.465198504Z [2024-06-28T00:17:06.459+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:17:06.465216594Z [2024-06-28T00:17:06.460+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:16:00+00:00, run_id=scheduled__2024-06-28T00:16:00+00:00, run_start_date=2024-06-28 00:17:00.972661+00:00, run_end_date=2024-06-28 00:17:06.460203+00:00, run_duration=5.487542, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:16:00+00:00, data_interval_end=2024-06-28 00:17:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:17:06.493933656Z [2024-06-28T00:17:06.492+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:17:00+00:00, run_after=2024-06-28T00:18:00+00:00 2024-06-28T00:17:06.551334429Z [2024-06-28T00:17:06.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:16:00+00:00 exited with status success for try_number 1 2024-06-28T00:17:06.562654338Z [2024-06-28T00:17:06.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:16:00+00:00, map_index=-1, run_start_date=2024-06-28 00:17:03.358272+00:00, run_end_date=2024-06-28 00:17:05.898647+00:00, run_duration=2.540375, state=success, executor_state=success, try_number=1, max_tries=1, job_id=470, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:17:01.029200+00:00, queued_by_job_id=2, pid=6869 2024-06-28T00:18:00.860880471Z [2024-06-28T00:18:00.860+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:18:00.875766396Z [2024-06-28T00:18:00.875+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:18:00+00:00, run_after=2024-06-28T00:19:00+00:00 2024-06-28T00:18:00.882914410Z [2024-06-28T00:18:00.882+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:18:00.894648104Z [2024-06-28T00:18:00.894+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:18:00+00:00, run_after=2024-06-28T00:19:00+00:00 2024-06-28T00:18:01.012966351Z [2024-06-28T00:18:01.012+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:18:01.012984229Z 2024-06-28T00:18:01.012990750Z 2024-06-28T00:18:01.012996313Z 2024-06-28T00:18:01.013002511Z 2024-06-28T00:18:01.013166815Z [2024-06-28T00:18:01.012+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:18:01.013368274Z [2024-06-28T00:18:01.013+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:18:01.013572615Z [2024-06-28T00:18:01.013+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:18:01.013987258Z [2024-06-28T00:18:01.013+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:18:01.015353722Z [2024-06-28T00:18:01.014+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:18:01.015371782Z 2024-06-28T00:18:01.015378284Z 2024-06-28T00:18:01.015383944Z 2024-06-28T00:18:01.015394394Z 2024-06-28T00:18:01.024607099Z [2024-06-28T00:18:01.024+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:18:01.025166297Z [2024-06-28T00:18:01.024+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:18:01.025995090Z [2024-06-28T00:18:01.025+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:18:01.026198236Z [2024-06-28T00:18:01.025+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:18:01.028064631Z [2024-06-28T00:18:01.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:18:01.028229610Z [2024-06-28T00:18:01.028+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:18:01.029492188Z [2024-06-28T00:18:01.029+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:18:01.029636914Z [2024-06-28T00:18:01.029+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:18:01.430972144Z [2024-06-28T00:18:01.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:16:00+00:00 exited with status queued for try_number 1 2024-06-28T00:18:01.430997336Z [2024-06-28T00:18:01.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:17:00+00:00 exited with status queued for try_number 1 2024-06-28T00:18:01.431097223Z [2024-06-28T00:18:01.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:17:00+00:00 exited with status queued for try_number 1 2024-06-28T00:18:01.431134367Z [2024-06-28T00:18:01.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:17:00+00:00 exited with status queued for try_number 1 2024-06-28T00:18:01.446017817Z [2024-06-28T00:18:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3764604-258b-497d-8247-1fb2ce654855 2024-06-28T00:18:01.446072016Z [2024-06-28T00:18:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6abfc508-838f-47f1-8547-f3f625efdaf7 2024-06-28T00:18:01.446158504Z [2024-06-28T00:18:01.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a2e2a7c-a92a-4974-85fe-309c822dccc3 2024-06-28T00:18:01.446363380Z [2024-06-28T00:18:01.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to 172e4968-3b7d-4381-9ac3-01675d8956cd 2024-06-28T00:18:02.640744936Z [2024-06-28T00:18:02.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:18:02.640956508Z [2024-06-28T00:18:02.640+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:16:00+00:00, run_id=scheduled__2024-06-28T00:16:00+00:00, run_start_date=2024-06-28 00:18:00.906244+00:00, run_end_date=2024-06-28 00:18:02.640690+00:00, run_duration=1.734446, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:16:00+00:00, data_interval_end=2024-06-28 00:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:18:02.649251573Z [2024-06-28T00:18:02.649+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:18:00+00:00, run_after=2024-06-28T00:20:00+00:00 2024-06-28T00:18:03.793428137Z [2024-06-28T00:18:03.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:18:03.793721146Z [2024-06-28T00:18:03.793+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:17:00+00:00, run_id=scheduled__2024-06-28T00:17:00+00:00, run_start_date=2024-06-28 00:18:00.907729+00:00, run_end_date=2024-06-28 00:18:03.793376+00:00, run_duration=2.885647, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:17:00+00:00, data_interval_end=2024-06-28 00:18:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:18:03.811622984Z [2024-06-28T00:18:03.811+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:18:00+00:00, run_after=2024-06-28T00:19:00+00:00 2024-06-28T00:18:03.909504955Z [2024-06-28T00:18:03.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:16:00+00:00 exited with status success for try_number 1 2024-06-28T00:18:03.909733173Z [2024-06-28T00:18:03.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:17:00+00:00 exited with status success for try_number 1 2024-06-28T00:18:03.919759225Z [2024-06-28T00:18:03.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:16:00+00:00, map_index=-1, run_start_date=2024-06-28 00:18:02.150348+00:00, run_end_date=2024-06-28 00:18:02.618898+00:00, run_duration=0.46855, state=success, executor_state=success, try_number=1, max_tries=1, job_id=471, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:18:01.017115+00:00, queued_by_job_id=2, pid=6902 2024-06-28T00:18:03.920022865Z [2024-06-28T00:18:03.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:17:00+00:00, map_index=-1, run_start_date=2024-06-28 00:18:02.369202+00:00, run_end_date=2024-06-28 00:18:02.865874+00:00, run_duration=0.496672, state=success, executor_state=success, try_number=1, max_tries=1, job_id=472, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:18:01.017115+00:00, queued_by_job_id=2, pid=6904 2024-06-28T00:18:05.695773109Z [2024-06-28T00:18:05.695+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:18:05.696205614Z [2024-06-28T00:18:05.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:17:00+00:00, run_id=scheduled__2024-06-28T00:17:00+00:00, run_start_date=2024-06-28 00:18:00.908990+00:00, run_end_date=2024-06-28 00:18:05.695712+00:00, run_duration=4.786722, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:17:00+00:00, data_interval_end=2024-06-28 00:18:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:18:05.711583484Z [2024-06-28T00:18:05.709+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:18:00+00:00, run_after=2024-06-28T00:19:00+00:00 2024-06-28T00:18:05.758441667Z [2024-06-28T00:18:05.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:17:00+00:00 exited with status success for try_number 1 2024-06-28T00:18:05.765442542Z [2024-06-28T00:18:05.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:17:00+00:00, map_index=-1, run_start_date=2024-06-28 00:18:03.653578+00:00, run_end_date=2024-06-28 00:18:05.528043+00:00, run_duration=1.874465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=474, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:18:01.017115+00:00, queued_by_job_id=2, pid=6927 2024-06-28T00:18:06.846391668Z [2024-06-28T00:18:06.846+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:18:06.846546914Z [2024-06-28T00:18:06.846+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:17:00+00:00, run_id=scheduled__2024-06-28T00:17:00+00:00, run_start_date=2024-06-28 00:18:00.910061+00:00, run_end_date=2024-06-28 00:18:06.846275+00:00, run_duration=5.936214, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:17:00+00:00, data_interval_end=2024-06-28 00:18:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:18:06.854896312Z [2024-06-28T00:18:06.854+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:18:00+00:00, run_after=2024-06-28T00:19:00+00:00 2024-06-28T00:18:06.881078340Z [2024-06-28T00:18:06.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:17:00+00:00 exited with status success for try_number 1 2024-06-28T00:18:06.888084592Z [2024-06-28T00:18:06.887+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:17:00+00:00, map_index=-1, run_start_date=2024-06-28 00:18:03.355789+00:00, run_end_date=2024-06-28 00:18:05.860675+00:00, run_duration=2.504886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=473, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:18:01.017115+00:00, queued_by_job_id=2, pid=6921 2024-06-28T00:19:00.768054273Z [2024-06-28T00:19:00.767+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:19:00.789595778Z [2024-06-28T00:19:00.789+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:19:00+00:00, run_after=2024-06-28T00:20:00+00:00 2024-06-28T00:19:00.804873500Z [2024-06-28T00:19:00.804+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:19:00+00:00, run_after=2024-06-28T00:20:00+00:00 2024-06-28T00:19:00.897131595Z [2024-06-28T00:19:00.896+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:19:00.897155134Z 2024-06-28T00:19:00.897158946Z 2024-06-28T00:19:00.897162048Z 2024-06-28T00:19:00.897456434Z [2024-06-28T00:19:00.897+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:19:00.897707766Z [2024-06-28T00:19:00.897+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:19:00.897962367Z [2024-06-28T00:19:00.897+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:19:00.898664625Z [2024-06-28T00:19:00.898+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:19:00.898676136Z 2024-06-28T00:19:00.898679458Z 2024-06-28T00:19:00.898682521Z 2024-06-28T00:19:00.901678416Z [2024-06-28T00:19:00.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:19:00.901960081Z [2024-06-28T00:19:00.901+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:19:00.902291094Z [2024-06-28T00:19:00.902+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:19:00.902494863Z [2024-06-28T00:19:00.902+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:19:00.902828733Z [2024-06-28T00:19:00.902+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:19:00.903032682Z [2024-06-28T00:19:00.902+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:19:01.218559931Z [2024-06-28T00:19:01.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:18:00+00:00 exited with status queued for try_number 1 2024-06-28T00:19:01.220628927Z [2024-06-28T00:19:01.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:18:00+00:00 exited with status queued for try_number 1 2024-06-28T00:19:01.220778731Z [2024-06-28T00:19:01.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:18:00+00:00 exited with status queued for try_number 1 2024-06-28T00:19:01.228702749Z [2024-06-28T00:19:01.228+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d1a0c1c-9ae5-453d-9ce5-aab4cf9b49f3 2024-06-28T00:19:01.228907846Z [2024-06-28T00:19:01.228+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f4e39dc-5a2c-48b0-bf2a-4bf6e745fe47 2024-06-28T00:19:01.229079641Z [2024-06-28T00:19:01.228+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36374c41-69ac-4f8d-8076-ab9526148fe6 2024-06-28T00:19:02.394386168Z [2024-06-28T00:19:02.393+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:19:02.394746199Z [2024-06-28T00:19:02.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:18:00+00:00, run_id=scheduled__2024-06-28T00:18:00+00:00, run_start_date=2024-06-28 00:19:00.820236+00:00, run_end_date=2024-06-28 00:19:02.394290+00:00, run_duration=1.574054, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:18:00+00:00, data_interval_end=2024-06-28 00:19:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:19:02.403991694Z [2024-06-28T00:19:02.403+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:19:00+00:00, run_after=2024-06-28T00:20:00+00:00 2024-06-28T00:19:02.472774748Z [2024-06-28T00:19:02.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:18:00+00:00 exited with status success for try_number 1 2024-06-28T00:19:02.480627665Z [2024-06-28T00:19:02.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:18:00+00:00, map_index=-1, run_start_date=2024-06-28 00:19:01.738484+00:00, run_end_date=2024-06-28 00:19:02.272883+00:00, run_duration=0.534399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=475, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:19:00.899569+00:00, queued_by_job_id=2, pid=6959 2024-06-28T00:19:04.826449630Z [2024-06-28T00:19:04.826+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:19:04.826655527Z [2024-06-28T00:19:04.826+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:18:00+00:00, run_id=scheduled__2024-06-28T00:18:00+00:00, run_start_date=2024-06-28 00:19:00.830805+00:00, run_end_date=2024-06-28 00:19:04.826365+00:00, run_duration=3.99556, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:18:00+00:00, data_interval_end=2024-06-28 00:19:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:19:04.836184674Z [2024-06-28T00:19:04.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:19:00+00:00, run_after=2024-06-28T00:20:00+00:00 2024-06-28T00:19:04.910150987Z [2024-06-28T00:19:04.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:18:00+00:00 exited with status success for try_number 1 2024-06-28T00:19:04.920565582Z [2024-06-28T00:19:04.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:18:00+00:00, map_index=-1, run_start_date=2024-06-28 00:19:02.949743+00:00, run_end_date=2024-06-28 00:19:04.699783+00:00, run_duration=1.75004, state=success, executor_state=success, try_number=1, max_tries=1, job_id=476, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:19:00.899569+00:00, queued_by_job_id=2, pid=6972 2024-06-28T00:19:06.020414644Z [2024-06-28T00:19:06.020+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:19:06.020722482Z [2024-06-28T00:19:06.020+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:18:00+00:00, run_id=scheduled__2024-06-28T00:18:00+00:00, run_start_date=2024-06-28 00:19:00.828788+00:00, run_end_date=2024-06-28 00:19:06.020397+00:00, run_duration=5.191609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:18:00+00:00, data_interval_end=2024-06-28 00:19:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:19:06.039587814Z [2024-06-28T00:19:06.039+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:19:00+00:00, run_after=2024-06-28T00:20:00+00:00 2024-06-28T00:19:06.085819476Z [2024-06-28T00:19:06.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:18:00+00:00 exited with status success for try_number 1 2024-06-28T00:19:06.093023202Z [2024-06-28T00:19:06.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:18:00+00:00, map_index=-1, run_start_date=2024-06-28 00:19:03.202873+00:00, run_end_date=2024-06-28 00:19:05.036818+00:00, run_duration=1.833945, state=success, executor_state=success, try_number=1, max_tries=1, job_id=477, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:19:00.899569+00:00, queued_by_job_id=2, pid=6978 2024-06-28T00:20:00.731224776Z [2024-06-28T00:20:00.730+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:20:00+00:00, run_after=2024-06-28T00:21:00+00:00 2024-06-28T00:20:00.746859875Z [2024-06-28T00:20:00.746+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:20:00+00:00, run_after=2024-06-28T00:25:00+00:00 2024-06-28T00:20:00.756050186Z [2024-06-28T00:20:00.755+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:20:00.771918250Z [2024-06-28T00:20:00.771+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:20:00+00:00, run_after=2024-06-28T00:21:00+00:00 2024-06-28T00:20:00.779337803Z [2024-06-28T00:20:00.778+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:20:00.892867350Z [2024-06-28T00:20:00.892+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-28T00:20:00.892881389Z 2024-06-28T00:20:00.892885867Z 2024-06-28T00:20:00.892890521Z 2024-06-28T00:20:00.892894553Z 2024-06-28T00:20:00.892899301Z 2024-06-28T00:20:00.892908783Z [2024-06-28T00:20:00.892+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:20:00.893001750Z [2024-06-28T00:20:00.892+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:20:00.893072407Z [2024-06-28T00:20:00.892+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:20:00.893158527Z [2024-06-28T00:20:00.893+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:20:00.893234996Z [2024-06-28T00:20:00.893+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:20:00.893837480Z [2024-06-28T00:20:00.893+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:20:00.893851002Z 2024-06-28T00:20:00.893855740Z 2024-06-28T00:20:00.893860259Z 2024-06-28T00:20:00.893864479Z 2024-06-28T00:20:00.893868654Z 2024-06-28T00:20:00.897913004Z [2024-06-28T00:20:00.897+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T00:20:00.898007591Z [2024-06-28T00:20:00.897+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:20:00.898723784Z [2024-06-28T00:20:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:20:00.898832908Z [2024-06-28T00:20:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:20:00.899030203Z [2024-06-28T00:20:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:20:00.899099306Z [2024-06-28T00:20:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:20:00.899351900Z [2024-06-28T00:20:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:20:00.899358194Z [2024-06-28T00:20:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:20:00.899554492Z [2024-06-28T00:20:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:20:00.899606219Z [2024-06-28T00:20:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:20:01.329086499Z [2024-06-28T00:20:01.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:15:00+00:00 exited with status queued for try_number 1 2024-06-28T00:20:01.329260028Z [2024-06-28T00:20:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:18:00+00:00 exited with status queued for try_number 1 2024-06-28T00:20:01.329381398Z [2024-06-28T00:20:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:19:00+00:00 exited with status queued for try_number 1 2024-06-28T00:20:01.329479048Z [2024-06-28T00:20:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:19:00+00:00 exited with status queued for try_number 1 2024-06-28T00:20:01.329574801Z [2024-06-28T00:20:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:19:00+00:00 exited with status queued for try_number 1 2024-06-28T00:20:01.345721783Z [2024-06-28T00:20:01.345+0000] {scheduler_job.py:635} INFO - Setting external_id for to d09563b2-c357-4802-a009-1e6d3deaf004 2024-06-28T00:20:01.346060397Z [2024-06-28T00:20:01.345+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6ae8cf3-b64c-4955-bc7f-aa5ea5aa5391 2024-06-28T00:20:01.346218806Z [2024-06-28T00:20:01.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ae38318-5088-44dd-9bba-c14604b6ddb3 2024-06-28T00:20:01.355167956Z [2024-06-28T00:20:01.354+0000] {scheduler_job.py:635} INFO - Setting external_id for to 823f4e4c-a776-44ca-9fa2-15c100c161bd 2024-06-28T00:20:01.355359711Z [2024-06-28T00:20:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b24e65f-616f-4165-b4e0-d6789896d266 2024-06-28T00:20:02.713245521Z [2024-06-28T00:20:02.712+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:20:02.713797789Z [2024-06-28T00:20:02.713+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:19:00+00:00, run_id=scheduled__2024-06-28T00:19:00+00:00, run_start_date=2024-06-28 00:20:00.793100+00:00, run_end_date=2024-06-28 00:20:02.713368+00:00, run_duration=1.920268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:19:00+00:00, data_interval_end=2024-06-28 00:20:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:20:02.728722547Z [2024-06-28T00:20:02.728+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:20:00+00:00, run_after=2024-06-28T00:21:00+00:00 2024-06-28T00:20:03.602388707Z [2024-06-28T00:20:03.602+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:20:03.602630558Z [2024-06-28T00:20:03.602+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:18:00+00:00, run_id=scheduled__2024-06-28T00:18:00+00:00, run_start_date=2024-06-28 00:20:00.792057+00:00, run_end_date=2024-06-28 00:20:03.602372+00:00, run_duration=2.810315, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:18:00+00:00, data_interval_end=2024-06-28 00:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:20:03.612921465Z [2024-06-28T00:20:03.612+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:20:00+00:00, run_after=2024-06-28T00:22:00+00:00 2024-06-28T00:20:03.735738015Z [2024-06-28T00:20:03.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:18:00+00:00 exited with status success for try_number 1 2024-06-28T00:20:03.735914104Z [2024-06-28T00:20:03.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:19:00+00:00 exited with status success for try_number 1 2024-06-28T00:20:03.770766120Z [2024-06-28T00:20:03.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:19:00+00:00, map_index=-1, run_start_date=2024-06-28 00:20:02.096693+00:00, run_end_date=2024-06-28 00:20:02.672781+00:00, run_duration=0.576088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=478, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:20:00.894821+00:00, queued_by_job_id=2, pid=7013 2024-06-28T00:20:03.771167113Z [2024-06-28T00:20:03.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:18:00+00:00, map_index=-1, run_start_date=2024-06-28 00:20:02.350860+00:00, run_end_date=2024-06-28 00:20:02.876709+00:00, run_duration=0.525849, state=success, executor_state=success, try_number=1, max_tries=1, job_id=479, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:20:00.894821+00:00, queued_by_job_id=2, pid=7014 2024-06-28T00:20:04.762360630Z [2024-06-28T00:20:04.762+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:20:04.762374931Z 2024-06-28T00:20:04.762609008Z [2024-06-28T00:20:04.762+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:20:04.763274836Z [2024-06-28T00:20:04.763+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:20:04.763288152Z 2024-06-28T00:20:04.767214495Z [2024-06-28T00:20:04.767+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T00:20:04.767428262Z [2024-06-28T00:20:04.767+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:20:04.912631917Z [2024-06-28T00:20:04.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:15:00+00:00 exited with status queued for try_number 1 2024-06-28T00:20:04.912650269Z [2024-06-28T00:20:04.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:15:00+00:00 exited with status success for try_number 1 2024-06-28T00:20:04.929015266Z [2024-06-28T00:20:04.928+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01328fcc-8bae-429a-bb12-cd9cf914ce0a 2024-06-28T00:20:04.929450174Z [2024-06-28T00:20:04.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T00:15:00+00:00, map_index=-1, run_start_date=2024-06-28 00:20:03.606840+00:00, run_end_date=2024-06-28 00:20:04.343599+00:00, run_duration=0.736759, state=success, executor_state=success, try_number=1, max_tries=1, job_id=480, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:20:00.894821+00:00, queued_by_job_id=2, pid=7038 2024-06-28T00:20:06.400079903Z [2024-06-28T00:20:06.398+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:20:06.400098358Z [2024-06-28T00:20:06.399+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:19:00+00:00, run_id=scheduled__2024-06-28T00:19:00+00:00, run_start_date=2024-06-28 00:20:00.794753+00:00, run_end_date=2024-06-28 00:20:06.399195+00:00, run_duration=5.604442, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:19:00+00:00, data_interval_end=2024-06-28 00:20:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:20:06.413296273Z [2024-06-28T00:20:06.409+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:20:00+00:00, run_after=2024-06-28T00:21:00+00:00 2024-06-28T00:20:06.418767125Z [2024-06-28T00:20:06.415+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:20:06.418794010Z [2024-06-28T00:20:06.415+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:19:00+00:00, run_id=scheduled__2024-06-28T00:19:00+00:00, run_start_date=2024-06-28 00:20:00.795768+00:00, run_end_date=2024-06-28 00:20:06.415613+00:00, run_duration=5.619845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:19:00+00:00, data_interval_end=2024-06-28 00:20:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:20:06.431786284Z [2024-06-28T00:20:06.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:20:00+00:00, run_after=2024-06-28T00:21:00+00:00 2024-06-28T00:20:06.551554626Z [2024-06-28T00:20:06.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:19:00+00:00 exited with status success for try_number 1 2024-06-28T00:20:06.551621611Z [2024-06-28T00:20:06.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:19:00+00:00 exited with status success for try_number 1 2024-06-28T00:20:06.573601358Z [2024-06-28T00:20:06.573+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:19:00+00:00, map_index=-1, run_start_date=2024-06-28 00:20:03.683227+00:00, run_end_date=2024-06-28 00:20:05.514921+00:00, run_duration=1.831694, state=success, executor_state=success, try_number=1, max_tries=1, job_id=481, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:20:00.894821+00:00, queued_by_job_id=2, pid=7041 2024-06-28T00:20:06.573757509Z [2024-06-28T00:20:06.573+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:19:00+00:00, map_index=-1, run_start_date=2024-06-28 00:20:04.024310+00:00, run_end_date=2024-06-28 00:20:05.975254+00:00, run_duration=1.950944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=482, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:20:00.894821+00:00, queued_by_job_id=2, pid=7045 2024-06-28T00:20:07.674353144Z [2024-06-28T00:20:07.674+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:20:07.674370979Z 2024-06-28T00:20:07.674473896Z [2024-06-28T00:20:07.674+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:20:07.675269446Z [2024-06-28T00:20:07.675+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:20:07.675277787Z 2024-06-28T00:20:07.677536065Z [2024-06-28T00:20:07.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T00:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T00:20:07.677659541Z [2024-06-28T00:20:07.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T00:20:07.798660895Z [2024-06-28T00:20:07.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:15:00+00:00 exited with status queued for try_number 1 2024-06-28T00:20:07.798896003Z [2024-06-28T00:20:07.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:15:00+00:00 exited with status success for try_number 1 2024-06-28T00:20:07.830907502Z [2024-06-28T00:20:07.830+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8574786f-0915-46fe-b1cc-c308ebeed924 2024-06-28T00:20:07.832402137Z [2024-06-28T00:20:07.832+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T00:15:00+00:00, map_index=-1, run_start_date=2024-06-28 00:20:06.869703+00:00, run_end_date=2024-06-28 00:20:07.246568+00:00, run_duration=0.376865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=483, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:20:04.764706+00:00, queued_by_job_id=2, pid=7068 2024-06-28T00:20:11.150326036Z [2024-06-28T00:20:11.149+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:20:11.150366404Z 2024-06-28T00:20:11.150566565Z [2024-06-28T00:20:11.150+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:20:11.151766925Z [2024-06-28T00:20:11.151+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:20:11.151780981Z 2024-06-28T00:20:11.155049121Z [2024-06-28T00:20:11.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:20:11.155273047Z [2024-06-28T00:20:11.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:20:11.232334600Z [2024-06-28T00:20:11.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:15:00+00:00 exited with status queued for try_number 1 2024-06-28T00:20:11.232744448Z [2024-06-28T00:20:11.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:15:00+00:00 exited with status success for try_number 1 2024-06-28T00:20:11.247739114Z [2024-06-28T00:20:11.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94dfdfc9-4d8d-4a98-9b91-7aa1f776f9cb 2024-06-28T00:20:11.248048595Z [2024-06-28T00:20:11.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T00:15:00+00:00, map_index=0, run_start_date=2024-06-28 00:20:09.554084+00:00, run_end_date=2024-06-28 00:20:09.939936+00:00, run_duration=0.385852, state=success, executor_state=success, try_number=1, max_tries=1, job_id=484, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:20:07.675690+00:00, queued_by_job_id=2, pid=7076 2024-06-28T00:20:13.454955439Z [2024-06-28T00:20:13.454+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:20:13.455761862Z [2024-06-28T00:20:13.455+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:15:00+00:00, run_id=scheduled__2024-06-28T00:15:00+00:00, run_start_date=2024-06-28 00:20:00.790009+00:00, run_end_date=2024-06-28 00:20:13.455113+00:00, run_duration=12.665104, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:15:00+00:00, data_interval_end=2024-06-28 00:20:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T00:20:13.470345612Z [2024-06-28T00:20:13.469+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:20:00+00:00, run_after=2024-06-28T00:25:00+00:00 2024-06-28T00:20:13.504092900Z [2024-06-28T00:20:13.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:15:00+00:00 exited with status success for try_number 1 2024-06-28T00:20:13.509114000Z [2024-06-28T00:20:13.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T00:15:00+00:00, map_index=-1, run_start_date=2024-06-28 00:20:12.871335+00:00, run_end_date=2024-06-28 00:20:13.303916+00:00, run_duration=0.432581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=485, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:20:11.152260+00:00, queued_by_job_id=2, pid=7084 2024-06-28T00:21:00.039890906Z [2024-06-28T00:21:00.039+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:21:00.052697499Z [2024-06-28T00:21:00.052+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:21:00+00:00, run_after=2024-06-28T00:22:00+00:00 2024-06-28T00:21:00.065106828Z [2024-06-28T00:21:00.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:21:00+00:00, run_after=2024-06-28T00:22:00+00:00 2024-06-28T00:21:00.124785151Z [2024-06-28T00:21:00.124+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:21:00.124807061Z 2024-06-28T00:21:00.124810644Z 2024-06-28T00:21:00.124813908Z 2024-06-28T00:21:00.125007546Z [2024-06-28T00:21:00.124+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:21:00.125290717Z [2024-06-28T00:21:00.125+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:21:00.125821484Z [2024-06-28T00:21:00.125+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:21:00.126921327Z [2024-06-28T00:21:00.126+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:21:00.126928572Z 2024-06-28T00:21:00.126931866Z 2024-06-28T00:21:00.126934881Z 2024-06-28T00:21:00.132263775Z [2024-06-28T00:21:00.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:21:00.132494288Z [2024-06-28T00:21:00.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:21:00.132820207Z [2024-06-28T00:21:00.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:21:00.133000237Z [2024-06-28T00:21:00.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:21:00.133303201Z [2024-06-28T00:21:00.133+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:21:00.133490755Z [2024-06-28T00:21:00.133+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:21:00.426093791Z [2024-06-28T00:21:00.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:20:00+00:00 exited with status queued for try_number 1 2024-06-28T00:21:00.427437596Z [2024-06-28T00:21:00.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:20:00+00:00 exited with status queued for try_number 1 2024-06-28T00:21:00.428203297Z [2024-06-28T00:21:00.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:20:00+00:00 exited with status queued for try_number 1 2024-06-28T00:21:00.456845690Z [2024-06-28T00:21:00.456+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4590c8c4-342f-483d-abbd-1c93bab710be 2024-06-28T00:21:00.457577711Z [2024-06-28T00:21:00.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce6b0dd7-012a-47d6-8083-64bb9f269b27 2024-06-28T00:21:00.458368711Z [2024-06-28T00:21:00.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed99a3a5-febe-4401-8982-89e2b746fca3 2024-06-28T00:21:02.007202632Z [2024-06-28T00:21:02.006+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:21:02.007597325Z [2024-06-28T00:21:02.007+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:20:00+00:00, run_id=scheduled__2024-06-28T00:20:00+00:00, run_start_date=2024-06-28 00:21:00.074262+00:00, run_end_date=2024-06-28 00:21:02.007227+00:00, run_duration=1.932965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:20:00+00:00, data_interval_end=2024-06-28 00:21:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:21:02.019812172Z [2024-06-28T00:21:02.019+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:21:00+00:00, run_after=2024-06-28T00:22:00+00:00 2024-06-28T00:21:02.087519426Z [2024-06-28T00:21:02.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:20:00+00:00 exited with status success for try_number 1 2024-06-28T00:21:02.095058254Z [2024-06-28T00:21:02.094+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:20:00+00:00, map_index=-1, run_start_date=2024-06-28 00:21:00.976824+00:00, run_end_date=2024-06-28 00:21:01.315541+00:00, run_duration=0.338717, state=success, executor_state=success, try_number=1, max_tries=1, job_id=486, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:21:00.128447+00:00, queued_by_job_id=2, pid=7106 2024-06-28T00:21:05.333351576Z [2024-06-28T00:21:05.332+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:21:05.333505193Z [2024-06-28T00:21:05.333+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:20:00+00:00, run_id=scheduled__2024-06-28T00:20:00+00:00, run_start_date=2024-06-28 00:21:00.075413+00:00, run_end_date=2024-06-28 00:21:05.333249+00:00, run_duration=5.257836, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:20:00+00:00, data_interval_end=2024-06-28 00:21:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:21:05.341013094Z [2024-06-28T00:21:05.340+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:21:00+00:00, run_after=2024-06-28T00:22:00+00:00 2024-06-28T00:21:05.372289284Z [2024-06-28T00:21:05.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:20:00+00:00 exited with status success for try_number 1 2024-06-28T00:21:05.377335299Z [2024-06-28T00:21:05.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:20:00+00:00, map_index=-1, run_start_date=2024-06-28 00:21:02.127862+00:00, run_end_date=2024-06-28 00:21:04.695700+00:00, run_duration=2.567838, state=success, executor_state=success, try_number=1, max_tries=1, job_id=488, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:21:00.128447+00:00, queued_by_job_id=2, pid=7125 2024-06-28T00:21:06.024000078Z [2024-06-28T00:21:06.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:21:06.024423690Z [2024-06-28T00:21:06.024+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:20:00+00:00, run_id=scheduled__2024-06-28T00:20:00+00:00, run_start_date=2024-06-28 00:21:00.076430+00:00, run_end_date=2024-06-28 00:21:06.024109+00:00, run_duration=5.947679, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:20:00+00:00, data_interval_end=2024-06-28 00:21:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:21:06.033054588Z [2024-06-28T00:21:06.032+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:21:00+00:00, run_after=2024-06-28T00:22:00+00:00 2024-06-28T00:21:06.069571625Z [2024-06-28T00:21:06.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:20:00+00:00 exited with status success for try_number 1 2024-06-28T00:21:06.081105983Z [2024-06-28T00:21:06.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:20:00+00:00, map_index=-1, run_start_date=2024-06-28 00:21:02.051697+00:00, run_end_date=2024-06-28 00:21:05.623893+00:00, run_duration=3.572196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=487, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:21:00.128447+00:00, queued_by_job_id=2, pid=7124 2024-06-28T00:21:45.579576955Z [2024-06-28T00:21:45.575+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T00:22:00.073797066Z [2024-06-28T00:22:00.073+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:22:00+00:00, run_after=2024-06-28T00:23:00+00:00 2024-06-28T00:22:00.083680668Z [2024-06-28T00:22:00.083+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:22:00.093079159Z [2024-06-28T00:22:00.092+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:22:00.105777311Z [2024-06-28T00:22:00.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:22:00+00:00, run_after=2024-06-28T00:23:00+00:00 2024-06-28T00:22:00.207982137Z [2024-06-28T00:22:00.207+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:22:00.208009772Z 2024-06-28T00:22:00.208015848Z 2024-06-28T00:22:00.208020415Z 2024-06-28T00:22:00.208024300Z 2024-06-28T00:22:00.208036611Z [2024-06-28T00:22:00.207+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:22:00.208109192Z [2024-06-28T00:22:00.208+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:22:00.208180354Z [2024-06-28T00:22:00.208+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:22:00.208248290Z [2024-06-28T00:22:00.208+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:22:00.208790822Z [2024-06-28T00:22:00.208+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:22:00.208821263Z 2024-06-28T00:22:00.208843279Z 2024-06-28T00:22:00.208848122Z 2024-06-28T00:22:00.208852756Z 2024-06-28T00:22:00.232540513Z [2024-06-28T00:22:00.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:22:00.234764603Z [2024-06-28T00:22:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:22:00.235665200Z [2024-06-28T00:22:00.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:22:00.235843857Z [2024-06-28T00:22:00.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:22:00.236910637Z [2024-06-28T00:22:00.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:22:00.237555928Z [2024-06-28T00:22:00.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:22:00.237829496Z [2024-06-28T00:22:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:22:00.238818657Z [2024-06-28T00:22:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:22:00.846575706Z [2024-06-28T00:22:00.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:20:00+00:00 exited with status queued for try_number 1 2024-06-28T00:22:00.851046078Z [2024-06-28T00:22:00.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:21:00+00:00 exited with status queued for try_number 1 2024-06-28T00:22:00.851186746Z [2024-06-28T00:22:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:21:00+00:00 exited with status queued for try_number 1 2024-06-28T00:22:00.851316604Z [2024-06-28T00:22:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:21:00+00:00 exited with status queued for try_number 1 2024-06-28T00:22:00.868651845Z [2024-06-28T00:22:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to a90cce81-efde-4c81-a531-aedcbe6c21aa 2024-06-28T00:22:00.868959613Z [2024-06-28T00:22:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4db7e87-749b-41a5-8902-72378715be43 2024-06-28T00:22:00.869249069Z [2024-06-28T00:22:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f1bc444-cde5-4684-9363-993fa4470254 2024-06-28T00:22:00.869544398Z [2024-06-28T00:22:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19471d6a-82d0-4589-a2f7-45442948210d 2024-06-28T00:22:01.985053238Z [2024-06-28T00:22:01.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:22:01.992912245Z [2024-06-28T00:22:01.992+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:20:00+00:00, run_id=scheduled__2024-06-28T00:20:00+00:00, run_start_date=2024-06-28 00:22:00.115886+00:00, run_end_date=2024-06-28 00:22:01.984982+00:00, run_duration=1.869096, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:20:00+00:00, data_interval_end=2024-06-28 00:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:22:02.013983553Z [2024-06-28T00:22:02.013+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:22:00+00:00, run_after=2024-06-28T00:24:00+00:00 2024-06-28T00:22:02.022400860Z [2024-06-28T00:22:02.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:22:02.022731379Z [2024-06-28T00:22:02.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:21:00+00:00, run_id=scheduled__2024-06-28T00:21:00+00:00, run_start_date=2024-06-28 00:22:00.117055+00:00, run_end_date=2024-06-28 00:22:02.022378+00:00, run_duration=1.905323, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:21:00+00:00, data_interval_end=2024-06-28 00:22:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:22:02.034295851Z [2024-06-28T00:22:02.034+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:22:00+00:00, run_after=2024-06-28T00:23:00+00:00 2024-06-28T00:22:02.089900820Z [2024-06-28T00:22:02.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:20:00+00:00 exited with status success for try_number 1 2024-06-28T00:22:02.090037704Z [2024-06-28T00:22:02.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:21:00+00:00 exited with status success for try_number 1 2024-06-28T00:22:02.097358330Z [2024-06-28T00:22:02.097+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:20:00+00:00, map_index=-1, run_start_date=2024-06-28 00:22:01.140866+00:00, run_end_date=2024-06-28 00:22:01.567664+00:00, run_duration=0.426798, state=success, executor_state=success, try_number=1, max_tries=1, job_id=489, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:22:00.209511+00:00, queued_by_job_id=2, pid=7154 2024-06-28T00:22:02.097641652Z [2024-06-28T00:22:02.097+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:21:00+00:00, map_index=-1, run_start_date=2024-06-28 00:22:01.438623+00:00, run_end_date=2024-06-28 00:22:01.888015+00:00, run_duration=0.449392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=490, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:22:00.209511+00:00, queued_by_job_id=2, pid=7162 2024-06-28T00:22:04.284729715Z [2024-06-28T00:22:04.284+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:22:04.286395195Z [2024-06-28T00:22:04.285+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:21:00+00:00, run_id=scheduled__2024-06-28T00:21:00+00:00, run_start_date=2024-06-28 00:22:00.118019+00:00, run_end_date=2024-06-28 00:22:04.284668+00:00, run_duration=4.166649, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:21:00+00:00, data_interval_end=2024-06-28 00:22:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:22:04.302074394Z [2024-06-28T00:22:04.301+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:22:00+00:00, run_after=2024-06-28T00:23:00+00:00 2024-06-28T00:22:04.452168554Z [2024-06-28T00:22:04.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:21:00+00:00 exited with status success for try_number 1 2024-06-28T00:22:04.458586986Z [2024-06-28T00:22:04.458+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:21:00+00:00, map_index=-1, run_start_date=2024-06-28 00:22:02.462034+00:00, run_end_date=2024-06-28 00:22:03.712761+00:00, run_duration=1.250727, state=success, executor_state=success, try_number=1, max_tries=1, job_id=491, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:22:00.209511+00:00, queued_by_job_id=2, pid=7178 2024-06-28T00:22:04.701546839Z [2024-06-28T00:22:04.701+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:22:04.701878274Z [2024-06-28T00:22:04.701+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:21:00+00:00, run_id=scheduled__2024-06-28T00:21:00+00:00, run_start_date=2024-06-28 00:22:00.119176+00:00, run_end_date=2024-06-28 00:22:04.701471+00:00, run_duration=4.582295, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:21:00+00:00, data_interval_end=2024-06-28 00:22:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:22:04.717399991Z [2024-06-28T00:22:04.717+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:22:00+00:00, run_after=2024-06-28T00:23:00+00:00 2024-06-28T00:22:04.758227328Z [2024-06-28T00:22:04.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:21:00+00:00 exited with status success for try_number 1 2024-06-28T00:22:04.763628019Z [2024-06-28T00:22:04.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:21:00+00:00, map_index=-1, run_start_date=2024-06-28 00:22:02.718258+00:00, run_end_date=2024-06-28 00:22:04.280601+00:00, run_duration=1.562343, state=success, executor_state=success, try_number=1, max_tries=1, job_id=492, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:22:00.209511+00:00, queued_by_job_id=2, pid=7184 2024-06-28T00:23:00.068094557Z [2024-06-28T00:23:00.067+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:23:00+00:00, run_after=2024-06-28T00:24:00+00:00 2024-06-28T00:23:00.077695398Z [2024-06-28T00:23:00.077+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:23:00.091570261Z [2024-06-28T00:23:00.091+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:23:00+00:00, run_after=2024-06-28T00:24:00+00:00 2024-06-28T00:23:00.156666515Z [2024-06-28T00:23:00.156+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:23:00.156680828Z 2024-06-28T00:23:00.156684940Z 2024-06-28T00:23:00.156688392Z 2024-06-28T00:23:00.156804505Z [2024-06-28T00:23:00.156+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:23:00.156930780Z [2024-06-28T00:23:00.156+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:23:00.157096948Z [2024-06-28T00:23:00.156+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:23:00.157685790Z [2024-06-28T00:23:00.157+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:23:00.157696510Z 2024-06-28T00:23:00.157699676Z 2024-06-28T00:23:00.157716852Z 2024-06-28T00:23:00.160490604Z [2024-06-28T00:23:00.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:23:00.160703580Z [2024-06-28T00:23:00.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:23:00.161397193Z [2024-06-28T00:23:00.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:23:00.161518271Z [2024-06-28T00:23:00.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:23:00.161785753Z [2024-06-28T00:23:00.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:23:00.161909239Z [2024-06-28T00:23:00.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:23:00.450802299Z [2024-06-28T00:23:00.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:22:00+00:00 exited with status queued for try_number 1 2024-06-28T00:23:00.450817257Z [2024-06-28T00:23:00.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:22:00+00:00 exited with status queued for try_number 1 2024-06-28T00:23:00.450821127Z [2024-06-28T00:23:00.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:22:00+00:00 exited with status queued for try_number 1 2024-06-28T00:23:00.467337831Z [2024-06-28T00:23:00.466+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9862c334-6a86-470f-80e0-ee6d823eb4cd 2024-06-28T00:23:00.467659491Z [2024-06-28T00:23:00.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4797b717-cfd8-40f9-943b-a64601490908 2024-06-28T00:23:00.467971414Z [2024-06-28T00:23:00.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bfe58c1-797c-47c7-beca-426864d9ee28 2024-06-28T00:23:01.628783857Z [2024-06-28T00:23:01.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:23:01.629333640Z [2024-06-28T00:23:01.629+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:22:00+00:00, run_id=scheduled__2024-06-28T00:22:00+00:00, run_start_date=2024-06-28 00:23:00.102630+00:00, run_end_date=2024-06-28 00:23:01.628965+00:00, run_duration=1.526335, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:22:00+00:00, data_interval_end=2024-06-28 00:23:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:23:01.643481925Z [2024-06-28T00:23:01.643+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:23:00+00:00, run_after=2024-06-28T00:24:00+00:00 2024-06-28T00:23:01.703877176Z [2024-06-28T00:23:01.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:22:00+00:00 exited with status success for try_number 1 2024-06-28T00:23:01.709817993Z [2024-06-28T00:23:01.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:22:00+00:00, map_index=-1, run_start_date=2024-06-28 00:23:01.109482+00:00, run_end_date=2024-06-28 00:23:01.487794+00:00, run_duration=0.378312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=493, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:23:00.158283+00:00, queued_by_job_id=2, pid=7216 2024-06-28T00:23:04.155758544Z [2024-06-28T00:23:04.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:23:04.156187859Z [2024-06-28T00:23:04.155+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:22:00+00:00, run_id=scheduled__2024-06-28T00:22:00+00:00, run_start_date=2024-06-28 00:23:00.103748+00:00, run_end_date=2024-06-28 00:23:04.155877+00:00, run_duration=4.052129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:22:00+00:00, data_interval_end=2024-06-28 00:23:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:23:04.165500347Z [2024-06-28T00:23:04.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:23:00+00:00, run_after=2024-06-28T00:24:00+00:00 2024-06-28T00:23:04.218598142Z [2024-06-28T00:23:04.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:22:00+00:00 exited with status success for try_number 1 2024-06-28T00:23:04.225077744Z [2024-06-28T00:23:04.224+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:22:00+00:00, map_index=-1, run_start_date=2024-06-28 00:23:02.488301+00:00, run_end_date=2024-06-28 00:23:03.969314+00:00, run_duration=1.481013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=495, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:23:00.158283+00:00, queued_by_job_id=2, pid=7235 2024-06-28T00:23:05.158576099Z [2024-06-28T00:23:05.158+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:23:05.158898185Z [2024-06-28T00:23:05.158+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:22:00+00:00, run_id=scheduled__2024-06-28T00:22:00+00:00, run_start_date=2024-06-28 00:23:00.105068+00:00, run_end_date=2024-06-28 00:23:05.158518+00:00, run_duration=5.05345, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:22:00+00:00, data_interval_end=2024-06-28 00:23:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:23:05.170650001Z [2024-06-28T00:23:05.170+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:23:00+00:00, run_after=2024-06-28T00:24:00+00:00 2024-06-28T00:23:05.213792076Z [2024-06-28T00:23:05.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:22:00+00:00 exited with status success for try_number 1 2024-06-28T00:23:05.225808163Z [2024-06-28T00:23:05.225+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:22:00+00:00, map_index=-1, run_start_date=2024-06-28 00:23:02.305112+00:00, run_end_date=2024-06-28 00:23:04.271617+00:00, run_duration=1.966505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=494, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:23:00.158283+00:00, queued_by_job_id=2, pid=7234 2024-06-28T00:24:00.948441367Z [2024-06-28T00:24:00.947+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:24:00+00:00, run_after=2024-06-28T00:25:00+00:00 2024-06-28T00:24:00.960754745Z [2024-06-28T00:24:00.960+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:24:00+00:00, run_after=2024-06-28T00:25:00+00:00 2024-06-28T00:24:00.967477368Z [2024-06-28T00:24:00.967+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:24:00.973645911Z [2024-06-28T00:24:00.973+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:24:01.092691256Z [2024-06-28T00:24:01.092+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:24:01.092712069Z 2024-06-28T00:24:01.092717033Z 2024-06-28T00:24:01.092727168Z 2024-06-28T00:24:01.092731292Z 2024-06-28T00:24:01.093014971Z [2024-06-28T00:24:01.092+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:24:01.093383252Z [2024-06-28T00:24:01.093+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:24:01.093608823Z [2024-06-28T00:24:01.093+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:24:01.094114619Z [2024-06-28T00:24:01.093+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:24:01.094816412Z [2024-06-28T00:24:01.094+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:24:01.094831470Z 2024-06-28T00:24:01.094835711Z 2024-06-28T00:24:01.094839572Z 2024-06-28T00:24:01.094843192Z 2024-06-28T00:24:01.099321254Z [2024-06-28T00:24:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:24:01.099562988Z [2024-06-28T00:24:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:24:01.099900684Z [2024-06-28T00:24:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:24:01.100121802Z [2024-06-28T00:24:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:24:01.100496325Z [2024-06-28T00:24:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:24:01.100699890Z [2024-06-28T00:24:01.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:24:01.100976793Z [2024-06-28T00:24:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:24:01.101160341Z [2024-06-28T00:24:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:24:01.464172503Z [2024-06-28T00:24:01.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:22:00+00:00 exited with status queued for try_number 1 2024-06-28T00:24:01.464274988Z [2024-06-28T00:24:01.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:23:00+00:00 exited with status queued for try_number 1 2024-06-28T00:24:01.464331028Z [2024-06-28T00:24:01.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:23:00+00:00 exited with status queued for try_number 1 2024-06-28T00:24:01.464404884Z [2024-06-28T00:24:01.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:23:00+00:00 exited with status queued for try_number 1 2024-06-28T00:24:01.478573492Z [2024-06-28T00:24:01.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to dccd3461-a927-4bc0-b440-23fb01fe62a1 2024-06-28T00:24:01.478752322Z [2024-06-28T00:24:01.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8efc9a30-62e4-4d78-8902-8750cf9105d5 2024-06-28T00:24:01.478921055Z [2024-06-28T00:24:01.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3dbc4a18-2fff-4fe7-baaf-88d2c186824d 2024-06-28T00:24:01.479110668Z [2024-06-28T00:24:01.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to 460b1844-02c1-455c-a603-0287d27ec1db 2024-06-28T00:24:03.756736927Z [2024-06-28T00:24:03.756+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:24:03.757367041Z [2024-06-28T00:24:03.757+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:22:00+00:00, run_id=scheduled__2024-06-28T00:22:00+00:00, run_start_date=2024-06-28 00:24:00.989651+00:00, run_end_date=2024-06-28 00:24:03.756632+00:00, run_duration=2.766981, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:22:00+00:00, data_interval_end=2024-06-28 00:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:24:03.766516482Z [2024-06-28T00:24:03.766+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:24:00+00:00, run_after=2024-06-28T00:26:00+00:00 2024-06-28T00:24:03.775589838Z [2024-06-28T00:24:03.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:24:03.775926932Z [2024-06-28T00:24:03.775+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:23:00+00:00, run_id=scheduled__2024-06-28T00:23:00+00:00, run_start_date=2024-06-28 00:24:00.992264+00:00, run_end_date=2024-06-28 00:24:03.775511+00:00, run_duration=2.783247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:23:00+00:00, data_interval_end=2024-06-28 00:24:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:24:03.790272923Z [2024-06-28T00:24:03.788+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:24:00+00:00, run_after=2024-06-28T00:25:00+00:00 2024-06-28T00:24:03.872760173Z [2024-06-28T00:24:03.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:22:00+00:00 exited with status success for try_number 1 2024-06-28T00:24:03.872959456Z [2024-06-28T00:24:03.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:23:00+00:00 exited with status success for try_number 1 2024-06-28T00:24:03.884566550Z [2024-06-28T00:24:03.884+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:22:00+00:00, map_index=-1, run_start_date=2024-06-28 00:24:02.179931+00:00, run_end_date=2024-06-28 00:24:02.674286+00:00, run_duration=0.494355, state=success, executor_state=success, try_number=1, max_tries=1, job_id=496, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:24:01.096393+00:00, queued_by_job_id=2, pid=7268 2024-06-28T00:24:03.885632638Z [2024-06-28T00:24:03.885+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:23:00+00:00, map_index=-1, run_start_date=2024-06-28 00:24:02.258837+00:00, run_end_date=2024-06-28 00:24:02.799811+00:00, run_duration=0.540974, state=success, executor_state=success, try_number=1, max_tries=1, job_id=497, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:24:01.096393+00:00, queued_by_job_id=2, pid=7269 2024-06-28T00:24:05.689557276Z [2024-06-28T00:24:05.689+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:24:05.689917290Z [2024-06-28T00:24:05.689+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:23:00+00:00, run_id=scheduled__2024-06-28T00:23:00+00:00, run_start_date=2024-06-28 00:24:00.994439+00:00, run_end_date=2024-06-28 00:24:05.689608+00:00, run_duration=4.695169, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:23:00+00:00, data_interval_end=2024-06-28 00:24:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:24:05.709748439Z [2024-06-28T00:24:05.709+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:24:00+00:00, run_after=2024-06-28T00:25:00+00:00 2024-06-28T00:24:05.736893169Z [2024-06-28T00:24:05.736+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:24:05.743907005Z [2024-06-28T00:24:05.743+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:23:00+00:00, run_id=scheduled__2024-06-28T00:23:00+00:00, run_start_date=2024-06-28 00:24:00.996499+00:00, run_end_date=2024-06-28 00:24:05.743482+00:00, run_duration=4.746983, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:23:00+00:00, data_interval_end=2024-06-28 00:24:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:24:05.762980577Z [2024-06-28T00:24:05.762+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:24:00+00:00, run_after=2024-06-28T00:25:00+00:00 2024-06-28T00:24:05.931652727Z [2024-06-28T00:24:05.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:23:00+00:00 exited with status success for try_number 1 2024-06-28T00:24:05.944386880Z [2024-06-28T00:24:05.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:23:00+00:00, map_index=-1, run_start_date=2024-06-28 00:24:03.451178+00:00, run_end_date=2024-06-28 00:24:05.187403+00:00, run_duration=1.736225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=499, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:24:01.096393+00:00, queued_by_job_id=2, pid=7293 2024-06-28T00:24:06.560364513Z [2024-06-28T00:24:06.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:23:00+00:00 exited with status success for try_number 1 2024-06-28T00:24:06.568995410Z [2024-06-28T00:24:06.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:23:00+00:00, map_index=-1, run_start_date=2024-06-28 00:24:03.397263+00:00, run_end_date=2024-06-28 00:24:05.596501+00:00, run_duration=2.199238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=498, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:24:01.096393+00:00, queued_by_job_id=2, pid=7292 2024-06-28T00:25:00.812984916Z [2024-06-28T00:25:00.812+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:25:00+00:00, run_after=2024-06-28T00:30:00+00:00 2024-06-28T00:25:00.831652807Z [2024-06-28T00:25:00.831+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:25:00+00:00, run_after=2024-06-28T00:26:00+00:00 2024-06-28T00:25:00.854881889Z [2024-06-28T00:25:00.854+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:25:00+00:00, run_after=2024-06-28T00:26:00+00:00 2024-06-28T00:25:00.866428559Z [2024-06-28T00:25:00.865+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:25:00.964320446Z [2024-06-28T00:25:00.963+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:25:00.964349885Z 2024-06-28T00:25:00.964361119Z 2024-06-28T00:25:00.964366849Z 2024-06-28T00:25:00.964371855Z 2024-06-28T00:25:00.964497827Z [2024-06-28T00:25:00.964+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:25:00.964721765Z [2024-06-28T00:25:00.964+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:25:00.964956470Z [2024-06-28T00:25:00.964+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:25:00.965154623Z [2024-06-28T00:25:00.964+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:25:00.967041494Z [2024-06-28T00:25:00.966+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:25:00.967056001Z 2024-06-28T00:25:00.967063254Z 2024-06-28T00:25:00.967069730Z 2024-06-28T00:25:00.967081128Z 2024-06-28T00:25:00.973551263Z [2024-06-28T00:25:00.973+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T00:25:00.973772662Z [2024-06-28T00:25:00.973+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:25:00.974176127Z [2024-06-28T00:25:00.973+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:25:00.974357444Z [2024-06-28T00:25:00.974+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:25:00.974745539Z [2024-06-28T00:25:00.974+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:25:00.975152508Z [2024-06-28T00:25:00.974+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:25:00.975505676Z [2024-06-28T00:25:00.975+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:25:00.975701103Z [2024-06-28T00:25:00.975+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:25:01.444756573Z [2024-06-28T00:25:01.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:20:00+00:00 exited with status queued for try_number 1 2024-06-28T00:25:01.444850360Z [2024-06-28T00:25:01.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:24:00+00:00 exited with status queued for try_number 1 2024-06-28T00:25:01.444915825Z [2024-06-28T00:25:01.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:24:00+00:00 exited with status queued for try_number 1 2024-06-28T00:25:01.445040781Z [2024-06-28T00:25:01.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:24:00+00:00 exited with status queued for try_number 1 2024-06-28T00:25:01.457530105Z [2024-06-28T00:25:01.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to 921804e7-9303-4ec6-93b9-d1f1c08bee07 2024-06-28T00:25:01.457557406Z [2024-06-28T00:25:01.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to 465190d3-1985-4c1f-ba7b-493f68e776d6 2024-06-28T00:25:01.457927419Z [2024-06-28T00:25:01.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to d91b5668-1dcb-4991-a104-bf18d68ab37a 2024-06-28T00:25:01.457950655Z [2024-06-28T00:25:01.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0ff0052-1e97-4194-9c8c-258d1bbc82bf 2024-06-28T00:25:02.633830013Z [2024-06-28T00:25:02.633+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:25:02.634289263Z [2024-06-28T00:25:02.634+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:24:00+00:00, run_id=scheduled__2024-06-28T00:24:00+00:00, run_start_date=2024-06-28 00:25:00.880366+00:00, run_end_date=2024-06-28 00:25:02.633926+00:00, run_duration=1.75356, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:24:00+00:00, data_interval_end=2024-06-28 00:25:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:25:02.645079019Z [2024-06-28T00:25:02.644+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:25:00+00:00, run_after=2024-06-28T00:26:00+00:00 2024-06-28T00:25:02.733516013Z [2024-06-28T00:25:02.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:24:00+00:00 exited with status success for try_number 1 2024-06-28T00:25:02.746304176Z [2024-06-28T00:25:02.745+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:24:00+00:00, map_index=-1, run_start_date=2024-06-28 00:25:01.954368+00:00, run_end_date=2024-06-28 00:25:02.375148+00:00, run_duration=0.42078, state=success, executor_state=success, try_number=1, max_tries=1, job_id=500, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:25:00.968786+00:00, queued_by_job_id=2, pid=7326 2024-06-28T00:25:04.822973354Z [2024-06-28T00:25:04.822+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:25:04.823367737Z [2024-06-28T00:25:04.823+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:24:00+00:00, run_id=scheduled__2024-06-28T00:24:00+00:00, run_start_date=2024-06-28 00:25:00.881343+00:00, run_end_date=2024-06-28 00:25:04.822891+00:00, run_duration=3.941548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:24:00+00:00, data_interval_end=2024-06-28 00:25:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:25:04.833315347Z [2024-06-28T00:25:04.833+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:25:00+00:00, run_after=2024-06-28T00:26:00+00:00 2024-06-28T00:25:04.864865828Z [2024-06-28T00:25:04.864+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:25:04.864895087Z 2024-06-28T00:25:04.864905943Z [2024-06-28T00:25:04.864+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:25:04.866185811Z [2024-06-28T00:25:04.865+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:25:04.866192381Z 2024-06-28T00:25:04.870009978Z [2024-06-28T00:25:04.869+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T00:25:04.870097067Z [2024-06-28T00:25:04.869+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:25:04.927913064Z [2024-06-28T00:25:04.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:20:00+00:00 exited with status queued for try_number 1 2024-06-28T00:25:04.927978404Z [2024-06-28T00:25:04.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:20:00+00:00 exited with status success for try_number 1 2024-06-28T00:25:04.928001739Z [2024-06-28T00:25:04.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:24:00+00:00 exited with status success for try_number 1 2024-06-28T00:25:04.934229312Z [2024-06-28T00:25:04.933+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T00:20:00+00:00, map_index=-1, run_start_date=2024-06-28 00:25:03.549853+00:00, run_end_date=2024-06-28 00:25:03.979258+00:00, run_duration=0.429405, state=success, executor_state=success, try_number=1, max_tries=1, job_id=503, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:25:00.968786+00:00, queued_by_job_id=2, pid=7352 2024-06-28T00:25:04.934336496Z [2024-06-28T00:25:04.934+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:24:00+00:00, map_index=-1, run_start_date=2024-06-28 00:25:03.273959+00:00, run_end_date=2024-06-28 00:25:04.540349+00:00, run_duration=1.26639, state=success, executor_state=success, try_number=1, max_tries=1, job_id=501, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:25:00.968786+00:00, queued_by_job_id=2, pid=7345 2024-06-28T00:25:04.934484340Z [2024-06-28T00:25:04.934+0000] {scheduler_job.py:635} INFO - Setting external_id for to bdfa61d2-1ba9-442d-a69d-a498b4908daf 2024-06-28T00:25:05.284776628Z [2024-06-28T00:25:05.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:24:00+00:00 exited with status success for try_number 1 2024-06-28T00:25:05.293958981Z [2024-06-28T00:25:05.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:24:00+00:00, map_index=-1, run_start_date=2024-06-28 00:25:03.375112+00:00, run_end_date=2024-06-28 00:25:05.102646+00:00, run_duration=1.727534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=502, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:25:00.968786+00:00, queued_by_job_id=2, pid=7351 2024-06-28T00:25:06.337990140Z [2024-06-28T00:25:06.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:25:06.338400600Z [2024-06-28T00:25:06.338+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:24:00+00:00, run_id=scheduled__2024-06-28T00:24:00+00:00, run_start_date=2024-06-28 00:25:00.882291+00:00, run_end_date=2024-06-28 00:25:06.338081+00:00, run_duration=5.45579, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:24:00+00:00, data_interval_end=2024-06-28 00:25:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:25:06.350891318Z [2024-06-28T00:25:06.350+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:25:00+00:00, run_after=2024-06-28T00:26:00+00:00 2024-06-28T00:25:07.969236937Z [2024-06-28T00:25:07.968+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:25:07.969298342Z 2024-06-28T00:25:07.969356073Z [2024-06-28T00:25:07.969+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:25:07.970013807Z [2024-06-28T00:25:07.969+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:25:07.970029189Z 2024-06-28T00:25:07.972313820Z [2024-06-28T00:25:07.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T00:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T00:25:07.972547165Z [2024-06-28T00:25:07.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T00:25:08.051212133Z [2024-06-28T00:25:08.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:20:00+00:00 exited with status queued for try_number 1 2024-06-28T00:25:08.051385966Z [2024-06-28T00:25:08.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:20:00+00:00 exited with status success for try_number 1 2024-06-28T00:25:08.074839063Z [2024-06-28T00:25:08.074+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff28cfc3-82ef-4210-940c-6fde743f313f 2024-06-28T00:25:08.074870465Z [2024-06-28T00:25:08.074+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T00:20:00+00:00, map_index=-1, run_start_date=2024-06-28 00:25:06.964451+00:00, run_end_date=2024-06-28 00:25:07.369862+00:00, run_duration=0.405411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=504, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:25:04.867677+00:00, queued_by_job_id=2, pid=7375 2024-06-28T00:25:11.200684396Z [2024-06-28T00:25:11.200+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:25:11.200709697Z 2024-06-28T00:25:11.200922383Z [2024-06-28T00:25:11.200+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:25:11.201520733Z [2024-06-28T00:25:11.201+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:25:11.201536390Z 2024-06-28T00:25:11.203605071Z [2024-06-28T00:25:11.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:25:11.203630543Z [2024-06-28T00:25:11.203+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:25:11.282670377Z [2024-06-28T00:25:11.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:20:00+00:00 exited with status queued for try_number 1 2024-06-28T00:25:11.282854401Z [2024-06-28T00:25:11.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:20:00+00:00 exited with status success for try_number 1 2024-06-28T00:25:11.292034306Z [2024-06-28T00:25:11.291+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58a39b1f-6103-4ce7-b49f-1b246261e964 2024-06-28T00:25:11.292321362Z [2024-06-28T00:25:11.292+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T00:20:00+00:00, map_index=0, run_start_date=2024-06-28 00:25:09.779373+00:00, run_end_date=2024-06-28 00:25:10.156012+00:00, run_duration=0.376639, state=success, executor_state=success, try_number=1, max_tries=1, job_id=505, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:25:07.970331+00:00, queued_by_job_id=2, pid=7383 2024-06-28T00:25:13.527317482Z [2024-06-28T00:25:13.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:25:13.527610257Z [2024-06-28T00:25:13.527+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:20:00+00:00, run_id=scheduled__2024-06-28T00:20:00+00:00, run_start_date=2024-06-28 00:25:00.879088+00:00, run_end_date=2024-06-28 00:25:13.527246+00:00, run_duration=12.648158, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:20:00+00:00, data_interval_end=2024-06-28 00:25:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T00:25:13.533342215Z [2024-06-28T00:25:13.533+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:25:00+00:00, run_after=2024-06-28T00:30:00+00:00 2024-06-28T00:25:14.657195321Z [2024-06-28T00:25:14.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:20:00+00:00 exited with status success for try_number 1 2024-06-28T00:25:14.663455736Z [2024-06-28T00:25:14.663+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T00:20:00+00:00, map_index=-1, run_start_date=2024-06-28 00:25:13.143714+00:00, run_end_date=2024-06-28 00:25:13.508628+00:00, run_duration=0.364914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=506, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:25:11.201827+00:00, queued_by_job_id=2, pid=7391 2024-06-28T00:26:00.832440594Z [2024-06-28T00:26:00.831+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:26:00+00:00, run_after=2024-06-28T00:27:00+00:00 2024-06-28T00:26:00.845389672Z [2024-06-28T00:26:00.844+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:26:00+00:00, run_after=2024-06-28T00:27:00+00:00 2024-06-28T00:26:00.852760635Z [2024-06-28T00:26:00.852+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:26:00.860298263Z [2024-06-28T00:26:00.859+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:26:00.976632115Z [2024-06-28T00:26:00.976+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:26:00.976669470Z 2024-06-28T00:26:00.976679716Z 2024-06-28T00:26:00.976688337Z 2024-06-28T00:26:00.976696850Z 2024-06-28T00:26:00.976820103Z [2024-06-28T00:26:00.976+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:26:00.977039697Z [2024-06-28T00:26:00.976+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:26:00.977295573Z [2024-06-28T00:26:00.977+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:26:00.977481100Z [2024-06-28T00:26:00.977+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:26:00.978657525Z [2024-06-28T00:26:00.978+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:26:00.978671295Z 2024-06-28T00:26:00.978677713Z 2024-06-28T00:26:00.978732529Z 2024-06-28T00:26:00.978740190Z 2024-06-28T00:26:00.988724895Z [2024-06-28T00:26:00.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:26:00.988990257Z [2024-06-28T00:26:00.988+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:26:00.989362774Z [2024-06-28T00:26:00.989+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:26:00.989532678Z [2024-06-28T00:26:00.989+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:26:00.989872764Z [2024-06-28T00:26:00.989+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:26:00.990523263Z [2024-06-28T00:26:00.990+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:26:00.990966985Z [2024-06-28T00:26:00.990+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:26:00.991137874Z [2024-06-28T00:26:00.990+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:26:01.459449933Z [2024-06-28T00:26:01.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:24:00+00:00 exited with status queued for try_number 1 2024-06-28T00:26:01.459618348Z [2024-06-28T00:26:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:25:00+00:00 exited with status queued for try_number 1 2024-06-28T00:26:01.459751617Z [2024-06-28T00:26:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:25:00+00:00 exited with status queued for try_number 1 2024-06-28T00:26:01.459848026Z [2024-06-28T00:26:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:25:00+00:00 exited with status queued for try_number 1 2024-06-28T00:26:01.482930416Z [2024-06-28T00:26:01.481+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a5d7fc7-9223-45ab-ae5b-e979a8ad3bc9 2024-06-28T00:26:01.482995777Z [2024-06-28T00:26:01.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to dad571be-c55d-446f-a259-4184d3d6eaf9 2024-06-28T00:26:01.482999877Z [2024-06-28T00:26:01.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0138d7f9-0d38-44ce-8082-55270ba1b3d3 2024-06-28T00:26:01.483003346Z [2024-06-28T00:26:01.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fbc3cb1-20fc-4a41-a01d-afe3deebb7c4 2024-06-28T00:26:02.734037817Z [2024-06-28T00:26:02.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:26:02.734474022Z [2024-06-28T00:26:02.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:24:00+00:00, run_id=scheduled__2024-06-28T00:24:00+00:00, run_start_date=2024-06-28 00:26:00.870504+00:00, run_end_date=2024-06-28 00:26:02.734084+00:00, run_duration=1.86358, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:24:00+00:00, data_interval_end=2024-06-28 00:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:26:02.745229034Z [2024-06-28T00:26:02.744+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:26:00+00:00, run_after=2024-06-28T00:28:00+00:00 2024-06-28T00:26:02.752297855Z [2024-06-28T00:26:02.751+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:26:02.752606766Z [2024-06-28T00:26:02.752+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:25:00+00:00, run_id=scheduled__2024-06-28T00:25:00+00:00, run_start_date=2024-06-28 00:26:00.871727+00:00, run_end_date=2024-06-28 00:26:02.752331+00:00, run_duration=1.880604, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:25:00+00:00, data_interval_end=2024-06-28 00:26:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:26:02.762232052Z [2024-06-28T00:26:02.761+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:26:00+00:00, run_after=2024-06-28T00:27:00+00:00 2024-06-28T00:26:02.816271518Z [2024-06-28T00:26:02.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:24:00+00:00 exited with status success for try_number 1 2024-06-28T00:26:02.816459166Z [2024-06-28T00:26:02.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:25:00+00:00 exited with status success for try_number 1 2024-06-28T00:26:02.823454954Z [2024-06-28T00:26:02.823+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:25:00+00:00, map_index=-1, run_start_date=2024-06-28 00:26:01.969880+00:00, run_end_date=2024-06-28 00:26:02.356984+00:00, run_duration=0.387104, state=success, executor_state=success, try_number=1, max_tries=1, job_id=507, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:26:00.981402+00:00, queued_by_job_id=2, pid=7414 2024-06-28T00:26:02.823966263Z [2024-06-28T00:26:02.823+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:24:00+00:00, map_index=-1, run_start_date=2024-06-28 00:26:01.992019+00:00, run_end_date=2024-06-28 00:26:02.362852+00:00, run_duration=0.370833, state=success, executor_state=success, try_number=1, max_tries=1, job_id=508, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:26:00.981402+00:00, queued_by_job_id=2, pid=7415 2024-06-28T00:26:06.092744057Z [2024-06-28T00:26:06.092+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:26:06.093776595Z [2024-06-28T00:26:06.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:25:00+00:00, run_id=scheduled__2024-06-28T00:25:00+00:00, run_start_date=2024-06-28 00:26:00.873038+00:00, run_end_date=2024-06-28 00:26:06.092677+00:00, run_duration=5.219639, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:25:00+00:00, data_interval_end=2024-06-28 00:26:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:26:06.123216758Z [2024-06-28T00:26:06.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:26:00+00:00, run_after=2024-06-28T00:27:00+00:00 2024-06-28T00:26:06.130891400Z [2024-06-28T00:26:06.130+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:26:06.131131888Z [2024-06-28T00:26:06.130+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:25:00+00:00, run_id=scheduled__2024-06-28T00:25:00+00:00, run_start_date=2024-06-28 00:26:00.881615+00:00, run_end_date=2024-06-28 00:26:06.130838+00:00, run_duration=5.249223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:25:00+00:00, data_interval_end=2024-06-28 00:26:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:26:06.141357540Z [2024-06-28T00:26:06.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:26:00+00:00, run_after=2024-06-28T00:27:00+00:00 2024-06-28T00:26:06.179725357Z [2024-06-28T00:26:06.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:25:00+00:00 exited with status success for try_number 1 2024-06-28T00:26:06.180793970Z [2024-06-28T00:26:06.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:25:00+00:00 exited with status success for try_number 1 2024-06-28T00:26:06.195536012Z [2024-06-28T00:26:06.194+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:25:00+00:00, map_index=-1, run_start_date=2024-06-28 00:26:03.409952+00:00, run_end_date=2024-06-28 00:26:05.105026+00:00, run_duration=1.695074, state=success, executor_state=success, try_number=1, max_tries=1, job_id=510, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:26:00.981402+00:00, queued_by_job_id=2, pid=7439 2024-06-28T00:26:06.195825782Z [2024-06-28T00:26:06.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:25:00+00:00, map_index=-1, run_start_date=2024-06-28 00:26:03.397516+00:00, run_end_date=2024-06-28 00:26:05.299377+00:00, run_duration=1.901861, state=success, executor_state=success, try_number=1, max_tries=1, job_id=509, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:26:00.981402+00:00, queued_by_job_id=2, pid=7438 2024-06-28T00:26:45.641325937Z [2024-06-28T00:26:45.640+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T00:27:00.516706163Z [2024-06-28T00:27:00.516+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:27:00+00:00, run_after=2024-06-28T00:28:00+00:00 2024-06-28T00:27:00.533528101Z [2024-06-28T00:27:00.533+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:27:00+00:00, run_after=2024-06-28T00:28:00+00:00 2024-06-28T00:27:00.539905312Z [2024-06-28T00:27:00.539+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:27:00.598053483Z [2024-06-28T00:27:00.597+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:27:00.598066654Z 2024-06-28T00:27:00.598069964Z 2024-06-28T00:27:00.598079784Z 2024-06-28T00:27:00.598844947Z [2024-06-28T00:27:00.598+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:27:00.599977888Z [2024-06-28T00:27:00.599+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:27:00.600506456Z [2024-06-28T00:27:00.600+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:27:00.603545643Z [2024-06-28T00:27:00.602+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:27:00.603554586Z 2024-06-28T00:27:00.603557896Z 2024-06-28T00:27:00.603561211Z 2024-06-28T00:27:00.610082470Z [2024-06-28T00:27:00.609+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:27:00.610665031Z [2024-06-28T00:27:00.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:27:00.611211157Z [2024-06-28T00:27:00.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:27:00.611505059Z [2024-06-28T00:27:00.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:27:00.611848886Z [2024-06-28T00:27:00.611+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:27:00.612048062Z [2024-06-28T00:27:00.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:27:00.949658479Z [2024-06-28T00:27:00.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:26:00+00:00 exited with status queued for try_number 1 2024-06-28T00:27:00.949848850Z [2024-06-28T00:27:00.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:26:00+00:00 exited with status queued for try_number 1 2024-06-28T00:27:00.950003079Z [2024-06-28T00:27:00.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:26:00+00:00 exited with status queued for try_number 1 2024-06-28T00:27:00.957406488Z [2024-06-28T00:27:00.957+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18f1f50d-8b56-4513-bae9-b1d52eade11b 2024-06-28T00:27:00.957627401Z [2024-06-28T00:27:00.957+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac0365db-041f-4350-ab4a-57e9cb777b45 2024-06-28T00:27:00.957774907Z [2024-06-28T00:27:00.957+0000] {scheduler_job.py:635} INFO - Setting external_id for to 628ca07b-7b75-4c62-9bb8-d2db5075246a 2024-06-28T00:27:02.188796140Z [2024-06-28T00:27:02.188+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:27:02.189283454Z [2024-06-28T00:27:02.189+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:26:00+00:00, run_id=scheduled__2024-06-28T00:26:00+00:00, run_start_date=2024-06-28 00:27:00.548386+00:00, run_end_date=2024-06-28 00:27:02.188877+00:00, run_duration=1.640491, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:26:00+00:00, data_interval_end=2024-06-28 00:27:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:27:02.202100168Z [2024-06-28T00:27:02.201+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:27:00+00:00, run_after=2024-06-28T00:28:00+00:00 2024-06-28T00:27:02.239365029Z [2024-06-28T00:27:02.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:26:00+00:00 exited with status success for try_number 1 2024-06-28T00:27:02.245919268Z [2024-06-28T00:27:02.245+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:26:00+00:00, map_index=-1, run_start_date=2024-06-28 00:27:01.516876+00:00, run_end_date=2024-06-28 00:27:01.914231+00:00, run_duration=0.397355, state=success, executor_state=success, try_number=1, max_tries=1, job_id=511, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:27:00.605314+00:00, queued_by_job_id=2, pid=7471 2024-06-28T00:27:04.548331361Z [2024-06-28T00:27:04.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:27:04.548531519Z [2024-06-28T00:27:04.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:26:00+00:00, run_id=scheduled__2024-06-28T00:26:00+00:00, run_start_date=2024-06-28 00:27:00.549650+00:00, run_end_date=2024-06-28 00:27:04.548243+00:00, run_duration=3.998593, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:26:00+00:00, data_interval_end=2024-06-28 00:27:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:27:04.557502755Z [2024-06-28T00:27:04.556+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:27:00+00:00, run_after=2024-06-28T00:28:00+00:00 2024-06-28T00:27:04.565518714Z [2024-06-28T00:27:04.564+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:27:04.565676792Z [2024-06-28T00:27:04.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:26:00+00:00, run_id=scheduled__2024-06-28T00:26:00+00:00, run_start_date=2024-06-28 00:27:00.550679+00:00, run_end_date=2024-06-28 00:27:04.565433+00:00, run_duration=4.014754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:26:00+00:00, data_interval_end=2024-06-28 00:27:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:27:04.580992761Z [2024-06-28T00:27:04.580+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:27:00+00:00, run_after=2024-06-28T00:28:00+00:00 2024-06-28T00:27:04.646961356Z [2024-06-28T00:27:04.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:26:00+00:00 exited with status success for try_number 1 2024-06-28T00:27:04.646997339Z [2024-06-28T00:27:04.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:26:00+00:00 exited with status success for try_number 1 2024-06-28T00:27:04.655167490Z [2024-06-28T00:27:04.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:26:00+00:00, map_index=-1, run_start_date=2024-06-28 00:27:02.656998+00:00, run_end_date=2024-06-28 00:27:04.354024+00:00, run_duration=1.697026, state=success, executor_state=success, try_number=1, max_tries=1, job_id=512, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:27:00.605314+00:00, queued_by_job_id=2, pid=7489 2024-06-28T00:27:04.655453955Z [2024-06-28T00:27:04.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:26:00+00:00, map_index=-1, run_start_date=2024-06-28 00:27:02.732219+00:00, run_end_date=2024-06-28 00:27:04.155770+00:00, run_duration=1.423551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=513, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:27:00.605314+00:00, queued_by_job_id=2, pid=7490 2024-06-28T00:28:00.410348089Z [2024-06-28T00:28:00.409+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:28:00+00:00, run_after=2024-06-28T00:29:00+00:00 2024-06-28T00:28:00.455146463Z [2024-06-28T00:28:00.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:28:00+00:00, run_after=2024-06-28T00:29:00+00:00 2024-06-28T00:28:00.469285793Z [2024-06-28T00:28:00.468+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:28:00.483191923Z [2024-06-28T00:28:00.482+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:28:00.588887634Z [2024-06-28T00:28:00.588+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:28:00.588910579Z 2024-06-28T00:28:00.588915914Z 2024-06-28T00:28:00.588919588Z 2024-06-28T00:28:00.588923259Z 2024-06-28T00:28:00.589043426Z [2024-06-28T00:28:00.588+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:28:00.589282511Z [2024-06-28T00:28:00.589+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:28:00.589474964Z [2024-06-28T00:28:00.589+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:28:00.589681203Z [2024-06-28T00:28:00.589+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:28:00.590916359Z [2024-06-28T00:28:00.590+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:28:00.590928917Z 2024-06-28T00:28:00.590933130Z 2024-06-28T00:28:00.590936761Z 2024-06-28T00:28:00.590940686Z 2024-06-28T00:28:00.596251590Z [2024-06-28T00:28:00.595+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:28:00.596383302Z [2024-06-28T00:28:00.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:28:00.596659236Z [2024-06-28T00:28:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:28:00.596784715Z [2024-06-28T00:28:00.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:28:00.597056695Z [2024-06-28T00:28:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:28:00.597242696Z [2024-06-28T00:28:00.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:28:00.597545437Z [2024-06-28T00:28:00.597+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:28:00.597654073Z [2024-06-28T00:28:00.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:28:00.984800793Z [2024-06-28T00:28:00.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:26:00+00:00 exited with status queued for try_number 1 2024-06-28T00:28:00.984927902Z [2024-06-28T00:28:00.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:27:00+00:00 exited with status queued for try_number 1 2024-06-28T00:28:00.985060577Z [2024-06-28T00:28:00.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:27:00+00:00 exited with status queued for try_number 1 2024-06-28T00:28:00.985166117Z [2024-06-28T00:28:00.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:27:00+00:00 exited with status queued for try_number 1 2024-06-28T00:28:00.995943130Z [2024-06-28T00:28:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2cc787c8-5d4d-4724-a2cb-28ce74cc3a3e 2024-06-28T00:28:00.996128194Z [2024-06-28T00:28:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49b1a994-71e8-4bae-9d16-5475af849fdc 2024-06-28T00:28:00.996290548Z [2024-06-28T00:28:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3281860-18de-4a49-961f-fa731bc5f464 2024-06-28T00:28:00.996451801Z [2024-06-28T00:28:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9867fcf2-10b0-493a-b239-ab10b634f0ed 2024-06-28T00:28:02.283804605Z [2024-06-28T00:28:02.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:28:02.284091981Z [2024-06-28T00:28:02.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:26:00+00:00, run_id=scheduled__2024-06-28T00:26:00+00:00, run_start_date=2024-06-28 00:28:00.500608+00:00, run_end_date=2024-06-28 00:28:02.283720+00:00, run_duration=1.783112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:26:00+00:00, data_interval_end=2024-06-28 00:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:28:02.295685309Z [2024-06-28T00:28:02.295+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:28:00+00:00, run_after=2024-06-28T00:30:00+00:00 2024-06-28T00:28:02.309653957Z [2024-06-28T00:28:02.309+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:28:02.309835049Z [2024-06-28T00:28:02.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:27:00+00:00, run_id=scheduled__2024-06-28T00:27:00+00:00, run_start_date=2024-06-28 00:28:00.502067+00:00, run_end_date=2024-06-28 00:28:02.309592+00:00, run_duration=1.807525, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:27:00+00:00, data_interval_end=2024-06-28 00:28:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:28:02.342863391Z [2024-06-28T00:28:02.342+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:28:00+00:00, run_after=2024-06-28T00:29:00+00:00 2024-06-28T00:28:02.390915853Z [2024-06-28T00:28:02.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:26:00+00:00 exited with status success for try_number 1 2024-06-28T00:28:02.390945808Z [2024-06-28T00:28:02.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:27:00+00:00 exited with status success for try_number 1 2024-06-28T00:28:02.400931125Z [2024-06-28T00:28:02.400+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:26:00+00:00, map_index=-1, run_start_date=2024-06-28 00:28:01.550637+00:00, run_end_date=2024-06-28 00:28:01.966032+00:00, run_duration=0.415395, state=success, executor_state=success, try_number=1, max_tries=1, job_id=514, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:28:00.592420+00:00, queued_by_job_id=2, pid=7523 2024-06-28T00:28:02.401079804Z [2024-06-28T00:28:02.400+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:27:00+00:00, map_index=-1, run_start_date=2024-06-28 00:28:01.616299+00:00, run_end_date=2024-06-28 00:28:02.071351+00:00, run_duration=0.455052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=515, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:28:00.592420+00:00, queued_by_job_id=2, pid=7524 2024-06-28T00:28:05.660949341Z [2024-06-28T00:28:05.660+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:28:05.661235959Z [2024-06-28T00:28:05.660+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:27:00+00:00, run_id=scheduled__2024-06-28T00:27:00+00:00, run_start_date=2024-06-28 00:28:00.503272+00:00, run_end_date=2024-06-28 00:28:05.660868+00:00, run_duration=5.157596, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:27:00+00:00, data_interval_end=2024-06-28 00:28:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:28:05.679902563Z [2024-06-28T00:28:05.677+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:28:00+00:00, run_after=2024-06-28T00:29:00+00:00 2024-06-28T00:28:05.689275606Z [2024-06-28T00:28:05.688+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:28:05.689488762Z [2024-06-28T00:28:05.689+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:27:00+00:00, run_id=scheduled__2024-06-28T00:27:00+00:00, run_start_date=2024-06-28 00:28:00.505989+00:00, run_end_date=2024-06-28 00:28:05.689206+00:00, run_duration=5.183217, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:27:00+00:00, data_interval_end=2024-06-28 00:28:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:28:05.702355942Z [2024-06-28T00:28:05.702+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:28:00+00:00, run_after=2024-06-28T00:29:00+00:00 2024-06-28T00:28:05.739246922Z [2024-06-28T00:28:05.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:27:00+00:00 exited with status success for try_number 1 2024-06-28T00:28:05.739287411Z [2024-06-28T00:28:05.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:27:00+00:00 exited with status success for try_number 1 2024-06-28T00:28:05.747629106Z [2024-06-28T00:28:05.747+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:27:00+00:00, map_index=-1, run_start_date=2024-06-28 00:28:03.020751+00:00, run_end_date=2024-06-28 00:28:04.540950+00:00, run_duration=1.520199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=517, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:28:00.592420+00:00, queued_by_job_id=2, pid=7548 2024-06-28T00:28:05.747740332Z [2024-06-28T00:28:05.747+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:27:00+00:00, map_index=-1, run_start_date=2024-06-28 00:28:02.856049+00:00, run_end_date=2024-06-28 00:28:04.631618+00:00, run_duration=1.775569, state=success, executor_state=success, try_number=1, max_tries=1, job_id=516, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:28:00.592420+00:00, queued_by_job_id=2, pid=7547 2024-06-28T00:28:51.317300326Z [2024-06-28T00:28:51.316+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97 to 2024-06-28T00:28:00+00:00, run_after=2024-06-28T00:29:00+00:00 2024-06-28T00:28:51.356729804Z [2024-06-28T00:28:51.356+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:28:51.356763210Z 2024-06-28T00:28:51.357120012Z [2024-06-28T00:28:51.356+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97 has 0/16 running and queued tasks 2024-06-28T00:28:51.358878499Z [2024-06-28T00:28:51.358+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:28:51.358909803Z 2024-06-28T00:28:51.363598290Z [2024-06-28T00:28:51.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:28:51.364217316Z [2024-06-28T00:28:51.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:28:51.453330737Z [2024-06-28T00:28:51.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:27:00+00:00 exited with status queued for try_number 1 2024-06-28T00:28:51.474818654Z [2024-06-28T00:28:51.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to 425d63cc-165c-4a4c-98dc-5f4f3073b306 2024-06-28T00:28:52.940666342Z [2024-06-28T00:28:52.940+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:28:52.941330508Z [2024-06-28T00:28:52.940+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97, execution_date=2024-06-28 00:27:00+00:00, run_id=scheduled__2024-06-28T00:27:00+00:00, run_start_date=2024-06-28 00:28:51.326148+00:00, run_end_date=2024-06-28 00:28:52.940555+00:00, run_duration=1.614407, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:27:00+00:00, data_interval_end=2024-06-28 00:28:00+00:00, dag_hash=a612989749837f7169dda5a2c90d06a5 2024-06-28T00:28:52.967725150Z [2024-06-28T00:28:52.967+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97 to 2024-06-28T00:28:00+00:00, run_after=2024-06-28T00:29:00+00:00 2024-06-28T00:28:53.011763464Z [2024-06-28T00:28:53.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:27:00+00:00 exited with status success for try_number 1 2024-06-28T00:28:53.018106718Z [2024-06-28T00:28:53.017+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:27:00+00:00, map_index=-1, run_start_date=2024-06-28 00:28:52.197674+00:00, run_end_date=2024-06-28 00:28:52.589878+00:00, run_duration=0.392204, state=success, executor_state=success, try_number=1, max_tries=1, job_id=518, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:28:51.359769+00:00, queued_by_job_id=2, pid=7578 2024-06-28T00:29:00.439970514Z [2024-06-28T00:29:00.439+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97 to 2024-06-28T00:29:00+00:00, run_after=2024-06-28T00:30:00+00:00 2024-06-28T00:29:00.447347827Z [2024-06-28T00:29:00.446+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:29:00.461890022Z [2024-06-28T00:29:00.461+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:29:00+00:00, run_after=2024-06-28T00:30:00+00:00 2024-06-28T00:29:00.474359822Z [2024-06-28T00:29:00.474+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:29:00+00:00, run_after=2024-06-28T00:30:00+00:00 2024-06-28T00:29:00.567897600Z [2024-06-28T00:29:00.567+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:29:00.567911175Z 2024-06-28T00:29:00.567914729Z 2024-06-28T00:29:00.567918126Z 2024-06-28T00:29:00.567921650Z 2024-06-28T00:29:00.568154605Z [2024-06-28T00:29:00.567+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:29:00.568337794Z [2024-06-28T00:29:00.568+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:29:00.568510964Z [2024-06-28T00:29:00.568+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:29:00.568781074Z [2024-06-28T00:29:00.568+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97 has 0/16 running and queued tasks 2024-06-28T00:29:00.569524296Z [2024-06-28T00:29:00.569+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:29:00.569536168Z 2024-06-28T00:29:00.569539631Z 2024-06-28T00:29:00.569543051Z 2024-06-28T00:29:00.569560381Z 2024-06-28T00:29:00.573919096Z [2024-06-28T00:29:00.573+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:29:00.574129903Z [2024-06-28T00:29:00.573+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:29:00.574461194Z [2024-06-28T00:29:00.574+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:29:00.574614926Z [2024-06-28T00:29:00.574+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:29:00.575011365Z [2024-06-28T00:29:00.574+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:29:00.575117328Z [2024-06-28T00:29:00.575+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:29:00.575373726Z [2024-06-28T00:29:00.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:29:00.575489876Z [2024-06-28T00:29:00.575+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:29:01.021821646Z [2024-06-28T00:29:01.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:28:00+00:00 exited with status queued for try_number 1 2024-06-28T00:29:01.022200017Z [2024-06-28T00:29:01.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:28:00+00:00 exited with status queued for try_number 1 2024-06-28T00:29:01.022678096Z [2024-06-28T00:29:01.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:28:00+00:00 exited with status queued for try_number 1 2024-06-28T00:29:01.023998640Z [2024-06-28T00:29:01.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:28:00+00:00 exited with status queued for try_number 1 2024-06-28T00:29:01.037542509Z [2024-06-28T00:29:01.037+0000] {scheduler_job.py:635} INFO - Setting external_id for to 251412ad-1d3e-4ca2-ad50-263a68878184 2024-06-28T00:29:01.037946691Z [2024-06-28T00:29:01.037+0000] {scheduler_job.py:635} INFO - Setting external_id for to a90b7859-ad86-4837-bf6b-d9f525acb9e8 2024-06-28T00:29:01.038235587Z [2024-06-28T00:29:01.038+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8855c8d9-9ce8-4791-bf46-01a4826055d8 2024-06-28T00:29:01.044811714Z [2024-06-28T00:29:01.044+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b6a8967-e2a9-4b7c-8d25-fcab4ad939b1 2024-06-28T00:29:03.540467774Z [2024-06-28T00:29:03.540+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:29:03.541059762Z [2024-06-28T00:29:03.540+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97, execution_date=2024-06-28 00:28:00+00:00, run_id=scheduled__2024-06-28T00:28:00+00:00, run_start_date=2024-06-28 00:29:00.486754+00:00, run_end_date=2024-06-28 00:29:03.540417+00:00, run_duration=3.053663, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:28:00+00:00, data_interval_end=2024-06-28 00:29:00+00:00, dag_hash=a612989749837f7169dda5a2c90d06a5 2024-06-28T00:29:03.561613079Z [2024-06-28T00:29:03.561+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97 to 2024-06-28T00:29:00+00:00, run_after=2024-06-28T00:30:00+00:00 2024-06-28T00:29:03.572098044Z [2024-06-28T00:29:03.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:29:03.573207485Z [2024-06-28T00:29:03.572+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:28:00+00:00, run_id=scheduled__2024-06-28T00:28:00+00:00, run_start_date=2024-06-28 00:29:00.486244+00:00, run_end_date=2024-06-28 00:29:03.572037+00:00, run_duration=3.085793, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:28:00+00:00, data_interval_end=2024-06-28 00:29:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:29:03.584748624Z [2024-06-28T00:29:03.584+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:29:00+00:00, run_after=2024-06-28T00:30:00+00:00 2024-06-28T00:29:03.681637525Z [2024-06-28T00:29:03.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:28:00+00:00 exited with status success for try_number 1 2024-06-28T00:29:03.681764152Z [2024-06-28T00:29:03.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:28:00+00:00 exited with status success for try_number 1 2024-06-28T00:29:03.694243718Z [2024-06-28T00:29:03.693+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:28:00+00:00, map_index=-1, run_start_date=2024-06-28 00:29:02.184779+00:00, run_end_date=2024-06-28 00:29:02.618211+00:00, run_duration=0.433432, state=success, executor_state=success, try_number=1, max_tries=1, job_id=520, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:29:00.570868+00:00, queued_by_job_id=2, pid=7599 2024-06-28T00:29:03.694624759Z [2024-06-28T00:29:03.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:28:00+00:00, map_index=-1, run_start_date=2024-06-28 00:29:02.073054+00:00, run_end_date=2024-06-28 00:29:02.767237+00:00, run_duration=0.694183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=519, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:29:00.570868+00:00, queued_by_job_id=2, pid=7598 2024-06-28T00:29:05.636832978Z [2024-06-28T00:29:05.636+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:29:05.637250920Z [2024-06-28T00:29:05.637+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:28:00+00:00, run_id=scheduled__2024-06-28T00:28:00+00:00, run_start_date=2024-06-28 00:29:00.488849+00:00, run_end_date=2024-06-28 00:29:05.636762+00:00, run_duration=5.147913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:28:00+00:00, data_interval_end=2024-06-28 00:29:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:29:05.648194712Z [2024-06-28T00:29:05.647+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:29:00+00:00, run_after=2024-06-28T00:30:00+00:00 2024-06-28T00:29:05.686299009Z [2024-06-28T00:29:05.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:28:00+00:00 exited with status success for try_number 1 2024-06-28T00:29:05.690916729Z [2024-06-28T00:29:05.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:28:00+00:00, map_index=-1, run_start_date=2024-06-28 00:29:03.264913+00:00, run_end_date=2024-06-28 00:29:04.883547+00:00, run_duration=1.618634, state=success, executor_state=success, try_number=1, max_tries=1, job_id=521, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:29:00.570868+00:00, queued_by_job_id=2, pid=7617 2024-06-28T00:29:06.755792262Z [2024-06-28T00:29:06.755+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:29:06.756185675Z [2024-06-28T00:29:06.755+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:28:00+00:00, run_id=scheduled__2024-06-28T00:28:00+00:00, run_start_date=2024-06-28 00:29:00.487820+00:00, run_end_date=2024-06-28 00:29:06.755721+00:00, run_duration=6.267901, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:28:00+00:00, data_interval_end=2024-06-28 00:29:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:29:06.767440419Z [2024-06-28T00:29:06.766+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:29:00+00:00, run_after=2024-06-28T00:30:00+00:00 2024-06-28T00:29:07.910413024Z [2024-06-28T00:29:07.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:28:00+00:00 exited with status success for try_number 1 2024-06-28T00:29:07.915265742Z [2024-06-28T00:29:07.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:28:00+00:00, map_index=-1, run_start_date=2024-06-28 00:29:03.647951+00:00, run_end_date=2024-06-28 00:29:06.656742+00:00, run_duration=3.008791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=522, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:29:00.570868+00:00, queued_by_job_id=2, pid=7628 2024-06-28T00:30:00.370506995Z [2024-06-28T00:30:00.369+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97 to 2024-06-28T00:30:00+00:00, run_after=2024-06-28T00:31:00+00:00 2024-06-28T00:30:00.385177513Z [2024-06-28T00:30:00.384+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:30:00+00:00, run_after=2024-06-28T00:35:00+00:00 2024-06-28T00:30:00.400652619Z [2024-06-28T00:30:00.400+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:30:00.421273080Z [2024-06-28T00:30:00.420+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:30:00+00:00, run_after=2024-06-28T00:31:00+00:00 2024-06-28T00:30:00.437019661Z [2024-06-28T00:30:00.436+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:30:00+00:00, run_after=2024-06-28T00:31:00+00:00 2024-06-28T00:30:00.446942584Z [2024-06-28T00:30:00.446+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:30:00.590816785Z [2024-06-28T00:30:00.590+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-06-28T00:30:00.590846890Z 2024-06-28T00:30:00.590852766Z 2024-06-28T00:30:00.590858446Z 2024-06-28T00:30:00.590863442Z 2024-06-28T00:30:00.590868262Z 2024-06-28T00:30:00.590873314Z 2024-06-28T00:30:00.591380186Z [2024-06-28T00:30:00.591+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:30:00.591652845Z [2024-06-28T00:30:00.591+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:30:00.591897425Z [2024-06-28T00:30:00.591+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:30:00.592139417Z [2024-06-28T00:30:00.591+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:30:00.592440322Z [2024-06-28T00:30:00.592+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:30:00.592676819Z [2024-06-28T00:30:00.592+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97 has 0/16 running and queued tasks 2024-06-28T00:30:00.593626935Z [2024-06-28T00:30:00.593+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:30:00.593643932Z 2024-06-28T00:30:00.593649990Z 2024-06-28T00:30:00.593655386Z 2024-06-28T00:30:00.593660201Z 2024-06-28T00:30:00.593664911Z 2024-06-28T00:30:00.593670090Z 2024-06-28T00:30:00.599157179Z [2024-06-28T00:30:00.598+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T00:30:00.599257483Z [2024-06-28T00:30:00.598+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:30:00.599546349Z [2024-06-28T00:30:00.599+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:30:00.599790121Z [2024-06-28T00:30:00.599+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:30:00.600187615Z [2024-06-28T00:30:00.599+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:30:00.600287367Z [2024-06-28T00:30:00.600+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:30:00.600571506Z [2024-06-28T00:30:00.600+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:30:00.600674643Z [2024-06-28T00:30:00.600+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:30:00.600888034Z [2024-06-28T00:30:00.600+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:30:00.601001858Z [2024-06-28T00:30:00.600+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:30:00.601193368Z [2024-06-28T00:30:00.601+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:30:00.601294999Z [2024-06-28T00:30:00.601+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:30:01.179426881Z [2024-06-28T00:30:01.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:25:00+00:00 exited with status queued for try_number 1 2024-06-28T00:30:01.179740410Z [2024-06-28T00:30:01.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:28:00+00:00 exited with status queued for try_number 1 2024-06-28T00:30:01.179969475Z [2024-06-28T00:30:01.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:29:00+00:00 exited with status queued for try_number 1 2024-06-28T00:30:01.180140443Z [2024-06-28T00:30:01.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:29:00+00:00 exited with status queued for try_number 1 2024-06-28T00:30:01.180269097Z [2024-06-28T00:30:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:29:00+00:00 exited with status queued for try_number 1 2024-06-28T00:30:01.180410037Z [2024-06-28T00:30:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:29:00+00:00 exited with status queued for try_number 1 2024-06-28T00:30:01.196098960Z [2024-06-28T00:30:01.195+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8318d51-d9f3-4b23-a74e-1ce1c5389d58 2024-06-28T00:30:01.197513411Z [2024-06-28T00:30:01.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2040410e-a80e-43d1-9cec-0a66ab067798 2024-06-28T00:30:01.197916320Z [2024-06-28T00:30:01.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf3805fc-c0e8-4a74-affe-c17a7b363634 2024-06-28T00:30:01.198210427Z [2024-06-28T00:30:01.198+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebd02e6d-e8c9-4f5a-975c-944a0e10757d 2024-06-28T00:30:01.198492261Z [2024-06-28T00:30:01.198+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99e0fb1a-6be7-4a50-b405-d02275682ac8 2024-06-28T00:30:01.198767720Z [2024-06-28T00:30:01.198+0000] {scheduler_job.py:635} INFO - Setting external_id for to f05fc831-3feb-4f7f-859f-7092aa20e703 2024-06-28T00:30:02.760364437Z [2024-06-28T00:30:02.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:29:00+00:00 exited with status failed for try_number 1 2024-06-28T00:30:02.772290312Z [2024-06-28T00:30:02.771+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:29:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:30:00.595364+00:00, queued_by_job_id=2, pid=None 2024-06-28T00:30:02.772611580Z [2024-06-28T00:30:02.772+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T00:30:02.787444231Z [2024-06-28T00:30:02.780+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T00:30:02.833719412Z [2024-06-28T00:30:02.833+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240628T002900, start_date=, end_date=20240628T003002 2024-06-28T00:30:03.930491784Z [2024-06-28T00:30:03.929+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:30:03.931379472Z [2024-06-28T00:30:03.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:28:00+00:00, run_id=scheduled__2024-06-28T00:28:00+00:00, run_start_date=2024-06-28 00:30:00.470520+00:00, run_end_date=2024-06-28 00:30:03.930558+00:00, run_duration=3.460038, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:28:00+00:00, data_interval_end=2024-06-28 00:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:30:03.947294855Z [2024-06-28T00:30:03.947+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:30:00+00:00, run_after=2024-06-28T00:32:00+00:00 2024-06-28T00:30:03.957065358Z [2024-06-28T00:30:03.956+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:30:03.957493486Z [2024-06-28T00:30:03.957+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:29:00+00:00, run_id=scheduled__2024-06-28T00:29:00+00:00, run_start_date=2024-06-28 00:30:00.471824+00:00, run_end_date=2024-06-28 00:30:03.957160+00:00, run_duration=3.485336, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:29:00+00:00, data_interval_end=2024-06-28 00:30:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:30:03.980236894Z [2024-06-28T00:30:03.979+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:30:00+00:00, run_after=2024-06-28T00:31:00+00:00 2024-06-28T00:30:04.154354996Z [2024-06-28T00:30:04.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:28:00+00:00 exited with status success for try_number 1 2024-06-28T00:30:04.154396237Z [2024-06-28T00:30:04.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:29:00+00:00 exited with status success for try_number 1 2024-06-28T00:30:04.166337067Z [2024-06-28T00:30:04.165+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:28:00+00:00, map_index=-1, run_start_date=2024-06-28 00:30:01.712797+00:00, run_end_date=2024-06-28 00:30:02.784339+00:00, run_duration=1.071542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=523, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:30:00.595364+00:00, queued_by_job_id=2, pid=7658 2024-06-28T00:30:04.167270387Z [2024-06-28T00:30:04.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:29:00+00:00, map_index=-1, run_start_date=2024-06-28 00:30:02.071446+00:00, run_end_date=2024-06-28 00:30:02.721151+00:00, run_duration=0.649705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=524, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:30:00.595364+00:00, queued_by_job_id=2, pid=7666 2024-06-28T00:30:05.340145973Z [2024-06-28T00:30:05.339+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:30:05.340179937Z 2024-06-28T00:30:05.340786002Z [2024-06-28T00:30:05.340+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:30:05.341988481Z [2024-06-28T00:30:05.341+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:30:05.342008391Z 2024-06-28T00:30:05.346065220Z [2024-06-28T00:30:05.345+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T00:30:05.346474843Z [2024-06-28T00:30:05.346+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:30:05.440702013Z [2024-06-28T00:30:05.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:25:00+00:00 exited with status queued for try_number 1 2024-06-28T00:30:05.440880517Z [2024-06-28T00:30:05.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:25:00+00:00 exited with status success for try_number 1 2024-06-28T00:30:05.449939320Z [2024-06-28T00:30:05.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bdb5d4a-0a37-4c10-b9f8-e2b7fdf650e0 2024-06-28T00:30:05.450877969Z [2024-06-28T00:30:05.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T00:25:00+00:00, map_index=-1, run_start_date=2024-06-28 00:30:03.683788+00:00, run_end_date=2024-06-28 00:30:04.380327+00:00, run_duration=0.696539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=525, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:30:00.595364+00:00, queued_by_job_id=2, pid=7693 2024-06-28T00:30:05.594966659Z [2024-06-28T00:30:05.594+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:30:05.597489875Z [2024-06-28T00:30:05.597+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:29:00+00:00, run_id=scheduled__2024-06-28T00:29:00+00:00, run_start_date=2024-06-28 00:30:00.474408+00:00, run_end_date=2024-06-28 00:30:05.597016+00:00, run_duration=5.122608, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:29:00+00:00, data_interval_end=2024-06-28 00:30:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:30:05.644241684Z [2024-06-28T00:30:05.643+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:30:00+00:00, run_after=2024-06-28T00:31:00+00:00 2024-06-28T00:30:05.927360103Z [2024-06-28T00:30:05.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:29:00+00:00 exited with status success for try_number 1 2024-06-28T00:30:05.938680156Z [2024-06-28T00:30:05.937+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:29:00+00:00, map_index=-1, run_start_date=2024-06-28 00:30:03.846920+00:00, run_end_date=2024-06-28 00:30:05.474165+00:00, run_duration=1.627245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=526, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:30:00.595364+00:00, queued_by_job_id=2, pid=7699 2024-06-28T00:30:06.347742843Z [2024-06-28T00:30:06.347+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:30:06.351069709Z [2024-06-28T00:30:06.347+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:29:00+00:00, run_id=scheduled__2024-06-28T00:29:00+00:00, run_start_date=2024-06-28 00:30:00.475816+00:00, run_end_date=2024-06-28 00:30:06.347665+00:00, run_duration=5.871849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:29:00+00:00, data_interval_end=2024-06-28 00:30:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:30:06.449437977Z [2024-06-28T00:30:06.437+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:30:00+00:00, run_after=2024-06-28T00:31:00+00:00 2024-06-28T00:30:06.630067522Z [2024-06-28T00:30:06.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:29:00+00:00 exited with status success for try_number 1 2024-06-28T00:30:06.637210600Z [2024-06-28T00:30:06.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:29:00+00:00, map_index=-1, run_start_date=2024-06-28 00:30:04.157824+00:00, run_end_date=2024-06-28 00:30:06.104595+00:00, run_duration=1.946771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=527, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:30:00.595364+00:00, queued_by_job_id=2, pid=7700 2024-06-28T00:30:08.391245182Z [2024-06-28T00:30:08.390+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:30:08.391264423Z 2024-06-28T00:30:08.391698625Z [2024-06-28T00:30:08.391+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:30:08.392655668Z [2024-06-28T00:30:08.392+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:30:08.392664890Z 2024-06-28T00:30:08.399593441Z [2024-06-28T00:30:08.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T00:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T00:30:08.399954291Z [2024-06-28T00:30:08.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T00:30:08.469577751Z [2024-06-28T00:30:08.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:25:00+00:00 exited with status queued for try_number 1 2024-06-28T00:30:08.469722581Z [2024-06-28T00:30:08.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:25:00+00:00 exited with status success for try_number 1 2024-06-28T00:30:08.482083413Z [2024-06-28T00:30:08.481+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94034428-7b99-4f80-8cea-33fdca1179e7 2024-06-28T00:30:08.482277972Z [2024-06-28T00:30:08.482+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T00:25:00+00:00, map_index=-1, run_start_date=2024-06-28 00:30:07.584495+00:00, run_end_date=2024-06-28 00:30:08.074591+00:00, run_duration=0.490096, state=success, executor_state=success, try_number=1, max_tries=1, job_id=528, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:30:05.342647+00:00, queued_by_job_id=2, pid=7723 2024-06-28T00:30:10.788287437Z [2024-06-28T00:30:10.787+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:30:10.788312313Z 2024-06-28T00:30:10.788548557Z [2024-06-28T00:30:10.788+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:30:10.789545264Z [2024-06-28T00:30:10.789+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:30:10.789588476Z 2024-06-28T00:30:10.795552892Z [2024-06-28T00:30:10.795+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:30:10.796366115Z [2024-06-28T00:30:10.796+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:30:10.847682509Z [2024-06-28T00:30:10.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:25:00+00:00 exited with status queued for try_number 1 2024-06-28T00:30:10.847915746Z [2024-06-28T00:30:10.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:25:00+00:00 exited with status success for try_number 1 2024-06-28T00:30:10.854533130Z [2024-06-28T00:30:10.854+0000] {scheduler_job.py:635} INFO - Setting external_id for to 543ddaf7-78ea-4134-9341-dfe0e846e077 2024-06-28T00:30:10.854971727Z [2024-06-28T00:30:10.854+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T00:25:00+00:00, map_index=0, run_start_date=2024-06-28 00:30:10.285533+00:00, run_end_date=2024-06-28 00:30:10.599577+00:00, run_duration=0.314044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=529, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:30:08.393275+00:00, queued_by_job_id=2, pid=7731 2024-06-28T00:30:12.952859718Z [2024-06-28T00:30:12.952+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:30:12.952891493Z 2024-06-28T00:30:12.953010095Z [2024-06-28T00:30:12.952+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97 has 0/16 running and queued tasks 2024-06-28T00:30:12.953632183Z [2024-06-28T00:30:12.953+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:30:12.953649830Z 2024-06-28T00:30:12.956200121Z [2024-06-28T00:30:12.955+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:29:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:30:12.956332591Z [2024-06-28T00:30:12.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:30:13.023786288Z [2024-06-28T00:30:13.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:29:00+00:00 exited with status queued for try_number 2 2024-06-28T00:30:13.029205132Z [2024-06-28T00:30:13.028+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d3a1fad-8af3-4609-905f-21266377f1ae 2024-06-28T00:30:13.098552305Z [2024-06-28T00:30:13.098+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:30:13.101315929Z [2024-06-28T00:30:13.099+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:25:00+00:00, run_id=scheduled__2024-06-28T00:25:00+00:00, run_start_date=2024-06-28 00:30:00.468932+00:00, run_end_date=2024-06-28 00:30:13.099421+00:00, run_duration=12.630489, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:25:00+00:00, data_interval_end=2024-06-28 00:30:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T00:30:13.114817881Z [2024-06-28T00:30:13.113+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:30:00+00:00, run_after=2024-06-28T00:35:00+00:00 2024-06-28T00:30:14.294330725Z [2024-06-28T00:30:14.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:25:00+00:00 exited with status success for try_number 1 2024-06-28T00:30:14.294516929Z [2024-06-28T00:30:14.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:29:00+00:00 exited with status failed for try_number 2 2024-06-28T00:30:14.307726372Z [2024-06-28T00:30:14.307+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:29:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-06-28 00:30:02.804837+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:30:12.953998+00:00, queued_by_job_id=2, pid=None 2024-06-28T00:30:14.308364153Z [2024-06-28T00:30:14.308+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T00:30:14.311482363Z [2024-06-28T00:30:14.311+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T00:30:14.325288624Z [2024-06-28T00:30:14.324+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240628T002900, start_date=, end_date=20240628T003014 2024-06-28T00:30:14.333744597Z [2024-06-28T00:30:14.333+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T00:25:00+00:00, map_index=-1, run_start_date=2024-06-28 00:30:12.511470+00:00, run_end_date=2024-06-28 00:30:12.921341+00:00, run_duration=0.409871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=530, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:30:10.790189+00:00, queued_by_job_id=2, pid=7739 2024-06-28T00:30:15.379931700Z [2024-06-28T00:30:15.379+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-28T00:30:15.380387948Z [2024-06-28T00:30:15.380+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97, execution_date=2024-06-28 00:29:00+00:00, run_id=scheduled__2024-06-28T00:29:00+00:00, run_start_date=2024-06-28 00:30:00.473048+00:00, run_end_date=2024-06-28 00:30:15.380064+00:00, run_duration=14.907016, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:29:00+00:00, data_interval_end=2024-06-28 00:30:00+00:00, dag_hash=a612989749837f7169dda5a2c90d06a5 2024-06-28T00:30:15.388982649Z [2024-06-28T00:30:15.388+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97 to 2024-06-28T00:30:00+00:00, run_after=2024-06-28T00:31:00+00:00 2024-06-28T00:31:00.912261239Z [2024-06-28T00:31:00.911+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:31:00.925519561Z [2024-06-28T00:31:00.925+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:31:00+00:00, run_after=2024-06-28T00:32:00+00:00 2024-06-28T00:31:00.943247777Z [2024-06-28T00:31:00.942+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:31:00+00:00, run_after=2024-06-28T00:32:00+00:00 2024-06-28T00:31:00.971484152Z [2024-06-28T00:31:00.971+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97 to 2024-06-28T00:31:00+00:00, run_after=2024-06-28T00:32:00+00:00 2024-06-28T00:31:01.080015920Z [2024-06-28T00:31:01.079+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:31:01.080036518Z 2024-06-28T00:31:01.080039975Z 2024-06-28T00:31:01.080043091Z 2024-06-28T00:31:01.080046075Z 2024-06-28T00:31:01.080096393Z [2024-06-28T00:31:01.079+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:31:01.080100553Z [2024-06-28T00:31:01.080+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97 has 0/16 running and queued tasks 2024-06-28T00:31:01.080160436Z [2024-06-28T00:31:01.080+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:31:01.080227424Z [2024-06-28T00:31:01.080+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:31:01.080739225Z [2024-06-28T00:31:01.080+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:31:01.080755004Z 2024-06-28T00:31:01.080758825Z 2024-06-28T00:31:01.080762006Z 2024-06-28T00:31:01.080765067Z 2024-06-28T00:31:01.086898707Z [2024-06-28T00:31:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:31:01.086989877Z [2024-06-28T00:31:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:31:01.087216380Z [2024-06-28T00:31:01.087+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:31:01.087358707Z [2024-06-28T00:31:01.087+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:31:01.087533585Z [2024-06-28T00:31:01.087+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:31:01.087597630Z [2024-06-28T00:31:01.087+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:31:01.087770498Z [2024-06-28T00:31:01.087+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:31:01.087830387Z [2024-06-28T00:31:01.087+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:31:01.713515359Z [2024-06-28T00:31:01.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status queued for try_number 1 2024-06-28T00:31:01.713770680Z [2024-06-28T00:31:01.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status queued for try_number 1 2024-06-28T00:31:01.726703968Z [2024-06-28T00:31:01.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status queued for try_number 1 2024-06-28T00:31:01.728110891Z [2024-06-28T00:31:01.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status queued for try_number 1 2024-06-28T00:31:01.743542129Z [2024-06-28T00:31:01.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to 122a75c1-c575-48d1-b811-a9d5e31b0b98 2024-06-28T00:31:01.743794221Z [2024-06-28T00:31:01.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7aa32bf4-5a71-477e-ab44-162b95bcb870 2024-06-28T00:31:01.744010044Z [2024-06-28T00:31:01.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to efe02a01-a69c-41f0-bada-90b1fca8c39f 2024-06-28T00:31:01.744156569Z [2024-06-28T00:31:01.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54cc7af2-87a8-4c21-8c71-180826f1e1c5 2024-06-28T00:31:02.591957872Z [2024-06-28T00:31:02.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status failed for try_number 1 2024-06-28T00:31:02.599112980Z [2024-06-28T00:31:02.598+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:30:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:31:01.084350+00:00, queued_by_job_id=2, pid=None 2024-06-28T00:31:02.599798076Z [2024-06-28T00:31:02.599+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T00:31:02.602950447Z [2024-06-28T00:31:02.602+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T00:31:02.616860306Z [2024-06-28T00:31:02.616+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240628T003000, start_date=, end_date=20240628T003102 2024-06-28T00:31:03.719983603Z [2024-06-28T00:31:03.719+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:31:03.720719337Z [2024-06-28T00:31:03.720+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:30:00+00:00, run_id=scheduled__2024-06-28T00:30:00+00:00, run_start_date=2024-06-28 00:31:00.988675+00:00, run_end_date=2024-06-28 00:31:03.719844+00:00, run_duration=2.731169, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:30:00+00:00, data_interval_end=2024-06-28 00:31:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:31:03.736833319Z [2024-06-28T00:31:03.736+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:31:00+00:00, run_after=2024-06-28T00:32:00+00:00 2024-06-28T00:31:03.809264432Z [2024-06-28T00:31:03.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status success for try_number 1 2024-06-28T00:31:03.818849208Z [2024-06-28T00:31:03.815+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:30:00+00:00, map_index=-1, run_start_date=2024-06-28 00:31:02.379398+00:00, run_end_date=2024-06-28 00:31:02.796799+00:00, run_duration=0.417401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=531, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:31:01.084350+00:00, queued_by_job_id=2, pid=7783 2024-06-28T00:31:05.976268240Z [2024-06-28T00:31:05.975+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:31:05.976536462Z [2024-06-28T00:31:05.976+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:30:00+00:00, run_id=scheduled__2024-06-28T00:30:00+00:00, run_start_date=2024-06-28 00:31:00.991516+00:00, run_end_date=2024-06-28 00:31:05.976155+00:00, run_duration=4.984639, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:30:00+00:00, data_interval_end=2024-06-28 00:31:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:31:05.986801650Z [2024-06-28T00:31:05.986+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:31:00+00:00, run_after=2024-06-28T00:32:00+00:00 2024-06-28T00:31:05.995376358Z [2024-06-28T00:31:05.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:31:05.996754197Z [2024-06-28T00:31:05.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:30:00+00:00, run_id=scheduled__2024-06-28T00:30:00+00:00, run_start_date=2024-06-28 00:31:00.993495+00:00, run_end_date=2024-06-28 00:31:05.996351+00:00, run_duration=5.002856, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:30:00+00:00, data_interval_end=2024-06-28 00:31:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:31:06.015215800Z [2024-06-28T00:31:06.014+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:31:00+00:00, run_after=2024-06-28T00:32:00+00:00 2024-06-28T00:31:06.059744140Z [2024-06-28T00:31:06.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status success for try_number 1 2024-06-28T00:31:06.059879041Z [2024-06-28T00:31:06.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status success for try_number 1 2024-06-28T00:31:06.065764810Z [2024-06-28T00:31:06.065+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:30:00+00:00, map_index=-1, run_start_date=2024-06-28 00:31:03.476367+00:00, run_end_date=2024-06-28 00:31:05.284516+00:00, run_duration=1.808149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=533, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:31:01.084350+00:00, queued_by_job_id=2, pid=7802 2024-06-28T00:31:06.066037525Z [2024-06-28T00:31:06.065+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:30:00+00:00, map_index=-1, run_start_date=2024-06-28 00:31:03.409654+00:00, run_end_date=2024-06-28 00:31:05.744136+00:00, run_duration=2.334482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=532, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:31:01.084350+00:00, queued_by_job_id=2, pid=7801 2024-06-28T00:31:12.849730129Z [2024-06-28T00:31:12.849+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:31:12.849761306Z 2024-06-28T00:31:12.851810458Z [2024-06-28T00:31:12.850+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97 has 0/16 running and queued tasks 2024-06-28T00:31:12.853334826Z [2024-06-28T00:31:12.853+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:31:12.853346884Z 2024-06-28T00:31:12.860042806Z [2024-06-28T00:31:12.859+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:30:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:31:12.860345805Z [2024-06-28T00:31:12.860+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:31:12.932432527Z [2024-06-28T00:31:12.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status queued for try_number 2 2024-06-28T00:31:12.938404922Z [2024-06-28T00:31:12.938+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a8fb75b-f63c-451a-94d9-f1701d2184cb 2024-06-28T00:31:14.111663266Z [2024-06-28T00:31:14.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status failed for try_number 2 2024-06-28T00:31:14.119504917Z [2024-06-28T00:31:14.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:30:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-06-28 00:31:02.605465+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:31:12.854299+00:00, queued_by_job_id=2, pid=None 2024-06-28T00:31:14.120064340Z [2024-06-28T00:31:14.119+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T00:31:14.122501058Z [2024-06-28T00:31:14.122+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T00:31:14.136702648Z [2024-06-28T00:31:14.136+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240628T003000, start_date=, end_date=20240628T003114 2024-06-28T00:31:15.211778978Z [2024-06-28T00:31:15.211+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-28T00:31:15.212725853Z [2024-06-28T00:31:15.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97, execution_date=2024-06-28 00:30:00+00:00, run_id=scheduled__2024-06-28T00:30:00+00:00, run_start_date=2024-06-28 00:31:00.990419+00:00, run_end_date=2024-06-28 00:31:15.212290+00:00, run_duration=14.221871, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:30:00+00:00, data_interval_end=2024-06-28 00:31:00+00:00, dag_hash=a612989749837f7169dda5a2c90d06a5 2024-06-28T00:31:15.226907218Z [2024-06-28T00:31:15.226+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_834887a9-7ba5-4e47-a0f3-0ee6e2362e97 to 2024-06-28T00:31:00+00:00, run_after=2024-06-28T00:32:00+00:00 2024-06-28T00:31:45.703541395Z [2024-06-28T00:31:45.703+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T00:32:00.265753113Z [2024-06-28T00:32:00.265+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:32:00+00:00, run_after=2024-06-28T00:33:00+00:00 2024-06-28T00:32:00.275222422Z [2024-06-28T00:32:00.274+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:32:00.288045595Z [2024-06-28T00:32:00.287+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:32:00+00:00, run_after=2024-06-28T00:33:00+00:00 2024-06-28T00:32:00.294828460Z [2024-06-28T00:32:00.294+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:32:00.359447712Z [2024-06-28T00:32:00.359+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:32:00.359512271Z 2024-06-28T00:32:00.359518193Z 2024-06-28T00:32:00.359571192Z 2024-06-28T00:32:00.359576545Z 2024-06-28T00:32:00.359592664Z [2024-06-28T00:32:00.359+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:32:00.359638211Z [2024-06-28T00:32:00.359+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:32:00.359653460Z [2024-06-28T00:32:00.359+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:32:00.359708745Z [2024-06-28T00:32:00.359+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:32:00.360594055Z [2024-06-28T00:32:00.360+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:32:00.360606474Z 2024-06-28T00:32:00.360626393Z 2024-06-28T00:32:00.360630581Z 2024-06-28T00:32:00.360634862Z 2024-06-28T00:32:00.363871175Z [2024-06-28T00:32:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:32:00.363935420Z [2024-06-28T00:32:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:32:00.364130926Z [2024-06-28T00:32:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:32:00.364143729Z [2024-06-28T00:32:00.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:32:00.364389188Z [2024-06-28T00:32:00.364+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:32:00.364402962Z [2024-06-28T00:32:00.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:32:00.364593784Z [2024-06-28T00:32:00.364+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:32:00.364639998Z [2024-06-28T00:32:00.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:32:00.851713465Z [2024-06-28T00:32:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status queued for try_number 1 2024-06-28T00:32:00.852403899Z [2024-06-28T00:32:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:31:00+00:00 exited with status queued for try_number 1 2024-06-28T00:32:00.852733171Z [2024-06-28T00:32:00.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:31:00+00:00 exited with status queued for try_number 1 2024-06-28T00:32:00.852925119Z [2024-06-28T00:32:00.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:31:00+00:00 exited with status queued for try_number 1 2024-06-28T00:32:00.866721752Z [2024-06-28T00:32:00.866+0000] {scheduler_job.py:635} INFO - Setting external_id for to 259edf2e-48bb-4ebe-a325-0425834ddb87 2024-06-28T00:32:00.867267589Z [2024-06-28T00:32:00.866+0000] {scheduler_job.py:635} INFO - Setting external_id for to c11f4ad6-cd61-4ba8-b37f-23f1302f455c 2024-06-28T00:32:00.867551803Z [2024-06-28T00:32:00.867+0000] {scheduler_job.py:635} INFO - Setting external_id for to f07be74f-9990-443a-ae81-d4efa3294433 2024-06-28T00:32:00.867788332Z [2024-06-28T00:32:00.867+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fe5f31c-9b54-4e4e-8346-384d513c651c 2024-06-28T00:32:02.141635139Z [2024-06-28T00:32:02.141+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:32:02.142104542Z [2024-06-28T00:32:02.141+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:30:00+00:00, run_id=scheduled__2024-06-28T00:30:00+00:00, run_start_date=2024-06-28 00:32:00.303621+00:00, run_end_date=2024-06-28 00:32:02.141516+00:00, run_duration=1.837895, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:30:00+00:00, data_interval_end=2024-06-28 00:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:32:02.150392197Z [2024-06-28T00:32:02.150+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:32:00+00:00, run_after=2024-06-28T00:34:00+00:00 2024-06-28T00:32:02.158458608Z [2024-06-28T00:32:02.158+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:32:02.158867380Z [2024-06-28T00:32:02.158+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:31:00+00:00, run_id=scheduled__2024-06-28T00:31:00+00:00, run_start_date=2024-06-28 00:32:00.304706+00:00, run_end_date=2024-06-28 00:32:02.158371+00:00, run_duration=1.853665, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:31:00+00:00, data_interval_end=2024-06-28 00:32:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:32:02.169437677Z [2024-06-28T00:32:02.169+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:32:00+00:00, run_after=2024-06-28T00:33:00+00:00 2024-06-28T00:32:02.255979335Z [2024-06-28T00:32:02.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status success for try_number 1 2024-06-28T00:32:02.256220293Z [2024-06-28T00:32:02.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:31:00+00:00 exited with status success for try_number 1 2024-06-28T00:32:02.275900324Z [2024-06-28T00:32:02.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:30:00+00:00, map_index=-1, run_start_date=2024-06-28 00:32:01.355578+00:00, run_end_date=2024-06-28 00:32:01.814832+00:00, run_duration=0.459254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=535, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:32:00.361431+00:00, queued_by_job_id=2, pid=7846 2024-06-28T00:32:02.276128093Z [2024-06-28T00:32:02.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:31:00+00:00, map_index=-1, run_start_date=2024-06-28 00:32:01.278025+00:00, run_end_date=2024-06-28 00:32:01.732762+00:00, run_duration=0.454737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=534, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:32:00.361431+00:00, queued_by_job_id=2, pid=7845 2024-06-28T00:32:04.930585836Z [2024-06-28T00:32:04.930+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:32:04.930879166Z [2024-06-28T00:32:04.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:31:00+00:00, run_id=scheduled__2024-06-28T00:31:00+00:00, run_start_date=2024-06-28 00:32:00.305636+00:00, run_end_date=2024-06-28 00:32:04.930375+00:00, run_duration=4.624739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:31:00+00:00, data_interval_end=2024-06-28 00:32:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:32:04.948643330Z [2024-06-28T00:32:04.948+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:32:00+00:00, run_after=2024-06-28T00:33:00+00:00 2024-06-28T00:32:05.048706723Z [2024-06-28T00:32:05.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:31:00+00:00 exited with status success for try_number 1 2024-06-28T00:32:05.057729573Z [2024-06-28T00:32:05.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:31:00+00:00, map_index=-1, run_start_date=2024-06-28 00:32:02.588528+00:00, run_end_date=2024-06-28 00:32:04.514986+00:00, run_duration=1.926458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=536, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:32:00.361431+00:00, queued_by_job_id=2, pid=7869 2024-06-28T00:32:06.140090624Z [2024-06-28T00:32:06.139+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:32:06.140576305Z [2024-06-28T00:32:06.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:31:00+00:00, run_id=scheduled__2024-06-28T00:31:00+00:00, run_start_date=2024-06-28 00:32:00.306561+00:00, run_end_date=2024-06-28 00:32:06.139979+00:00, run_duration=5.833418, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:31:00+00:00, data_interval_end=2024-06-28 00:32:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:32:06.154737198Z [2024-06-28T00:32:06.154+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:32:00+00:00, run_after=2024-06-28T00:33:00+00:00 2024-06-28T00:32:06.210629009Z [2024-06-28T00:32:06.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:31:00+00:00 exited with status success for try_number 1 2024-06-28T00:32:06.217125964Z [2024-06-28T00:32:06.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:31:00+00:00, map_index=-1, run_start_date=2024-06-28 00:32:02.785927+00:00, run_end_date=2024-06-28 00:32:05.109995+00:00, run_duration=2.324068, state=success, executor_state=success, try_number=1, max_tries=1, job_id=537, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:32:00.361431+00:00, queued_by_job_id=2, pid=7870 2024-06-28T00:33:00.803309644Z [2024-06-28T00:33:00.802+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:33:00.821384829Z [2024-06-28T00:33:00.820+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:33:00+00:00, run_after=2024-06-28T00:34:00+00:00 2024-06-28T00:33:00.834290607Z [2024-06-28T00:33:00.833+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:33:00+00:00, run_after=2024-06-28T00:34:00+00:00 2024-06-28T00:33:00.895369443Z [2024-06-28T00:33:00.894+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:33:00.895469586Z 2024-06-28T00:33:00.895481210Z 2024-06-28T00:33:00.895490236Z 2024-06-28T00:33:00.895567666Z [2024-06-28T00:33:00.895+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:33:00.895638144Z [2024-06-28T00:33:00.895+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:33:00.895659736Z [2024-06-28T00:33:00.895+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:33:00.896219105Z [2024-06-28T00:33:00.895+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:33:00.896282108Z 2024-06-28T00:33:00.896294288Z 2024-06-28T00:33:00.896304075Z 2024-06-28T00:33:00.899486532Z [2024-06-28T00:33:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:33:00.899550220Z [2024-06-28T00:33:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:33:00.899763261Z [2024-06-28T00:33:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:33:00.899783948Z [2024-06-28T00:33:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:33:00.900006203Z [2024-06-28T00:33:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:33:00.900036420Z [2024-06-28T00:33:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:33:01.242549525Z [2024-06-28T00:33:01.242+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:32:00+00:00 exited with status queued for try_number 1 2024-06-28T00:33:01.243207093Z [2024-06-28T00:33:01.242+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:32:00+00:00 exited with status queued for try_number 1 2024-06-28T00:33:01.243219683Z [2024-06-28T00:33:01.242+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:32:00+00:00 exited with status queued for try_number 1 2024-06-28T00:33:01.256696164Z [2024-06-28T00:33:01.256+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51091475-199e-4c56-929b-e44a96723619 2024-06-28T00:33:01.257252280Z [2024-06-28T00:33:01.256+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d3a817c-9c77-4972-9c5c-82d75b8176c4 2024-06-28T00:33:01.257500290Z [2024-06-28T00:33:01.257+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25e2c792-7530-4d38-bbc9-2553c14e51b6 2024-06-28T00:33:03.494005779Z [2024-06-28T00:33:03.493+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:33:03.494396741Z [2024-06-28T00:33:03.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:32:00+00:00, run_id=scheduled__2024-06-28T00:32:00+00:00, run_start_date=2024-06-28 00:33:00.845225+00:00, run_end_date=2024-06-28 00:33:03.493911+00:00, run_duration=2.648686, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:32:00+00:00, data_interval_end=2024-06-28 00:33:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:33:03.503537938Z [2024-06-28T00:33:03.503+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:33:00+00:00, run_after=2024-06-28T00:34:00+00:00 2024-06-28T00:33:03.557496376Z [2024-06-28T00:33:03.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:32:00+00:00 exited with status success for try_number 1 2024-06-28T00:33:03.565069963Z [2024-06-28T00:33:03.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:32:00+00:00, map_index=-1, run_start_date=2024-06-28 00:33:01.880360+00:00, run_end_date=2024-06-28 00:33:02.348813+00:00, run_duration=0.468453, state=success, executor_state=success, try_number=1, max_tries=1, job_id=538, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:33:00.896708+00:00, queued_by_job_id=2, pid=7902 2024-06-28T00:33:04.603215705Z [2024-06-28T00:33:04.602+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:33:04.603585990Z [2024-06-28T00:33:04.603+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:32:00+00:00, run_id=scheduled__2024-06-28T00:32:00+00:00, run_start_date=2024-06-28 00:33:00.846868+00:00, run_end_date=2024-06-28 00:33:04.603159+00:00, run_duration=3.756291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:32:00+00:00, data_interval_end=2024-06-28 00:33:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:33:04.617523453Z [2024-06-28T00:33:04.612+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:33:00+00:00, run_after=2024-06-28T00:34:00+00:00 2024-06-28T00:33:04.898367413Z [2024-06-28T00:33:04.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:32:00+00:00 exited with status success for try_number 1 2024-06-28T00:33:04.903429345Z [2024-06-28T00:33:04.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:32:00+00:00, map_index=-1, run_start_date=2024-06-28 00:33:02.917083+00:00, run_end_date=2024-06-28 00:33:04.535315+00:00, run_duration=1.618232, state=success, executor_state=success, try_number=1, max_tries=1, job_id=539, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:33:00.896708+00:00, queued_by_job_id=2, pid=7920 2024-06-28T00:33:06.016801967Z [2024-06-28T00:33:06.016+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:33:06.016978243Z [2024-06-28T00:33:06.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:32:00+00:00, run_id=scheduled__2024-06-28T00:32:00+00:00, run_start_date=2024-06-28 00:33:00.848055+00:00, run_end_date=2024-06-28 00:33:06.016719+00:00, run_duration=5.168664, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:32:00+00:00, data_interval_end=2024-06-28 00:33:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:33:06.041037574Z [2024-06-28T00:33:06.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:33:00+00:00, run_after=2024-06-28T00:34:00+00:00 2024-06-28T00:33:06.102413879Z [2024-06-28T00:33:06.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:32:00+00:00 exited with status success for try_number 1 2024-06-28T00:33:06.124378162Z [2024-06-28T00:33:06.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:32:00+00:00, map_index=-1, run_start_date=2024-06-28 00:33:02.964500+00:00, run_end_date=2024-06-28 00:33:05.429948+00:00, run_duration=2.465448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=540, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:33:00.896708+00:00, queued_by_job_id=2, pid=7921 2024-06-28T00:34:00.055381398Z [2024-06-28T00:34:00.055+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:34:00.063368780Z [2024-06-28T00:34:00.063+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:34:00.076152305Z [2024-06-28T00:34:00.075+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:34:00+00:00, run_after=2024-06-28T00:35:00+00:00 2024-06-28T00:34:00.087461066Z [2024-06-28T00:34:00.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:34:00+00:00, run_after=2024-06-28T00:35:00+00:00 2024-06-28T00:34:00.169331516Z [2024-06-28T00:34:00.168+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:34:00.169361422Z 2024-06-28T00:34:00.169391429Z 2024-06-28T00:34:00.169433292Z 2024-06-28T00:34:00.169442511Z 2024-06-28T00:34:00.169466472Z [2024-06-28T00:34:00.169+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:34:00.169697754Z [2024-06-28T00:34:00.169+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:34:00.169963770Z [2024-06-28T00:34:00.169+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:34:00.170190679Z [2024-06-28T00:34:00.169+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:34:00.171878492Z [2024-06-28T00:34:00.171+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:34:00.171925194Z 2024-06-28T00:34:00.171936002Z 2024-06-28T00:34:00.171944461Z 2024-06-28T00:34:00.171953126Z 2024-06-28T00:34:00.178118597Z [2024-06-28T00:34:00.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:34:00.178273035Z [2024-06-28T00:34:00.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:34:00.178808059Z [2024-06-28T00:34:00.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:34:00.178955965Z [2024-06-28T00:34:00.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:34:00.179158126Z [2024-06-28T00:34:00.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:34:00.179411866Z [2024-06-28T00:34:00.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:34:00.179652370Z [2024-06-28T00:34:00.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:34:00.179792575Z [2024-06-28T00:34:00.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:34:00.501004757Z [2024-06-28T00:34:00.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:32:00+00:00 exited with status queued for try_number 1 2024-06-28T00:34:00.501154012Z [2024-06-28T00:34:00.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:33:00+00:00 exited with status queued for try_number 1 2024-06-28T00:34:00.501292196Z [2024-06-28T00:34:00.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:33:00+00:00 exited with status queued for try_number 1 2024-06-28T00:34:00.501403960Z [2024-06-28T00:34:00.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:33:00+00:00 exited with status queued for try_number 1 2024-06-28T00:34:00.516389429Z [2024-06-28T00:34:00.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66127645-8fe3-4be1-acad-7f376031bbc3 2024-06-28T00:34:00.520823279Z [2024-06-28T00:34:00.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbb5d77e-1a66-4105-97c1-ce329c106e03 2024-06-28T00:34:00.521111258Z [2024-06-28T00:34:00.520+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0e3f07a-1dd3-4334-a02c-f1889594b711 2024-06-28T00:34:00.521123753Z [2024-06-28T00:34:00.520+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb00277e-449f-4717-84a6-74a744401930 2024-06-28T00:34:02.084978772Z [2024-06-28T00:34:02.084+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:34:02.085205783Z [2024-06-28T00:34:02.085+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:32:00+00:00, run_id=scheduled__2024-06-28T00:32:00+00:00, run_start_date=2024-06-28 00:34:00.098475+00:00, run_end_date=2024-06-28 00:34:02.084902+00:00, run_duration=1.986427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:32:00+00:00, data_interval_end=2024-06-28 00:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:34:02.095747327Z [2024-06-28T00:34:02.095+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:34:00+00:00, run_after=2024-06-28T00:36:00+00:00 2024-06-28T00:34:02.112259783Z [2024-06-28T00:34:02.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:34:02.112633978Z [2024-06-28T00:34:02.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:33:00+00:00, run_id=scheduled__2024-06-28T00:33:00+00:00, run_start_date=2024-06-28 00:34:00.100282+00:00, run_end_date=2024-06-28 00:34:02.112203+00:00, run_duration=2.011921, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:33:00+00:00, data_interval_end=2024-06-28 00:34:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:34:02.125111878Z [2024-06-28T00:34:02.124+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:34:00+00:00, run_after=2024-06-28T00:35:00+00:00 2024-06-28T00:34:02.191472636Z [2024-06-28T00:34:02.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:32:00+00:00 exited with status success for try_number 1 2024-06-28T00:34:02.191755684Z [2024-06-28T00:34:02.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:33:00+00:00 exited with status success for try_number 1 2024-06-28T00:34:02.208326051Z [2024-06-28T00:34:02.208+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:32:00+00:00, map_index=-1, run_start_date=2024-06-28 00:34:01.241271+00:00, run_end_date=2024-06-28 00:34:01.760373+00:00, run_duration=0.519102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=541, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:34:00.173345+00:00, queued_by_job_id=2, pid=7954 2024-06-28T00:34:02.211232229Z [2024-06-28T00:34:02.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:33:00+00:00, map_index=-1, run_start_date=2024-06-28 00:34:01.365197+00:00, run_end_date=2024-06-28 00:34:01.924871+00:00, run_duration=0.559674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=542, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:34:00.173345+00:00, queued_by_job_id=2, pid=7955 2024-06-28T00:34:04.364542378Z [2024-06-28T00:34:04.364+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:34:04.364920551Z [2024-06-28T00:34:04.364+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:33:00+00:00, run_id=scheduled__2024-06-28T00:33:00+00:00, run_start_date=2024-06-28 00:34:00.102367+00:00, run_end_date=2024-06-28 00:34:04.364556+00:00, run_duration=4.262189, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:33:00+00:00, data_interval_end=2024-06-28 00:34:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:34:04.373868980Z [2024-06-28T00:34:04.373+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:34:00+00:00, run_after=2024-06-28T00:35:00+00:00 2024-06-28T00:34:04.380235283Z [2024-06-28T00:34:04.379+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:34:04.380645501Z [2024-06-28T00:34:04.380+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:33:00+00:00, run_id=scheduled__2024-06-28T00:33:00+00:00, run_start_date=2024-06-28 00:34:00.101406+00:00, run_end_date=2024-06-28 00:34:04.380338+00:00, run_duration=4.278932, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:33:00+00:00, data_interval_end=2024-06-28 00:34:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:34:04.389793881Z [2024-06-28T00:34:04.389+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:34:00+00:00, run_after=2024-06-28T00:35:00+00:00 2024-06-28T00:34:04.432231035Z [2024-06-28T00:34:04.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:33:00+00:00 exited with status success for try_number 1 2024-06-28T00:34:04.434886910Z [2024-06-28T00:34:04.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:33:00+00:00 exited with status success for try_number 1 2024-06-28T00:34:04.444018217Z [2024-06-28T00:34:04.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:33:00+00:00, map_index=-1, run_start_date=2024-06-28 00:34:02.640391+00:00, run_end_date=2024-06-28 00:34:03.942182+00:00, run_duration=1.301791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=544, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:34:00.173345+00:00, queued_by_job_id=2, pid=7979 2024-06-28T00:34:04.444512313Z [2024-06-28T00:34:04.444+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:33:00+00:00, map_index=-1, run_start_date=2024-06-28 00:34:02.463218+00:00, run_end_date=2024-06-28 00:34:04.097735+00:00, run_duration=1.634517, state=success, executor_state=success, try_number=1, max_tries=1, job_id=543, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:34:00.173345+00:00, queued_by_job_id=2, pid=7978 2024-06-28T00:35:00.020182809Z [2024-06-28T00:35:00.019+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:35:00+00:00, run_after=2024-06-28T00:36:00+00:00 2024-06-28T00:35:00.045085573Z [2024-06-28T00:35:00.044+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:35:00+00:00, run_after=2024-06-28T00:36:00+00:00 2024-06-28T00:35:00.054909389Z [2024-06-28T00:35:00.054+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:35:00.076047609Z [2024-06-28T00:35:00.075+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:35:00+00:00, run_after=2024-06-28T00:40:00+00:00 2024-06-28T00:35:00.163592042Z [2024-06-28T00:35:00.163+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:35:00.163620085Z 2024-06-28T00:35:00.163626081Z 2024-06-28T00:35:00.163630780Z 2024-06-28T00:35:00.163653769Z 2024-06-28T00:35:00.163659655Z [2024-06-28T00:35:00.163+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:35:00.163709393Z [2024-06-28T00:35:00.163+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:35:00.163917245Z [2024-06-28T00:35:00.163+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:35:00.164027356Z [2024-06-28T00:35:00.163+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:35:00.164901148Z [2024-06-28T00:35:00.164+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:35:00.164920516Z 2024-06-28T00:35:00.164927336Z 2024-06-28T00:35:00.164933276Z 2024-06-28T00:35:00.164939283Z 2024-06-28T00:35:00.168806058Z [2024-06-28T00:35:00.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T00:35:00.169077614Z [2024-06-28T00:35:00.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:35:00.169434806Z [2024-06-28T00:35:00.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:35:00.169641777Z [2024-06-28T00:35:00.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:35:00.169890958Z [2024-06-28T00:35:00.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:35:00.169990448Z [2024-06-28T00:35:00.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:35:00.170187384Z [2024-06-28T00:35:00.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:35:00.170252674Z [2024-06-28T00:35:00.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:35:00.538619372Z [2024-06-28T00:35:00.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status queued for try_number 1 2024-06-28T00:35:00.538666453Z [2024-06-28T00:35:00.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:34:00+00:00 exited with status queued for try_number 1 2024-06-28T00:35:00.538779806Z [2024-06-28T00:35:00.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:34:00+00:00 exited with status queued for try_number 1 2024-06-28T00:35:00.538850676Z [2024-06-28T00:35:00.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:34:00+00:00 exited with status queued for try_number 1 2024-06-28T00:35:00.574349069Z [2024-06-28T00:35:00.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to e86c9db7-dd5c-4a00-ba0a-df874fc0d4af 2024-06-28T00:35:00.574435628Z [2024-06-28T00:35:00.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9265dbb3-6d16-4c1e-8319-8b4366131dd5 2024-06-28T00:35:00.574550532Z [2024-06-28T00:35:00.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to c555e4fb-a5fe-4704-8528-0c66eab25777 2024-06-28T00:35:00.579809827Z [2024-06-28T00:35:00.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a85a234-5f29-4dc5-a800-c39fbad93025 2024-06-28T00:35:01.928823459Z [2024-06-28T00:35:01.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:35:01.929376989Z [2024-06-28T00:35:01.929+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:34:00+00:00, run_id=scheduled__2024-06-28T00:34:00+00:00, run_start_date=2024-06-28 00:35:00.090339+00:00, run_end_date=2024-06-28 00:35:01.928970+00:00, run_duration=1.838631, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:34:00+00:00, data_interval_end=2024-06-28 00:35:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:35:01.939457984Z [2024-06-28T00:35:01.939+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:35:00+00:00, run_after=2024-06-28T00:36:00+00:00 2024-06-28T00:35:01.988855275Z [2024-06-28T00:35:01.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:34:00+00:00 exited with status success for try_number 1 2024-06-28T00:35:01.994444581Z [2024-06-28T00:35:01.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:34:00+00:00, map_index=-1, run_start_date=2024-06-28 00:35:01.044338+00:00, run_end_date=2024-06-28 00:35:01.517029+00:00, run_duration=0.472691, state=success, executor_state=success, try_number=1, max_tries=1, job_id=545, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:35:00.165809+00:00, queued_by_job_id=2, pid=8011 2024-06-28T00:35:03.115029296Z [2024-06-28T00:35:03.114+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:35:03.115053729Z 2024-06-28T00:35:03.115272457Z [2024-06-28T00:35:03.114+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:35:03.115839664Z [2024-06-28T00:35:03.115+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:35:03.115851614Z 2024-06-28T00:35:03.118626232Z [2024-06-28T00:35:03.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T00:35:03.119079536Z [2024-06-28T00:35:03.118+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:35:03.203140749Z [2024-06-28T00:35:03.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status queued for try_number 1 2024-06-28T00:35:03.203180682Z [2024-06-28T00:35:03.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status success for try_number 1 2024-06-28T00:35:03.216346701Z [2024-06-28T00:35:03.215+0000] {scheduler_job.py:635} INFO - Setting external_id for to 519943f2-ceb7-48ae-bf4b-9057f3ebf8ad 2024-06-28T00:35:03.216614432Z [2024-06-28T00:35:03.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T00:30:00+00:00, map_index=-1, run_start_date=2024-06-28 00:35:02.474942+00:00, run_end_date=2024-06-28 00:35:02.943907+00:00, run_duration=0.468965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=546, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:35:00.165809+00:00, queued_by_job_id=2, pid=8035 2024-06-28T00:35:04.415130840Z [2024-06-28T00:35:04.414+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:35:04.415314204Z [2024-06-28T00:35:04.415+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:34:00+00:00, run_id=scheduled__2024-06-28T00:34:00+00:00, run_start_date=2024-06-28 00:35:00.091469+00:00, run_end_date=2024-06-28 00:35:04.415051+00:00, run_duration=4.323582, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:34:00+00:00, data_interval_end=2024-06-28 00:35:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:35:04.464542410Z [2024-06-28T00:35:04.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:35:00+00:00, run_after=2024-06-28T00:36:00+00:00 2024-06-28T00:35:04.575573738Z [2024-06-28T00:35:04.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:34:00+00:00 exited with status success for try_number 1 2024-06-28T00:35:04.590980022Z [2024-06-28T00:35:04.590+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:34:00+00:00, map_index=-1, run_start_date=2024-06-28 00:35:02.508222+00:00, run_end_date=2024-06-28 00:35:03.821373+00:00, run_duration=1.313151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=547, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:35:00.165809+00:00, queued_by_job_id=2, pid=8036 2024-06-28T00:35:05.652764593Z [2024-06-28T00:35:05.652+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:35:05.653367162Z [2024-06-28T00:35:05.652+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:34:00+00:00, run_id=scheduled__2024-06-28T00:34:00+00:00, run_start_date=2024-06-28 00:35:00.092532+00:00, run_end_date=2024-06-28 00:35:05.652793+00:00, run_duration=5.560261, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:34:00+00:00, data_interval_end=2024-06-28 00:35:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:35:05.667999890Z [2024-06-28T00:35:05.667+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:35:00+00:00, run_after=2024-06-28T00:36:00+00:00 2024-06-28T00:35:05.864311412Z [2024-06-28T00:35:05.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:34:00+00:00 exited with status success for try_number 1 2024-06-28T00:35:05.869538233Z [2024-06-28T00:35:05.869+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:34:00+00:00, map_index=-1, run_start_date=2024-06-28 00:35:02.662546+00:00, run_end_date=2024-06-28 00:35:04.534002+00:00, run_duration=1.871456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=548, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:35:00.165809+00:00, queued_by_job_id=2, pid=8037 2024-06-28T00:35:06.977781210Z [2024-06-28T00:35:06.977+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:35:06.977810024Z 2024-06-28T00:35:06.977834207Z [2024-06-28T00:35:06.977+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:35:06.978809645Z [2024-06-28T00:35:06.978+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:35:06.978822570Z 2024-06-28T00:35:06.981253365Z [2024-06-28T00:35:06.981+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T00:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T00:35:06.981311011Z [2024-06-28T00:35:06.981+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T00:35:07.079037155Z [2024-06-28T00:35:07.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status queued for try_number 1 2024-06-28T00:35:07.079367595Z [2024-06-28T00:35:07.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status success for try_number 1 2024-06-28T00:35:07.091948370Z [2024-06-28T00:35:07.091+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77c15237-a844-4fab-88fc-b1d3471958dc 2024-06-28T00:35:07.092214963Z [2024-06-28T00:35:07.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T00:30:00+00:00, map_index=-1, run_start_date=2024-06-28 00:35:05.327380+00:00, run_end_date=2024-06-28 00:35:05.825212+00:00, run_duration=0.497832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=549, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:35:03.116220+00:00, queued_by_job_id=2, pid=8060 2024-06-28T00:35:09.416997714Z [2024-06-28T00:35:09.416+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:35:09.417027259Z 2024-06-28T00:35:09.417381855Z [2024-06-28T00:35:09.417+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:35:09.418068817Z [2024-06-28T00:35:09.417+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:35:09.418079890Z 2024-06-28T00:35:09.420967025Z [2024-06-28T00:35:09.420+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:35:09.421227974Z [2024-06-28T00:35:09.421+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:35:09.495983891Z [2024-06-28T00:35:09.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status queued for try_number 1 2024-06-28T00:35:09.496056103Z [2024-06-28T00:35:09.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status success for try_number 1 2024-06-28T00:35:09.510481825Z [2024-06-28T00:35:09.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03a103ea-d153-40af-b730-db1024206fad 2024-06-28T00:35:09.510630740Z [2024-06-28T00:35:09.510+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T00:30:00+00:00, map_index=0, run_start_date=2024-06-28 00:35:08.863941+00:00, run_end_date=2024-06-28 00:35:09.190498+00:00, run_duration=0.326557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=550, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:35:06.979176+00:00, queued_by_job_id=2, pid=8068 2024-06-28T00:35:11.964585527Z [2024-06-28T00:35:11.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:35:11.965041301Z [2024-06-28T00:35:11.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:30:00+00:00, run_id=scheduled__2024-06-28T00:30:00+00:00, run_start_date=2024-06-28 00:35:00.089020+00:00, run_end_date=2024-06-28 00:35:11.964485+00:00, run_duration=11.875465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:30:00+00:00, data_interval_end=2024-06-28 00:35:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T00:35:11.973477443Z [2024-06-28T00:35:11.973+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:35:00+00:00, run_after=2024-06-28T00:40:00+00:00 2024-06-28T00:35:12.016527421Z [2024-06-28T00:35:12.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:30:00+00:00 exited with status success for try_number 1 2024-06-28T00:35:12.022041396Z [2024-06-28T00:35:12.021+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T00:30:00+00:00, map_index=-1, run_start_date=2024-06-28 00:35:11.033780+00:00, run_end_date=2024-06-28 00:35:11.329520+00:00, run_duration=0.29574, state=success, executor_state=success, try_number=1, max_tries=1, job_id=551, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:35:09.418629+00:00, queued_by_job_id=2, pid=8076 2024-06-28T00:36:00.043786602Z [2024-06-28T00:36:00.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:36:00+00:00, run_after=2024-06-28T00:37:00+00:00 2024-06-28T00:36:00.052482056Z [2024-06-28T00:36:00.052+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:36:00.059322200Z [2024-06-28T00:36:00.058+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:36:00.071232763Z [2024-06-28T00:36:00.070+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:36:00+00:00, run_after=2024-06-28T00:37:00+00:00 2024-06-28T00:36:00.141606427Z [2024-06-28T00:36:00.141+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:36:00.141734415Z 2024-06-28T00:36:00.141746013Z 2024-06-28T00:36:00.141754701Z 2024-06-28T00:36:00.141762971Z 2024-06-28T00:36:00.141772348Z [2024-06-28T00:36:00.141+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:36:00.141796948Z [2024-06-28T00:36:00.141+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:36:00.141806425Z [2024-06-28T00:36:00.141+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:36:00.141814872Z [2024-06-28T00:36:00.141+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:36:00.142488830Z [2024-06-28T00:36:00.142+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:36:00.142510457Z 2024-06-28T00:36:00.142519860Z 2024-06-28T00:36:00.142528472Z 2024-06-28T00:36:00.142538011Z 2024-06-28T00:36:00.146345655Z [2024-06-28T00:36:00.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:36:00.146400870Z [2024-06-28T00:36:00.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:36:00.146506413Z [2024-06-28T00:36:00.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:36:00.146520387Z [2024-06-28T00:36:00.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:36:00.146637376Z [2024-06-28T00:36:00.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:36:00.146657603Z [2024-06-28T00:36:00.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:36:00.146876633Z [2024-06-28T00:36:00.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:36:00.146964371Z [2024-06-28T00:36:00.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:36:00.585250819Z [2024-06-28T00:36:00.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:34:00+00:00 exited with status queued for try_number 1 2024-06-28T00:36:00.585276338Z [2024-06-28T00:36:00.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:35:00+00:00 exited with status queued for try_number 1 2024-06-28T00:36:00.585333076Z [2024-06-28T00:36:00.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:35:00+00:00 exited with status queued for try_number 1 2024-06-28T00:36:00.585393388Z [2024-06-28T00:36:00.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:35:00+00:00 exited with status queued for try_number 1 2024-06-28T00:36:00.605259340Z [2024-06-28T00:36:00.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88d6a85d-6a39-45e9-8e0b-6f2010a91f4e 2024-06-28T00:36:00.605312219Z [2024-06-28T00:36:00.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to c182ac88-3a1b-4800-9e82-d98967052b22 2024-06-28T00:36:00.605424443Z [2024-06-28T00:36:00.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to 535ab95c-755a-440d-8dc6-bbc8953f833d 2024-06-28T00:36:00.605523699Z [2024-06-28T00:36:00.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to 652add9a-6a60-4261-9471-44bfd94e5372 2024-06-28T00:36:02.509551380Z [2024-06-28T00:36:02.509+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:36:02.509909029Z [2024-06-28T00:36:02.509+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:35:00+00:00, run_id=scheduled__2024-06-28T00:35:00+00:00, run_start_date=2024-06-28 00:36:00.082781+00:00, run_end_date=2024-06-28 00:36:02.509567+00:00, run_duration=2.426786, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:35:00+00:00, data_interval_end=2024-06-28 00:36:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:36:02.520292630Z [2024-06-28T00:36:02.520+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:36:00+00:00, run_after=2024-06-28T00:37:00+00:00 2024-06-28T00:36:02.530599250Z [2024-06-28T00:36:02.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:36:02.531124934Z [2024-06-28T00:36:02.530+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:34:00+00:00, run_id=scheduled__2024-06-28T00:34:00+00:00, run_start_date=2024-06-28 00:36:00.081487+00:00, run_end_date=2024-06-28 00:36:02.530628+00:00, run_duration=2.449141, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:34:00+00:00, data_interval_end=2024-06-28 00:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:36:02.541151664Z [2024-06-28T00:36:02.540+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:36:00+00:00, run_after=2024-06-28T00:38:00+00:00 2024-06-28T00:36:02.644351739Z [2024-06-28T00:36:02.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:34:00+00:00 exited with status success for try_number 1 2024-06-28T00:36:02.644533835Z [2024-06-28T00:36:02.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:35:00+00:00 exited with status success for try_number 1 2024-06-28T00:36:02.678009451Z [2024-06-28T00:36:02.677+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:34:00+00:00, map_index=-1, run_start_date=2024-06-28 00:36:01.278016+00:00, run_end_date=2024-06-28 00:36:01.753103+00:00, run_duration=0.475087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=552, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:36:00.143327+00:00, queued_by_job_id=2, pid=8099 2024-06-28T00:36:02.678579260Z [2024-06-28T00:36:02.678+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:35:00+00:00, map_index=-1, run_start_date=2024-06-28 00:36:01.599685+00:00, run_end_date=2024-06-28 00:36:02.109160+00:00, run_duration=0.509475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=553, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:36:00.143327+00:00, queued_by_job_id=2, pid=8100 2024-06-28T00:36:04.167350782Z [2024-06-28T00:36:04.166+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:36:04.167679944Z [2024-06-28T00:36:04.167+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:35:00+00:00, run_id=scheduled__2024-06-28T00:35:00+00:00, run_start_date=2024-06-28 00:36:00.083778+00:00, run_end_date=2024-06-28 00:36:04.167304+00:00, run_duration=4.083526, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:35:00+00:00, data_interval_end=2024-06-28 00:36:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:36:04.188598011Z [2024-06-28T00:36:04.186+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:36:00+00:00, run_after=2024-06-28T00:37:00+00:00 2024-06-28T00:36:04.259491822Z [2024-06-28T00:36:04.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:35:00+00:00 exited with status success for try_number 1 2024-06-28T00:36:04.276452346Z [2024-06-28T00:36:04.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:35:00+00:00, map_index=-1, run_start_date=2024-06-28 00:36:02.686344+00:00, run_end_date=2024-06-28 00:36:03.914979+00:00, run_duration=1.228635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=554, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:36:00.143327+00:00, queued_by_job_id=2, pid=8123 2024-06-28T00:36:05.341114318Z [2024-06-28T00:36:05.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:36:05.341484690Z [2024-06-28T00:36:05.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:35:00+00:00, run_id=scheduled__2024-06-28T00:35:00+00:00, run_start_date=2024-06-28 00:36:00.084728+00:00, run_end_date=2024-06-28 00:36:05.341054+00:00, run_duration=5.256326, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:35:00+00:00, data_interval_end=2024-06-28 00:36:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:36:05.352758662Z [2024-06-28T00:36:05.352+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:36:00+00:00, run_after=2024-06-28T00:37:00+00:00 2024-06-28T00:36:05.383483418Z [2024-06-28T00:36:05.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:35:00+00:00 exited with status success for try_number 1 2024-06-28T00:36:05.388268623Z [2024-06-28T00:36:05.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:35:00+00:00, map_index=-1, run_start_date=2024-06-28 00:36:02.712520+00:00, run_end_date=2024-06-28 00:36:04.380777+00:00, run_duration=1.668257, state=success, executor_state=success, try_number=1, max_tries=1, job_id=555, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:36:00.143327+00:00, queued_by_job_id=2, pid=8124 2024-06-28T00:36:45.763813387Z [2024-06-28T00:36:45.763+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T00:37:00.077240202Z [2024-06-28T00:37:00.076+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:37:00+00:00, run_after=2024-06-28T00:38:00+00:00 2024-06-28T00:37:00.085840618Z [2024-06-28T00:37:00.085+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:37:00.098334832Z [2024-06-28T00:37:00.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:37:00+00:00, run_after=2024-06-28T00:38:00+00:00 2024-06-28T00:37:00.174252596Z [2024-06-28T00:37:00.173+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:37:00.174282142Z 2024-06-28T00:37:00.174290480Z 2024-06-28T00:37:00.174297672Z 2024-06-28T00:37:00.174366554Z [2024-06-28T00:37:00.174+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:37:00.174607245Z [2024-06-28T00:37:00.174+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:37:00.174878131Z [2024-06-28T00:37:00.174+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:37:00.175656028Z [2024-06-28T00:37:00.175+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:37:00.175669971Z 2024-06-28T00:37:00.175674394Z 2024-06-28T00:37:00.175678339Z 2024-06-28T00:37:00.179489243Z [2024-06-28T00:37:00.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:37:00.179748621Z [2024-06-28T00:37:00.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:37:00.180100921Z [2024-06-28T00:37:00.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:37:00.180317213Z [2024-06-28T00:37:00.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:37:00.180579391Z [2024-06-28T00:37:00.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:37:00.180632192Z [2024-06-28T00:37:00.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:37:00.543934031Z [2024-06-28T00:37:00.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:36:00+00:00 exited with status queued for try_number 1 2024-06-28T00:37:00.547110483Z [2024-06-28T00:37:00.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:36:00+00:00 exited with status queued for try_number 1 2024-06-28T00:37:00.547276956Z [2024-06-28T00:37:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:36:00+00:00 exited with status queued for try_number 1 2024-06-28T00:37:00.555905348Z [2024-06-28T00:37:00.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to 218b827b-b5a8-43bd-aea2-5103d3f9566d 2024-06-28T00:37:00.556168670Z [2024-06-28T00:37:00.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to 093b9857-c9a6-475a-bc23-342b465e046e 2024-06-28T00:37:00.556326289Z [2024-06-28T00:37:00.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ba1fc42-a753-4db3-9e76-4eb55f1b7260 2024-06-28T00:37:01.689707752Z [2024-06-28T00:37:01.689+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:37:01.690100289Z [2024-06-28T00:37:01.689+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:36:00+00:00, run_id=scheduled__2024-06-28T00:36:00+00:00, run_start_date=2024-06-28 00:37:00.110591+00:00, run_end_date=2024-06-28 00:37:01.689758+00:00, run_duration=1.579167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:36:00+00:00, data_interval_end=2024-06-28 00:37:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:37:01.698848827Z [2024-06-28T00:37:01.698+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:37:00+00:00, run_after=2024-06-28T00:38:00+00:00 2024-06-28T00:37:01.775396230Z [2024-06-28T00:37:01.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:36:00+00:00 exited with status success for try_number 1 2024-06-28T00:37:01.787768998Z [2024-06-28T00:37:01.787+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:36:00+00:00, map_index=-1, run_start_date=2024-06-28 00:37:01.083137+00:00, run_end_date=2024-06-28 00:37:01.536870+00:00, run_duration=0.453733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=556, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:37:00.176470+00:00, queued_by_job_id=2, pid=8156 2024-06-28T00:37:04.071392656Z [2024-06-28T00:37:04.070+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:37:04.071605627Z [2024-06-28T00:37:04.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:36:00+00:00, run_id=scheduled__2024-06-28T00:36:00+00:00, run_start_date=2024-06-28 00:37:00.111856+00:00, run_end_date=2024-06-28 00:37:04.071341+00:00, run_duration=3.959485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:36:00+00:00, data_interval_end=2024-06-28 00:37:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:37:04.081933664Z [2024-06-28T00:37:04.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:37:00+00:00, run_after=2024-06-28T00:38:00+00:00 2024-06-28T00:37:04.154536363Z [2024-06-28T00:37:04.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:36:00+00:00 exited with status success for try_number 1 2024-06-28T00:37:04.164047283Z [2024-06-28T00:37:04.163+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:36:00+00:00, map_index=-1, run_start_date=2024-06-28 00:37:02.324767+00:00, run_end_date=2024-06-28 00:37:03.727656+00:00, run_duration=1.402889, state=success, executor_state=success, try_number=1, max_tries=1, job_id=558, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:37:00.176470+00:00, queued_by_job_id=2, pid=8175 2024-06-28T00:37:05.232187212Z [2024-06-28T00:37:05.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:37:05.232845186Z [2024-06-28T00:37:05.232+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:36:00+00:00, run_id=scheduled__2024-06-28T00:36:00+00:00, run_start_date=2024-06-28 00:37:00.112872+00:00, run_end_date=2024-06-28 00:37:05.232494+00:00, run_duration=5.119622, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:36:00+00:00, data_interval_end=2024-06-28 00:37:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:37:05.244189865Z [2024-06-28T00:37:05.243+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:37:00+00:00, run_after=2024-06-28T00:38:00+00:00 2024-06-28T00:37:05.292280362Z [2024-06-28T00:37:05.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:36:00+00:00 exited with status success for try_number 1 2024-06-28T00:37:05.297134205Z [2024-06-28T00:37:05.296+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:36:00+00:00, map_index=-1, run_start_date=2024-06-28 00:37:02.296392+00:00, run_end_date=2024-06-28 00:37:04.038002+00:00, run_duration=1.74161, state=success, executor_state=success, try_number=1, max_tries=1, job_id=557, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:37:00.176470+00:00, queued_by_job_id=2, pid=8174 2024-06-28T00:38:00.033521628Z [2024-06-28T00:38:00.033+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:38:00+00:00, run_after=2024-06-28T00:39:00+00:00 2024-06-28T00:38:00.045445637Z [2024-06-28T00:38:00.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:38:00+00:00, run_after=2024-06-28T00:39:00+00:00 2024-06-28T00:38:00.054277756Z [2024-06-28T00:38:00.053+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:38:00.062867989Z [2024-06-28T00:38:00.062+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:38:00.133252827Z [2024-06-28T00:38:00.132+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:38:00.133271012Z 2024-06-28T00:38:00.133275041Z 2024-06-28T00:38:00.133278646Z 2024-06-28T00:38:00.133281908Z 2024-06-28T00:38:00.133473003Z [2024-06-28T00:38:00.133+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:38:00.133720449Z [2024-06-28T00:38:00.133+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:38:00.133940892Z [2024-06-28T00:38:00.133+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:38:00.134193236Z [2024-06-28T00:38:00.133+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:38:00.136166801Z [2024-06-28T00:38:00.135+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:38:00.136178063Z 2024-06-28T00:38:00.136181720Z 2024-06-28T00:38:00.136184843Z 2024-06-28T00:38:00.136187973Z 2024-06-28T00:38:00.140655383Z [2024-06-28T00:38:00.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:38:00.140951629Z [2024-06-28T00:38:00.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:38:00.141383334Z [2024-06-28T00:38:00.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:38:00.141622140Z [2024-06-28T00:38:00.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:38:00.142024163Z [2024-06-28T00:38:00.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:38:00.142271855Z [2024-06-28T00:38:00.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:38:00.142739676Z [2024-06-28T00:38:00.142+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:38:00.142988825Z [2024-06-28T00:38:00.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:38:00.519267179Z [2024-06-28T00:38:00.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:36:00+00:00 exited with status queued for try_number 1 2024-06-28T00:38:00.519329449Z [2024-06-28T00:38:00.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:37:00+00:00 exited with status queued for try_number 1 2024-06-28T00:38:00.519400223Z [2024-06-28T00:38:00.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:37:00+00:00 exited with status queued for try_number 1 2024-06-28T00:38:00.519464378Z [2024-06-28T00:38:00.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:37:00+00:00 exited with status queued for try_number 1 2024-06-28T00:38:00.532265729Z [2024-06-28T00:38:00.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to a06575bf-9caf-442f-a14a-dc20a510e29b 2024-06-28T00:38:00.532316271Z [2024-06-28T00:38:00.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b80f102-9b81-4bbb-9a99-87e056d4dd52 2024-06-28T00:38:00.532426618Z [2024-06-28T00:38:00.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc934d01-02c1-4db7-a6ef-a4fa3bcdca0b 2024-06-28T00:38:00.532519235Z [2024-06-28T00:38:00.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fb4d87a-79eb-4e6a-807c-85bfab6d18ba 2024-06-28T00:38:01.839134855Z [2024-06-28T00:38:01.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:38:01.839518139Z [2024-06-28T00:38:01.839+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:36:00+00:00, run_id=scheduled__2024-06-28T00:36:00+00:00, run_start_date=2024-06-28 00:38:00.072599+00:00, run_end_date=2024-06-28 00:38:01.839163+00:00, run_duration=1.766564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:36:00+00:00, data_interval_end=2024-06-28 00:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:38:01.855389097Z [2024-06-28T00:38:01.855+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:38:00+00:00, run_after=2024-06-28T00:40:00+00:00 2024-06-28T00:38:01.867652767Z [2024-06-28T00:38:01.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:38:01.867992740Z [2024-06-28T00:38:01.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:37:00+00:00, run_id=scheduled__2024-06-28T00:37:00+00:00, run_start_date=2024-06-28 00:38:00.073702+00:00, run_end_date=2024-06-28 00:38:01.867671+00:00, run_duration=1.793969, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:37:00+00:00, data_interval_end=2024-06-28 00:38:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:38:01.884466673Z [2024-06-28T00:38:01.884+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:38:00+00:00, run_after=2024-06-28T00:39:00+00:00 2024-06-28T00:38:02.333525734Z [2024-06-28T00:38:02.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:36:00+00:00 exited with status success for try_number 1 2024-06-28T00:38:02.333549980Z [2024-06-28T00:38:02.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:37:00+00:00 exited with status success for try_number 1 2024-06-28T00:38:02.345197904Z [2024-06-28T00:38:02.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:37:00+00:00, map_index=-1, run_start_date=2024-06-28 00:38:01.165418+00:00, run_end_date=2024-06-28 00:38:01.801623+00:00, run_duration=0.636205, state=success, executor_state=success, try_number=1, max_tries=1, job_id=559, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:38:00.137404+00:00, queued_by_job_id=2, pid=8207 2024-06-28T00:38:02.345369166Z [2024-06-28T00:38:02.345+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:36:00+00:00, map_index=-1, run_start_date=2024-06-28 00:38:01.262823+00:00, run_end_date=2024-06-28 00:38:01.816576+00:00, run_duration=0.553753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=560, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:38:00.137404+00:00, queued_by_job_id=2, pid=8208 2024-06-28T00:38:05.597409323Z [2024-06-28T00:38:05.596+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:38:05.597430256Z [2024-06-28T00:38:05.597+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:37:00+00:00, run_id=scheduled__2024-06-28T00:37:00+00:00, run_start_date=2024-06-28 00:38:00.074787+00:00, run_end_date=2024-06-28 00:38:05.596923+00:00, run_duration=5.522136, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:37:00+00:00, data_interval_end=2024-06-28 00:38:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:38:05.605683849Z [2024-06-28T00:38:05.605+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:38:00+00:00, run_after=2024-06-28T00:39:00+00:00 2024-06-28T00:38:05.612713863Z [2024-06-28T00:38:05.612+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:38:05.612929329Z [2024-06-28T00:38:05.612+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:37:00+00:00, run_id=scheduled__2024-06-28T00:37:00+00:00, run_start_date=2024-06-28 00:38:00.075922+00:00, run_end_date=2024-06-28 00:38:05.612682+00:00, run_duration=5.53676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:37:00+00:00, data_interval_end=2024-06-28 00:38:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:38:05.622976031Z [2024-06-28T00:38:05.622+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:38:00+00:00, run_after=2024-06-28T00:39:00+00:00 2024-06-28T00:38:05.658128803Z [2024-06-28T00:38:05.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:37:00+00:00 exited with status success for try_number 1 2024-06-28T00:38:05.658181715Z [2024-06-28T00:38:05.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:37:00+00:00 exited with status success for try_number 1 2024-06-28T00:38:05.664555501Z [2024-06-28T00:38:05.664+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:37:00+00:00, map_index=-1, run_start_date=2024-06-28 00:38:02.907701+00:00, run_end_date=2024-06-28 00:38:04.877286+00:00, run_duration=1.969585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=562, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:38:00.137404+00:00, queued_by_job_id=2, pid=8231 2024-06-28T00:38:05.664696896Z [2024-06-28T00:38:05.664+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:37:00+00:00, map_index=-1, run_start_date=2024-06-28 00:38:02.901526+00:00, run_end_date=2024-06-28 00:38:05.033008+00:00, run_duration=2.131482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=561, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:38:00.137404+00:00, queued_by_job_id=2, pid=8232 2024-06-28T00:39:00.648712803Z [2024-06-28T00:39:00.648+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:39:00.664976957Z [2024-06-28T00:39:00.664+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:39:00+00:00, run_after=2024-06-28T00:40:00+00:00 2024-06-28T00:39:00.678097144Z [2024-06-28T00:39:00.677+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:39:00+00:00, run_after=2024-06-28T00:40:00+00:00 2024-06-28T00:39:00.762491882Z [2024-06-28T00:39:00.762+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:39:00.762518538Z 2024-06-28T00:39:00.762523039Z 2024-06-28T00:39:00.762526416Z 2024-06-28T00:39:00.762994396Z [2024-06-28T00:39:00.762+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:39:00.763005927Z [2024-06-28T00:39:00.762+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:39:00.763009273Z [2024-06-28T00:39:00.762+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:39:00.763592786Z [2024-06-28T00:39:00.763+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:39:00.763610337Z 2024-06-28T00:39:00.763614825Z 2024-06-28T00:39:00.763618188Z 2024-06-28T00:39:00.767126380Z [2024-06-28T00:39:00.766+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:39:00.767358650Z [2024-06-28T00:39:00.767+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:39:00.767748477Z [2024-06-28T00:39:00.767+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:39:00.767979811Z [2024-06-28T00:39:00.767+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:39:00.768234005Z [2024-06-28T00:39:00.768+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:39:00.768390435Z [2024-06-28T00:39:00.768+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:39:01.127202325Z [2024-06-28T00:39:01.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:38:00+00:00 exited with status queued for try_number 1 2024-06-28T00:39:01.129318928Z [2024-06-28T00:39:01.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:38:00+00:00 exited with status queued for try_number 1 2024-06-28T00:39:01.129501911Z [2024-06-28T00:39:01.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:38:00+00:00 exited with status queued for try_number 1 2024-06-28T00:39:01.148355078Z [2024-06-28T00:39:01.148+0000] {scheduler_job.py:635} INFO - Setting external_id for to e48058d9-6d72-44f4-9b07-fed70b6ea650 2024-06-28T00:39:01.150013683Z [2024-06-28T00:39:01.149+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d6c9799-1201-4dd0-8d9c-7727b6852454 2024-06-28T00:39:01.150203861Z [2024-06-28T00:39:01.149+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90ea5fc3-2aa9-4115-8da1-481429b78524 2024-06-28T00:39:02.699771970Z [2024-06-28T00:39:02.699+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:39:02.701134970Z [2024-06-28T00:39:02.700+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:38:00+00:00, run_id=scheduled__2024-06-28T00:38:00+00:00, run_start_date=2024-06-28 00:39:00.690885+00:00, run_end_date=2024-06-28 00:39:02.700417+00:00, run_duration=2.009532, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:38:00+00:00, data_interval_end=2024-06-28 00:39:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:39:02.711690341Z [2024-06-28T00:39:02.711+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:39:00+00:00, run_after=2024-06-28T00:40:00+00:00 2024-06-28T00:39:02.767825204Z [2024-06-28T00:39:02.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:38:00+00:00 exited with status success for try_number 1 2024-06-28T00:39:02.775860722Z [2024-06-28T00:39:02.775+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:38:00+00:00, map_index=-1, run_start_date=2024-06-28 00:39:01.829531+00:00, run_end_date=2024-06-28 00:39:02.314055+00:00, run_duration=0.484524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=563, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:39:00.764279+00:00, queued_by_job_id=2, pid=8263 2024-06-28T00:39:04.995444670Z [2024-06-28T00:39:04.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:39:04.995726030Z [2024-06-28T00:39:04.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:38:00+00:00, run_id=scheduled__2024-06-28T00:38:00+00:00, run_start_date=2024-06-28 00:39:00.692197+00:00, run_end_date=2024-06-28 00:39:04.995413+00:00, run_duration=4.303216, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:38:00+00:00, data_interval_end=2024-06-28 00:39:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:39:05.025201474Z [2024-06-28T00:39:05.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:39:00+00:00, run_after=2024-06-28T00:40:00+00:00 2024-06-28T00:39:05.152180425Z [2024-06-28T00:39:05.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:38:00+00:00 exited with status success for try_number 1 2024-06-28T00:39:05.162222530Z [2024-06-28T00:39:05.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:38:00+00:00, map_index=-1, run_start_date=2024-06-28 00:39:02.889143+00:00, run_end_date=2024-06-28 00:39:04.418397+00:00, run_duration=1.529254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=564, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:39:00.764279+00:00, queued_by_job_id=2, pid=8281 2024-06-28T00:39:06.230901363Z [2024-06-28T00:39:06.230+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:39:06.231619061Z [2024-06-28T00:39:06.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:38:00+00:00, run_id=scheduled__2024-06-28T00:38:00+00:00, run_start_date=2024-06-28 00:39:00.693359+00:00, run_end_date=2024-06-28 00:39:06.231265+00:00, run_duration=5.537906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:38:00+00:00, data_interval_end=2024-06-28 00:39:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:39:06.244029544Z [2024-06-28T00:39:06.243+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:39:00+00:00, run_after=2024-06-28T00:40:00+00:00 2024-06-28T00:39:06.299772378Z [2024-06-28T00:39:06.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:38:00+00:00 exited with status success for try_number 1 2024-06-28T00:39:06.306906341Z [2024-06-28T00:39:06.306+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:38:00+00:00, map_index=-1, run_start_date=2024-06-28 00:39:02.958791+00:00, run_end_date=2024-06-28 00:39:05.013991+00:00, run_duration=2.0552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=565, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:39:00.764279+00:00, queued_by_job_id=2, pid=8282 2024-06-28T00:40:00.777336532Z [2024-06-28T00:40:00.776+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:40:00+00:00, run_after=2024-06-28T00:45:00+00:00 2024-06-28T00:40:00.787009882Z [2024-06-28T00:40:00.786+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:40:00.797649854Z [2024-06-28T00:40:00.797+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:40:00.814625398Z [2024-06-28T00:40:00.814+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:40:00+00:00, run_after=2024-06-28T00:41:00+00:00 2024-06-28T00:40:00.828579081Z [2024-06-28T00:40:00.828+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:40:00+00:00, run_after=2024-06-28T00:41:00+00:00 2024-06-28T00:40:00.978230607Z [2024-06-28T00:40:00.977+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-28T00:40:00.978260876Z 2024-06-28T00:40:00.978266292Z 2024-06-28T00:40:00.978273910Z 2024-06-28T00:40:00.978281494Z 2024-06-28T00:40:00.978288533Z 2024-06-28T00:40:00.978307596Z [2024-06-28T00:40:00.978+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:40:00.978472112Z [2024-06-28T00:40:00.978+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:40:00.978604429Z [2024-06-28T00:40:00.978+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:40:00.978779913Z [2024-06-28T00:40:00.978+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:40:00.978885453Z [2024-06-28T00:40:00.978+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:40:00.979531839Z [2024-06-28T00:40:00.979+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:40:00.979562824Z 2024-06-28T00:40:00.979568731Z 2024-06-28T00:40:00.979581752Z 2024-06-28T00:40:00.979587036Z 2024-06-28T00:40:00.979591974Z 2024-06-28T00:40:00.983479396Z [2024-06-28T00:40:00.983+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T00:40:00.983591114Z [2024-06-28T00:40:00.983+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:40:00.983838066Z [2024-06-28T00:40:00.983+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:40:00.983969584Z [2024-06-28T00:40:00.983+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:40:00.984211171Z [2024-06-28T00:40:00.984+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:40:00.984343585Z [2024-06-28T00:40:00.984+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:40:00.984548912Z [2024-06-28T00:40:00.984+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:40:00.984675038Z [2024-06-28T00:40:00.984+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:40:00.984885584Z [2024-06-28T00:40:00.984+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:40:00.985014202Z [2024-06-28T00:40:00.984+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:40:01.640145684Z [2024-06-28T00:40:01.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:35:00+00:00 exited with status queued for try_number 1 2024-06-28T00:40:01.640822826Z [2024-06-28T00:40:01.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:38:00+00:00 exited with status queued for try_number 1 2024-06-28T00:40:01.643079065Z [2024-06-28T00:40:01.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:39:00+00:00 exited with status queued for try_number 1 2024-06-28T00:40:01.644158640Z [2024-06-28T00:40:01.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:39:00+00:00 exited with status queued for try_number 1 2024-06-28T00:40:01.644380465Z [2024-06-28T00:40:01.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:39:00+00:00 exited with status queued for try_number 1 2024-06-28T00:40:01.661007326Z [2024-06-28T00:40:01.660+0000] {scheduler_job.py:635} INFO - Setting external_id for to 131c0bb8-e825-4d99-abb8-4225bde5f822 2024-06-28T00:40:01.661265230Z [2024-06-28T00:40:01.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4cba057-4de9-4c44-a60a-f60aab16a6d1 2024-06-28T00:40:01.661486348Z [2024-06-28T00:40:01.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e48cd9c-cf60-4ec2-b810-9dce6b67f745 2024-06-28T00:40:01.661699758Z [2024-06-28T00:40:01.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33b8768b-ce91-4a78-93e6-515d2334247c 2024-06-28T00:40:01.661909993Z [2024-06-28T00:40:01.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8874727a-c040-49cf-ad6b-7fce9644d5de 2024-06-28T00:40:04.462428949Z [2024-06-28T00:40:04.462+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:40:04.468063169Z [2024-06-28T00:40:04.467+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:39:00+00:00, run_id=scheduled__2024-06-28T00:39:00+00:00, run_start_date=2024-06-28 00:40:00.848687+00:00, run_end_date=2024-06-28 00:40:04.462368+00:00, run_duration=3.613681, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:39:00+00:00, data_interval_end=2024-06-28 00:40:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:40:04.501215495Z [2024-06-28T00:40:04.500+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:40:00+00:00, run_after=2024-06-28T00:41:00+00:00 2024-06-28T00:40:04.548265896Z [2024-06-28T00:40:04.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:40:04.550108784Z [2024-06-28T00:40:04.549+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:38:00+00:00, run_id=scheduled__2024-06-28T00:38:00+00:00, run_start_date=2024-06-28 00:40:00.840944+00:00, run_end_date=2024-06-28 00:40:04.549518+00:00, run_duration=3.708574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:38:00+00:00, data_interval_end=2024-06-28 00:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:40:04.567747799Z [2024-06-28T00:40:04.567+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:40:00+00:00, run_after=2024-06-28T00:42:00+00:00 2024-06-28T00:40:04.688524701Z [2024-06-28T00:40:04.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:38:00+00:00 exited with status success for try_number 1 2024-06-28T00:40:04.691780204Z [2024-06-28T00:40:04.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:39:00+00:00 exited with status success for try_number 1 2024-06-28T00:40:04.717614108Z [2024-06-28T00:40:04.717+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:38:00+00:00, map_index=-1, run_start_date=2024-06-28 00:40:02.496917+00:00, run_end_date=2024-06-28 00:40:03.157905+00:00, run_duration=0.660988, state=success, executor_state=success, try_number=1, max_tries=1, job_id=566, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:40:00.980571+00:00, queued_by_job_id=2, pid=8316 2024-06-28T00:40:04.717987713Z [2024-06-28T00:40:04.717+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:39:00+00:00, map_index=-1, run_start_date=2024-06-28 00:40:02.924789+00:00, run_end_date=2024-06-28 00:40:03.521916+00:00, run_duration=0.597127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=567, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:40:00.980571+00:00, queued_by_job_id=2, pid=8318 2024-06-28T00:40:05.836976316Z [2024-06-28T00:40:05.836+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:40:05.836998120Z 2024-06-28T00:40:05.837280408Z [2024-06-28T00:40:05.836+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:40:05.838159925Z [2024-06-28T00:40:05.837+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:40:05.838172043Z 2024-06-28T00:40:05.840558013Z [2024-06-28T00:40:05.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T00:40:05.840999700Z [2024-06-28T00:40:05.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:40:05.903711253Z [2024-06-28T00:40:05.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:35:00+00:00 exited with status queued for try_number 1 2024-06-28T00:40:05.903932344Z [2024-06-28T00:40:05.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:35:00+00:00 exited with status success for try_number 1 2024-06-28T00:40:05.910808387Z [2024-06-28T00:40:05.910+0000] {scheduler_job.py:635} INFO - Setting external_id for to e98a7181-255e-46f2-aba4-c2b6ec07cc70 2024-06-28T00:40:05.913588104Z [2024-06-28T00:40:05.913+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T00:35:00+00:00, map_index=-1, run_start_date=2024-06-28 00:40:04.345034+00:00, run_end_date=2024-06-28 00:40:05.101292+00:00, run_duration=0.756258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=570, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:40:00.980571+00:00, queued_by_job_id=2, pid=8348 2024-06-28T00:40:06.084253483Z [2024-06-28T00:40:06.083+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:40:06.092187995Z [2024-06-28T00:40:06.091+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:39:00+00:00, run_id=scheduled__2024-06-28T00:39:00+00:00, run_start_date=2024-06-28 00:40:00.850207+00:00, run_end_date=2024-06-28 00:40:06.084167+00:00, run_duration=5.23396, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:39:00+00:00, data_interval_end=2024-06-28 00:40:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:40:06.144210361Z [2024-06-28T00:40:06.143+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:40:00+00:00, run_after=2024-06-28T00:41:00+00:00 2024-06-28T00:40:06.369010577Z [2024-06-28T00:40:06.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:39:00+00:00 exited with status success for try_number 1 2024-06-28T00:40:06.380269114Z [2024-06-28T00:40:06.379+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:39:00+00:00, map_index=-1, run_start_date=2024-06-28 00:40:04.076154+00:00, run_end_date=2024-06-28 00:40:05.839826+00:00, run_duration=1.763672, state=success, executor_state=success, try_number=1, max_tries=1, job_id=568, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:40:00.980571+00:00, queued_by_job_id=2, pid=8343 2024-06-28T00:40:07.445222402Z [2024-06-28T00:40:07.444+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:40:07.445405010Z [2024-06-28T00:40:07.445+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:39:00+00:00, run_id=scheduled__2024-06-28T00:39:00+00:00, run_start_date=2024-06-28 00:40:00.851482+00:00, run_end_date=2024-06-28 00:40:07.445155+00:00, run_duration=6.593673, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:39:00+00:00, data_interval_end=2024-06-28 00:40:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:40:07.458800445Z [2024-06-28T00:40:07.458+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:40:00+00:00, run_after=2024-06-28T00:41:00+00:00 2024-06-28T00:40:07.587460425Z [2024-06-28T00:40:07.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:39:00+00:00 exited with status success for try_number 1 2024-06-28T00:40:07.609409384Z [2024-06-28T00:40:07.609+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:39:00+00:00, map_index=-1, run_start_date=2024-06-28 00:40:04.190149+00:00, run_end_date=2024-06-28 00:40:06.532033+00:00, run_duration=2.341884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=569, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:40:00.980571+00:00, queued_by_job_id=2, pid=8347 2024-06-28T00:40:09.129877779Z [2024-06-28T00:40:09.129+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:40:09.129898843Z 2024-06-28T00:40:09.130030760Z [2024-06-28T00:40:09.129+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:40:09.131261386Z [2024-06-28T00:40:09.130+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:40:09.131276331Z 2024-06-28T00:40:09.133510320Z [2024-06-28T00:40:09.133+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T00:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T00:40:09.133572774Z [2024-06-28T00:40:09.133+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T00:40:09.218627804Z [2024-06-28T00:40:09.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:35:00+00:00 exited with status queued for try_number 1 2024-06-28T00:40:09.218777828Z [2024-06-28T00:40:09.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:35:00+00:00 exited with status success for try_number 1 2024-06-28T00:40:09.228924183Z [2024-06-28T00:40:09.228+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e9c8d0f-cbbc-4354-bb78-33b96222eca8 2024-06-28T00:40:09.229061542Z [2024-06-28T00:40:09.228+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T00:35:00+00:00, map_index=-1, run_start_date=2024-06-28 00:40:07.945013+00:00, run_end_date=2024-06-28 00:40:08.365931+00:00, run_duration=0.420918, state=success, executor_state=success, try_number=1, max_tries=1, job_id=571, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:40:05.838559+00:00, queued_by_job_id=2, pid=8371 2024-06-28T00:40:12.161610950Z [2024-06-28T00:40:12.160+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:40:12.161754252Z 2024-06-28T00:40:12.161765040Z [2024-06-28T00:40:12.161+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:40:12.162508855Z [2024-06-28T00:40:12.162+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:40:12.162520681Z 2024-06-28T00:40:12.166327163Z [2024-06-28T00:40:12.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:40:12.166467462Z [2024-06-28T00:40:12.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:40:12.229989305Z [2024-06-28T00:40:12.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:35:00+00:00 exited with status queued for try_number 1 2024-06-28T00:40:12.230341946Z [2024-06-28T00:40:12.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:35:00+00:00 exited with status success for try_number 1 2024-06-28T00:40:12.241555206Z [2024-06-28T00:40:12.241+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e8ec025-13a0-4e36-aaf8-a52e60ddd8a2 2024-06-28T00:40:12.241953666Z [2024-06-28T00:40:12.241+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T00:35:00+00:00, map_index=0, run_start_date=2024-06-28 00:40:10.973123+00:00, run_end_date=2024-06-28 00:40:11.324132+00:00, run_duration=0.351009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=572, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:40:09.131576+00:00, queued_by_job_id=2, pid=8379 2024-06-28T00:40:14.474237087Z [2024-06-28T00:40:14.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:40:14.474579498Z [2024-06-28T00:40:14.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:35:00+00:00, run_id=scheduled__2024-06-28T00:35:00+00:00, run_start_date=2024-06-28 00:40:00.838774+00:00, run_end_date=2024-06-28 00:40:14.474179+00:00, run_duration=13.635405, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:35:00+00:00, data_interval_end=2024-06-28 00:40:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T00:40:14.483305847Z [2024-06-28T00:40:14.483+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:40:00+00:00, run_after=2024-06-28T00:45:00+00:00 2024-06-28T00:40:14.544046662Z [2024-06-28T00:40:14.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:35:00+00:00 exited with status success for try_number 1 2024-06-28T00:40:14.553188051Z [2024-06-28T00:40:14.552+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T00:35:00+00:00, map_index=-1, run_start_date=2024-06-28 00:40:13.985174+00:00, run_end_date=2024-06-28 00:40:14.319093+00:00, run_duration=0.333919, state=success, executor_state=success, try_number=1, max_tries=1, job_id=573, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:40:12.163170+00:00, queued_by_job_id=2, pid=8387 2024-06-28T00:41:00.936908495Z [2024-06-28T00:41:00.936+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:41:00.952296873Z [2024-06-28T00:41:00.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:41:00+00:00, run_after=2024-06-28T00:42:00+00:00 2024-06-28T00:41:00.968232990Z [2024-06-28T00:41:00.967+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:41:00+00:00, run_after=2024-06-28T00:42:00+00:00 2024-06-28T00:41:01.045686717Z [2024-06-28T00:41:01.045+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:41:01.045717361Z 2024-06-28T00:41:01.045722419Z 2024-06-28T00:41:01.045726728Z 2024-06-28T00:41:01.045745406Z [2024-06-28T00:41:01.045+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:41:01.045851943Z [2024-06-28T00:41:01.045+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:41:01.045973975Z [2024-06-28T00:41:01.045+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:41:01.046620788Z [2024-06-28T00:41:01.046+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:41:01.046630070Z 2024-06-28T00:41:01.046648524Z 2024-06-28T00:41:01.046652102Z 2024-06-28T00:41:01.049943197Z [2024-06-28T00:41:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:41:01.050225401Z [2024-06-28T00:41:01.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:41:01.051000715Z [2024-06-28T00:41:01.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:41:01.051127169Z [2024-06-28T00:41:01.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:41:01.051392195Z [2024-06-28T00:41:01.051+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:41:01.051557985Z [2024-06-28T00:41:01.051+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:41:01.370184906Z [2024-06-28T00:41:01.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:40:00+00:00 exited with status queued for try_number 1 2024-06-28T00:41:01.370356834Z [2024-06-28T00:41:01.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:40:00+00:00 exited with status queued for try_number 1 2024-06-28T00:41:01.370516723Z [2024-06-28T00:41:01.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:40:00+00:00 exited with status queued for try_number 1 2024-06-28T00:41:01.377651295Z [2024-06-28T00:41:01.377+0000] {scheduler_job.py:635} INFO - Setting external_id for to d54425be-a03d-4900-a9e0-2f8d3f98b384 2024-06-28T00:41:01.377867457Z [2024-06-28T00:41:01.377+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ab64f79-7633-46e8-9260-7c7169c11fa4 2024-06-28T00:41:01.379023578Z [2024-06-28T00:41:01.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to d981d66d-3c15-4558-ae96-3ce9705bdba6 2024-06-28T00:41:02.529414221Z [2024-06-28T00:41:02.528+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:41:02.529929561Z [2024-06-28T00:41:02.529+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:40:00+00:00, run_id=scheduled__2024-06-28T00:40:00+00:00, run_start_date=2024-06-28 00:41:00.982559+00:00, run_end_date=2024-06-28 00:41:02.529336+00:00, run_duration=1.546777, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:40:00+00:00, data_interval_end=2024-06-28 00:41:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:41:02.542796561Z [2024-06-28T00:41:02.542+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:41:00+00:00, run_after=2024-06-28T00:42:00+00:00 2024-06-28T00:41:02.610545175Z [2024-06-28T00:41:02.610+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:40:00+00:00 exited with status success for try_number 1 2024-06-28T00:41:02.615747105Z [2024-06-28T00:41:02.615+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:40:00+00:00, map_index=-1, run_start_date=2024-06-28 00:41:01.954901+00:00, run_end_date=2024-06-28 00:41:02.339114+00:00, run_duration=0.384213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=574, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:41:01.047388+00:00, queued_by_job_id=2, pid=8409 2024-06-28T00:41:06.202529243Z [2024-06-28T00:41:06.202+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:41:06.202717001Z [2024-06-28T00:41:06.202+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:40:00+00:00, run_id=scheduled__2024-06-28T00:40:00+00:00, run_start_date=2024-06-28 00:41:00.984270+00:00, run_end_date=2024-06-28 00:41:06.202431+00:00, run_duration=5.218161, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:40:00+00:00, data_interval_end=2024-06-28 00:41:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:41:06.213263333Z [2024-06-28T00:41:06.213+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:41:00+00:00, run_after=2024-06-28T00:42:00+00:00 2024-06-28T00:41:06.221287006Z [2024-06-28T00:41:06.220+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:41:06.221439290Z [2024-06-28T00:41:06.221+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:40:00+00:00, run_id=scheduled__2024-06-28T00:40:00+00:00, run_start_date=2024-06-28 00:41:00.985669+00:00, run_end_date=2024-06-28 00:41:06.221215+00:00, run_duration=5.235546, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:40:00+00:00, data_interval_end=2024-06-28 00:41:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:41:06.232071885Z [2024-06-28T00:41:06.231+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:41:00+00:00, run_after=2024-06-28T00:42:00+00:00 2024-06-28T00:41:06.263934048Z [2024-06-28T00:41:06.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:40:00+00:00 exited with status success for try_number 1 2024-06-28T00:41:06.263963589Z [2024-06-28T00:41:06.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:40:00+00:00 exited with status success for try_number 1 2024-06-28T00:41:06.274932082Z [2024-06-28T00:41:06.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:40:00+00:00, map_index=-1, run_start_date=2024-06-28 00:41:03.024276+00:00, run_end_date=2024-06-28 00:41:05.050431+00:00, run_duration=2.026155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=575, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:41:01.047388+00:00, queued_by_job_id=2, pid=8427 2024-06-28T00:41:06.275360392Z [2024-06-28T00:41:06.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:40:00+00:00, map_index=-1, run_start_date=2024-06-28 00:41:03.043622+00:00, run_end_date=2024-06-28 00:41:05.471915+00:00, run_duration=2.428293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=576, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:41:01.047388+00:00, queued_by_job_id=2, pid=8428 2024-06-28T00:41:45.793136417Z [2024-06-28T00:41:45.792+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T00:42:01.054664859Z [2024-06-28T00:42:01.054+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:42:00+00:00, run_after=2024-06-28T00:43:00+00:00 2024-06-28T00:42:01.064277734Z [2024-06-28T00:42:01.063+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:42:01.076991807Z [2024-06-28T00:42:01.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:42:00+00:00, run_after=2024-06-28T00:43:00+00:00 2024-06-28T00:42:01.085864266Z [2024-06-28T00:42:01.085+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:42:01.191602671Z [2024-06-28T00:42:01.191+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:42:01.191704074Z 2024-06-28T00:42:01.191716229Z 2024-06-28T00:42:01.191724981Z 2024-06-28T00:42:01.191755113Z 2024-06-28T00:42:01.192447886Z [2024-06-28T00:42:01.192+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:42:01.193038447Z [2024-06-28T00:42:01.192+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:42:01.193604964Z [2024-06-28T00:42:01.193+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:42:01.194071442Z [2024-06-28T00:42:01.193+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:42:01.195341631Z [2024-06-28T00:42:01.195+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:42:01.195361849Z 2024-06-28T00:42:01.195368383Z 2024-06-28T00:42:01.195374239Z 2024-06-28T00:42:01.195379534Z 2024-06-28T00:42:01.201906313Z [2024-06-28T00:42:01.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:42:01.202359573Z [2024-06-28T00:42:01.202+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:42:01.203037777Z [2024-06-28T00:42:01.202+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:42:01.203507278Z [2024-06-28T00:42:01.203+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:42:01.204068618Z [2024-06-28T00:42:01.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:42:01.204424399Z [2024-06-28T00:42:01.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:42:01.204783812Z [2024-06-28T00:42:01.204+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:42:01.205031687Z [2024-06-28T00:42:01.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:42:01.616215827Z [2024-06-28T00:42:01.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:40:00+00:00 exited with status queued for try_number 1 2024-06-28T00:42:01.616612772Z [2024-06-28T00:42:01.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:41:00+00:00 exited with status queued for try_number 1 2024-06-28T00:42:01.617120162Z [2024-06-28T00:42:01.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:41:00+00:00 exited with status queued for try_number 1 2024-06-28T00:42:01.617290527Z [2024-06-28T00:42:01.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:41:00+00:00 exited with status queued for try_number 1 2024-06-28T00:42:01.643253473Z [2024-06-28T00:42:01.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8970650c-cb3e-421f-9652-fb5d5451ed18 2024-06-28T00:42:01.643511761Z [2024-06-28T00:42:01.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to b234e333-33b0-447a-b951-0af75fae38fa 2024-06-28T00:42:01.643698019Z [2024-06-28T00:42:01.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e494727-1994-4d33-8bff-c57c03d3a9b3 2024-06-28T00:42:01.644035294Z [2024-06-28T00:42:01.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6583a2b2-6550-4f2b-8fe0-aaad9a968d9b 2024-06-28T00:42:02.992058868Z [2024-06-28T00:42:02.991+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:42:02.992669614Z [2024-06-28T00:42:02.992+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:40:00+00:00, run_id=scheduled__2024-06-28T00:40:00+00:00, run_start_date=2024-06-28 00:42:01.104142+00:00, run_end_date=2024-06-28 00:42:02.992163+00:00, run_duration=1.888021, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:40:00+00:00, data_interval_end=2024-06-28 00:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:42:03.018767052Z [2024-06-28T00:42:03.018+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:42:00+00:00, run_after=2024-06-28T00:44:00+00:00 2024-06-28T00:42:03.038784166Z [2024-06-28T00:42:03.038+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:42:03.039094900Z [2024-06-28T00:42:03.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:41:00+00:00, run_id=scheduled__2024-06-28T00:41:00+00:00, run_start_date=2024-06-28 00:42:01.105528+00:00, run_end_date=2024-06-28 00:42:03.038672+00:00, run_duration=1.933144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:41:00+00:00, data_interval_end=2024-06-28 00:42:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:42:03.063663180Z [2024-06-28T00:42:03.063+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:42:00+00:00, run_after=2024-06-28T00:43:00+00:00 2024-06-28T00:42:03.120480772Z [2024-06-28T00:42:03.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:40:00+00:00 exited with status success for try_number 1 2024-06-28T00:42:03.121111987Z [2024-06-28T00:42:03.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:41:00+00:00 exited with status success for try_number 1 2024-06-28T00:42:03.130125255Z [2024-06-28T00:42:03.129+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:41:00+00:00, map_index=-1, run_start_date=2024-06-28 00:42:02.183253+00:00, run_end_date=2024-06-28 00:42:02.677240+00:00, run_duration=0.493987, state=success, executor_state=success, try_number=1, max_tries=1, job_id=577, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:42:01.197519+00:00, queued_by_job_id=2, pid=8460 2024-06-28T00:42:03.130390008Z [2024-06-28T00:42:03.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:40:00+00:00, map_index=-1, run_start_date=2024-06-28 00:42:02.262826+00:00, run_end_date=2024-06-28 00:42:02.741924+00:00, run_duration=0.479098, state=success, executor_state=success, try_number=1, max_tries=1, job_id=578, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:42:01.197519+00:00, queued_by_job_id=2, pid=8461 2024-06-28T00:42:06.302572317Z [2024-06-28T00:42:06.302+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:42:06.302891715Z [2024-06-28T00:42:06.302+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:41:00+00:00, run_id=scheduled__2024-06-28T00:41:00+00:00, run_start_date=2024-06-28 00:42:01.106647+00:00, run_end_date=2024-06-28 00:42:06.302452+00:00, run_duration=5.195805, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:41:00+00:00, data_interval_end=2024-06-28 00:42:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:42:06.311708059Z [2024-06-28T00:42:06.311+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:42:00+00:00, run_after=2024-06-28T00:43:00+00:00 2024-06-28T00:42:06.318180948Z [2024-06-28T00:42:06.317+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:42:06.318408602Z [2024-06-28T00:42:06.318+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:41:00+00:00, run_id=scheduled__2024-06-28T00:41:00+00:00, run_start_date=2024-06-28 00:42:01.107647+00:00, run_end_date=2024-06-28 00:42:06.318096+00:00, run_duration=5.210449, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:41:00+00:00, data_interval_end=2024-06-28 00:42:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:42:06.328868907Z [2024-06-28T00:42:06.328+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:42:00+00:00, run_after=2024-06-28T00:43:00+00:00 2024-06-28T00:42:06.365112664Z [2024-06-28T00:42:06.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:41:00+00:00 exited with status success for try_number 1 2024-06-28T00:42:06.365190768Z [2024-06-28T00:42:06.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:41:00+00:00 exited with status success for try_number 1 2024-06-28T00:42:06.376615448Z [2024-06-28T00:42:06.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:41:00+00:00, map_index=-1, run_start_date=2024-06-28 00:42:03.551903+00:00, run_end_date=2024-06-28 00:42:05.443383+00:00, run_duration=1.89148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=580, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:42:01.197519+00:00, queued_by_job_id=2, pid=8485 2024-06-28T00:42:06.376903090Z [2024-06-28T00:42:06.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:41:00+00:00, map_index=-1, run_start_date=2024-06-28 00:42:03.518976+00:00, run_end_date=2024-06-28 00:42:05.439572+00:00, run_duration=1.920596, state=success, executor_state=success, try_number=1, max_tries=1, job_id=579, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:42:01.197519+00:00, queued_by_job_id=2, pid=8484 2024-06-28T00:43:00.960971055Z [2024-06-28T00:43:00.960+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:43:00+00:00, run_after=2024-06-28T00:44:00+00:00 2024-06-28T00:43:00.971042853Z [2024-06-28T00:43:00.970+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:43:00.985219934Z [2024-06-28T00:43:00.984+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:43:00+00:00, run_after=2024-06-28T00:44:00+00:00 2024-06-28T00:43:01.062444417Z [2024-06-28T00:43:01.062+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:43:01.062456928Z 2024-06-28T00:43:01.062460322Z 2024-06-28T00:43:01.062463396Z 2024-06-28T00:43:01.062731259Z [2024-06-28T00:43:01.062+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:43:01.063011643Z [2024-06-28T00:43:01.062+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:43:01.063251626Z [2024-06-28T00:43:01.063+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:43:01.064031693Z [2024-06-28T00:43:01.063+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:43:01.064043728Z 2024-06-28T00:43:01.064047095Z 2024-06-28T00:43:01.064050165Z 2024-06-28T00:43:01.068461582Z [2024-06-28T00:43:01.068+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:43:01.068751766Z [2024-06-28T00:43:01.068+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:43:01.069115310Z [2024-06-28T00:43:01.068+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:43:01.069351657Z [2024-06-28T00:43:01.069+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:43:01.069691903Z [2024-06-28T00:43:01.069+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:43:01.069920281Z [2024-06-28T00:43:01.069+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:43:01.388047940Z [2024-06-28T00:43:01.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:42:00+00:00 exited with status queued for try_number 1 2024-06-28T00:43:01.388254366Z [2024-06-28T00:43:01.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:42:00+00:00 exited with status queued for try_number 1 2024-06-28T00:43:01.388414091Z [2024-06-28T00:43:01.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:42:00+00:00 exited with status queued for try_number 1 2024-06-28T00:43:01.402144814Z [2024-06-28T00:43:01.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02f1bad4-6d38-4e6b-b5ec-04374931a0a1 2024-06-28T00:43:01.402400162Z [2024-06-28T00:43:01.402+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8690529c-cd8c-4eae-bf78-a5f0c9bf95db 2024-06-28T00:43:01.402637814Z [2024-06-28T00:43:01.402+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2452547a-d9c9-4e43-a931-7d90e1871d70 2024-06-28T00:43:02.658914521Z [2024-06-28T00:43:02.658+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:43:02.659333542Z [2024-06-28T00:43:02.659+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:42:00+00:00, run_id=scheduled__2024-06-28T00:42:00+00:00, run_start_date=2024-06-28 00:43:00.998781+00:00, run_end_date=2024-06-28 00:43:02.658925+00:00, run_duration=1.660144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:42:00+00:00, data_interval_end=2024-06-28 00:43:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:43:02.668875130Z [2024-06-28T00:43:02.668+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:43:00+00:00, run_after=2024-06-28T00:44:00+00:00 2024-06-28T00:43:02.729322333Z [2024-06-28T00:43:02.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:42:00+00:00 exited with status success for try_number 1 2024-06-28T00:43:02.743545233Z [2024-06-28T00:43:02.743+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:42:00+00:00, map_index=-1, run_start_date=2024-06-28 00:43:01.984071+00:00, run_end_date=2024-06-28 00:43:02.380993+00:00, run_duration=0.396922, state=success, executor_state=success, try_number=1, max_tries=1, job_id=581, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:43:01.064946+00:00, queued_by_job_id=2, pid=8516 2024-06-28T00:43:04.616308146Z [2024-06-28T00:43:04.615+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:43:04.616754158Z [2024-06-28T00:43:04.616+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:42:00+00:00, run_id=scheduled__2024-06-28T00:42:00+00:00, run_start_date=2024-06-28 00:43:01.000564+00:00, run_end_date=2024-06-28 00:43:04.616231+00:00, run_duration=3.615667, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:42:00+00:00, data_interval_end=2024-06-28 00:43:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:43:04.636634968Z [2024-06-28T00:43:04.636+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:43:00+00:00, run_after=2024-06-28T00:44:00+00:00 2024-06-28T00:43:05.771594419Z [2024-06-28T00:43:05.771+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:43:05.771754883Z [2024-06-28T00:43:05.771+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:42:00+00:00, run_id=scheduled__2024-06-28T00:42:00+00:00, run_start_date=2024-06-28 00:43:01.001810+00:00, run_end_date=2024-06-28 00:43:05.771515+00:00, run_duration=4.769705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:42:00+00:00, data_interval_end=2024-06-28 00:43:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:43:05.780059339Z [2024-06-28T00:43:05.779+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:43:00+00:00, run_after=2024-06-28T00:44:00+00:00 2024-06-28T00:43:05.820644375Z [2024-06-28T00:43:05.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:42:00+00:00 exited with status success for try_number 1 2024-06-28T00:43:05.820752135Z [2024-06-28T00:43:05.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:42:00+00:00 exited with status success for try_number 1 2024-06-28T00:43:05.863312603Z [2024-06-28T00:43:05.862+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:42:00+00:00, map_index=-1, run_start_date=2024-06-28 00:43:03.146183+00:00, run_end_date=2024-06-28 00:43:05.073522+00:00, run_duration=1.927339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=583, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:43:01.064946+00:00, queued_by_job_id=2, pid=8535 2024-06-28T00:43:05.863500457Z [2024-06-28T00:43:05.863+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:42:00+00:00, map_index=-1, run_start_date=2024-06-28 00:43:03.052484+00:00, run_end_date=2024-06-28 00:43:04.523943+00:00, run_duration=1.471459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=582, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:43:01.064946+00:00, queued_by_job_id=2, pid=8534 2024-06-28T00:44:00.454778593Z [2024-06-28T00:44:00.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:44:00+00:00, run_after=2024-06-28T00:45:00+00:00 2024-06-28T00:44:00.471823440Z [2024-06-28T00:44:00.471+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:44:00+00:00, run_after=2024-06-28T00:45:00+00:00 2024-06-28T00:44:00.483817983Z [2024-06-28T00:44:00.483+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:44:00.491278465Z [2024-06-28T00:44:00.490+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:44:00.577509089Z [2024-06-28T00:44:00.577+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:44:00.577527058Z 2024-06-28T00:44:00.577535630Z 2024-06-28T00:44:00.577539272Z 2024-06-28T00:44:00.577542576Z 2024-06-28T00:44:00.578444962Z [2024-06-28T00:44:00.578+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:44:00.578859109Z [2024-06-28T00:44:00.578+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:44:00.579172249Z [2024-06-28T00:44:00.578+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:44:00.579475149Z [2024-06-28T00:44:00.579+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:44:00.580488522Z [2024-06-28T00:44:00.580+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:44:00.580500351Z 2024-06-28T00:44:00.580504047Z 2024-06-28T00:44:00.580512709Z 2024-06-28T00:44:00.580515825Z 2024-06-28T00:44:00.585470443Z [2024-06-28T00:44:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:44:00.585768880Z [2024-06-28T00:44:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:44:00.586179401Z [2024-06-28T00:44:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:44:00.586408225Z [2024-06-28T00:44:00.586+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:44:00.586835874Z [2024-06-28T00:44:00.586+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:44:00.587187470Z [2024-06-28T00:44:00.586+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:44:00.587543607Z [2024-06-28T00:44:00.587+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:44:00.587787041Z [2024-06-28T00:44:00.587+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:44:01.029083153Z [2024-06-28T00:44:01.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:42:00+00:00 exited with status queued for try_number 1 2024-06-28T00:44:01.029240089Z [2024-06-28T00:44:01.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:43:00+00:00 exited with status queued for try_number 1 2024-06-28T00:44:01.029401358Z [2024-06-28T00:44:01.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:43:00+00:00 exited with status queued for try_number 1 2024-06-28T00:44:01.029577543Z [2024-06-28T00:44:01.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:43:00+00:00 exited with status queued for try_number 1 2024-06-28T00:44:01.051645768Z [2024-06-28T00:44:01.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34d8e308-6180-45a3-936f-497c95ba4b94 2024-06-28T00:44:01.052077588Z [2024-06-28T00:44:01.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d9d3ff1-6563-4ee0-81fb-5073d327d27a 2024-06-28T00:44:01.052297255Z [2024-06-28T00:44:01.052+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1d7797c-974a-4a98-b424-a758092bc48d 2024-06-28T00:44:01.052465356Z [2024-06-28T00:44:01.052+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61084d89-1c23-49a2-a59e-8a5d44bd1dbd 2024-06-28T00:44:02.312346467Z [2024-06-28T00:44:02.311+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:44:02.312967231Z [2024-06-28T00:44:02.312+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:42:00+00:00, run_id=scheduled__2024-06-28T00:42:00+00:00, run_start_date=2024-06-28 00:44:00.502197+00:00, run_end_date=2024-06-28 00:44:02.312523+00:00, run_duration=1.810326, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:42:00+00:00, data_interval_end=2024-06-28 00:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:44:02.321753211Z [2024-06-28T00:44:02.321+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:44:00+00:00, run_after=2024-06-28T00:46:00+00:00 2024-06-28T00:44:02.339562751Z [2024-06-28T00:44:02.339+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:44:02.340231925Z [2024-06-28T00:44:02.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:43:00+00:00, run_id=scheduled__2024-06-28T00:43:00+00:00, run_start_date=2024-06-28 00:44:00.503906+00:00, run_end_date=2024-06-28 00:44:02.339421+00:00, run_duration=1.835515, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:43:00+00:00, data_interval_end=2024-06-28 00:44:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:44:02.350285527Z [2024-06-28T00:44:02.349+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:44:00+00:00, run_after=2024-06-28T00:45:00+00:00 2024-06-28T00:44:02.394091818Z [2024-06-28T00:44:02.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:42:00+00:00 exited with status success for try_number 1 2024-06-28T00:44:02.394223163Z [2024-06-28T00:44:02.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:43:00+00:00 exited with status success for try_number 1 2024-06-28T00:44:02.401536423Z [2024-06-28T00:44:02.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:43:00+00:00, map_index=-1, run_start_date=2024-06-28 00:44:01.599195+00:00, run_end_date=2024-06-28 00:44:02.174191+00:00, run_duration=0.574996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=585, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:44:00.581975+00:00, queued_by_job_id=2, pid=8569 2024-06-28T00:44:02.401800022Z [2024-06-28T00:44:02.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:42:00+00:00, map_index=-1, run_start_date=2024-06-28 00:44:01.515479+00:00, run_end_date=2024-06-28 00:44:01.971631+00:00, run_duration=0.456152, state=success, executor_state=success, try_number=1, max_tries=1, job_id=584, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:44:00.581975+00:00, queued_by_job_id=2, pid=8568 2024-06-28T00:44:05.106493362Z [2024-06-28T00:44:05.106+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:44:05.107270640Z [2024-06-28T00:44:05.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:43:00+00:00, run_id=scheduled__2024-06-28T00:43:00+00:00, run_start_date=2024-06-28 00:44:00.505149+00:00, run_end_date=2024-06-28 00:44:05.106578+00:00, run_duration=4.601429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:43:00+00:00, data_interval_end=2024-06-28 00:44:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:44:05.116915224Z [2024-06-28T00:44:05.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:44:00+00:00, run_after=2024-06-28T00:45:00+00:00 2024-06-28T00:44:05.178322692Z [2024-06-28T00:44:05.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:43:00+00:00 exited with status success for try_number 1 2024-06-28T00:44:05.190824126Z [2024-06-28T00:44:05.190+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:43:00+00:00, map_index=-1, run_start_date=2024-06-28 00:44:03.000181+00:00, run_end_date=2024-06-28 00:44:04.658372+00:00, run_duration=1.658191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=587, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:44:00.581975+00:00, queued_by_job_id=2, pid=8593 2024-06-28T00:44:06.262911066Z [2024-06-28T00:44:06.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:44:06.263295410Z [2024-06-28T00:44:06.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:43:00+00:00, run_id=scheduled__2024-06-28T00:43:00+00:00, run_start_date=2024-06-28 00:44:00.506428+00:00, run_end_date=2024-06-28 00:44:06.262829+00:00, run_duration=5.756401, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:43:00+00:00, data_interval_end=2024-06-28 00:44:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:44:06.282898501Z [2024-06-28T00:44:06.282+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:44:00+00:00, run_after=2024-06-28T00:45:00+00:00 2024-06-28T00:44:06.316497628Z [2024-06-28T00:44:06.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:43:00+00:00 exited with status success for try_number 1 2024-06-28T00:44:06.323222026Z [2024-06-28T00:44:06.322+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:43:00+00:00, map_index=-1, run_start_date=2024-06-28 00:44:02.928049+00:00, run_end_date=2024-06-28 00:44:05.186518+00:00, run_duration=2.258469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=586, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:44:00.581975+00:00, queued_by_job_id=2, pid=8592 2024-06-28T00:45:00.409579933Z [2024-06-28T00:45:00.409+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:45:00+00:00, run_after=2024-06-28T00:46:00+00:00 2024-06-28T00:45:00.423722124Z [2024-06-28T00:45:00.423+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:45:00+00:00, run_after=2024-06-28T00:46:00+00:00 2024-06-28T00:45:00.434338017Z [2024-06-28T00:45:00.434+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:45:00+00:00, run_after=2024-06-28T00:50:00+00:00 2024-06-28T00:45:00.440790058Z [2024-06-28T00:45:00.440+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:45:00.519260336Z [2024-06-28T00:45:00.518+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:45:00.519289478Z 2024-06-28T00:45:00.519317145Z 2024-06-28T00:45:00.519323247Z 2024-06-28T00:45:00.519329163Z 2024-06-28T00:45:00.519346149Z [2024-06-28T00:45:00.519+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:45:00.519564597Z [2024-06-28T00:45:00.519+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:45:00.519721824Z [2024-06-28T00:45:00.519+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:45:00.519875767Z [2024-06-28T00:45:00.519+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:45:00.520551578Z [2024-06-28T00:45:00.520+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:45:00.520562421Z 2024-06-28T00:45:00.520567821Z 2024-06-28T00:45:00.520572754Z 2024-06-28T00:45:00.520577685Z 2024-06-28T00:45:00.524899890Z [2024-06-28T00:45:00.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T00:45:00.524914339Z [2024-06-28T00:45:00.524+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:45:00.525151688Z [2024-06-28T00:45:00.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:45:00.525323900Z [2024-06-28T00:45:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:45:00.525604788Z [2024-06-28T00:45:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:45:00.525749868Z [2024-06-28T00:45:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:45:00.526016670Z [2024-06-28T00:45:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:45:00.526181554Z [2024-06-28T00:45:00.526+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:45:00.984718306Z [2024-06-28T00:45:00.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:40:00+00:00 exited with status queued for try_number 1 2024-06-28T00:45:00.984920034Z [2024-06-28T00:45:00.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:44:00+00:00 exited with status queued for try_number 1 2024-06-28T00:45:00.985061856Z [2024-06-28T00:45:00.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:44:00+00:00 exited with status queued for try_number 1 2024-06-28T00:45:00.985194583Z [2024-06-28T00:45:00.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:44:00+00:00 exited with status queued for try_number 1 2024-06-28T00:45:01.006955899Z [2024-06-28T00:45:01.006+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05f5970b-ac5b-48dd-92b5-a99c8e096487 2024-06-28T00:45:01.007079494Z [2024-06-28T00:45:01.006+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c117471-2c4f-4cb2-a767-7cd21a6e7756 2024-06-28T00:45:01.007188665Z [2024-06-28T00:45:01.007+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e38aca2-c18a-4ddf-95eb-f3fa8733e22e 2024-06-28T00:45:01.007287927Z [2024-06-28T00:45:01.007+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0406a84-dbde-4950-957c-9c5f7eb8c86a 2024-06-28T00:45:02.283159929Z [2024-06-28T00:45:02.282+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:45:02.283710962Z [2024-06-28T00:45:02.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:44:00+00:00, run_id=scheduled__2024-06-28T00:44:00+00:00, run_start_date=2024-06-28 00:45:00.453000+00:00, run_end_date=2024-06-28 00:45:02.283082+00:00, run_duration=1.830082, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:44:00+00:00, data_interval_end=2024-06-28 00:45:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:45:02.296228504Z [2024-06-28T00:45:02.295+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:45:00+00:00, run_after=2024-06-28T00:46:00+00:00 2024-06-28T00:45:03.359775737Z [2024-06-28T00:45:03.359+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:45:03.359789234Z 2024-06-28T00:45:03.359975423Z [2024-06-28T00:45:03.359+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:45:03.360576121Z [2024-06-28T00:45:03.360+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:45:03.360590416Z 2024-06-28T00:45:03.370649009Z [2024-06-28T00:45:03.365+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T00:45:03.370993209Z [2024-06-28T00:45:03.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:45:03.474514975Z [2024-06-28T00:45:03.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:40:00+00:00 exited with status queued for try_number 1 2024-06-28T00:45:03.475636176Z [2024-06-28T00:45:03.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:40:00+00:00 exited with status success for try_number 1 2024-06-28T00:45:03.475883826Z [2024-06-28T00:45:03.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:44:00+00:00 exited with status success for try_number 1 2024-06-28T00:45:03.486079489Z [2024-06-28T00:45:03.485+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T00:40:00+00:00, map_index=-1, run_start_date=2024-06-28 00:45:02.790245+00:00, run_end_date=2024-06-28 00:45:03.229628+00:00, run_duration=0.439383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=589, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:45:00.521446+00:00, queued_by_job_id=2, pid=8645 2024-06-28T00:45:03.487130251Z [2024-06-28T00:45:03.486+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba1a2745-f7f4-4522-9086-78e7fd6261d2 2024-06-28T00:45:03.487664147Z [2024-06-28T00:45:03.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:44:00+00:00, map_index=-1, run_start_date=2024-06-28 00:45:01.719030+00:00, run_end_date=2024-06-28 00:45:02.201608+00:00, run_duration=0.482578, state=success, executor_state=success, try_number=1, max_tries=1, job_id=588, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:45:00.521446+00:00, queued_by_job_id=2, pid=8626 2024-06-28T00:45:05.682755611Z [2024-06-28T00:45:05.682+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:45:05.684827930Z [2024-06-28T00:45:05.684+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:44:00+00:00, run_id=scheduled__2024-06-28T00:44:00+00:00, run_start_date=2024-06-28 00:45:00.454787+00:00, run_end_date=2024-06-28 00:45:05.682656+00:00, run_duration=5.227869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:44:00+00:00, data_interval_end=2024-06-28 00:45:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:45:05.707259773Z [2024-06-28T00:45:05.706+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:45:00+00:00, run_after=2024-06-28T00:46:00+00:00 2024-06-28T00:45:05.721615137Z [2024-06-28T00:45:05.721+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:45:05.721788225Z [2024-06-28T00:45:05.721+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:44:00+00:00, run_id=scheduled__2024-06-28T00:44:00+00:00, run_start_date=2024-06-28 00:45:00.456030+00:00, run_end_date=2024-06-28 00:45:05.721538+00:00, run_duration=5.265508, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:44:00+00:00, data_interval_end=2024-06-28 00:45:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:45:05.742483952Z [2024-06-28T00:45:05.742+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:45:00+00:00, run_after=2024-06-28T00:46:00+00:00 2024-06-28T00:45:05.836301334Z [2024-06-28T00:45:05.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:44:00+00:00 exited with status success for try_number 1 2024-06-28T00:45:05.836631879Z [2024-06-28T00:45:05.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:44:00+00:00 exited with status success for try_number 1 2024-06-28T00:45:05.857267015Z [2024-06-28T00:45:05.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:44:00+00:00, map_index=-1, run_start_date=2024-06-28 00:45:03.068817+00:00, run_end_date=2024-06-28 00:45:04.800289+00:00, run_duration=1.731472, state=success, executor_state=success, try_number=1, max_tries=1, job_id=590, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:45:00.521446+00:00, queued_by_job_id=2, pid=8652 2024-06-28T00:45:05.857588052Z [2024-06-28T00:45:05.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:44:00+00:00, map_index=-1, run_start_date=2024-06-28 00:45:03.070216+00:00, run_end_date=2024-06-28 00:45:04.989993+00:00, run_duration=1.919777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=591, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:45:00.521446+00:00, queued_by_job_id=2, pid=8651 2024-06-28T00:45:06.942207368Z [2024-06-28T00:45:06.941+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:45:06.942232676Z 2024-06-28T00:45:06.942416660Z [2024-06-28T00:45:06.942+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:45:06.943072781Z [2024-06-28T00:45:06.942+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:45:06.943085395Z 2024-06-28T00:45:06.945627452Z [2024-06-28T00:45:06.945+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T00:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T00:45:06.945782460Z [2024-06-28T00:45:06.945+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T00:45:07.009162764Z [2024-06-28T00:45:07.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:40:00+00:00 exited with status queued for try_number 1 2024-06-28T00:45:07.009269229Z [2024-06-28T00:45:07.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:40:00+00:00 exited with status success for try_number 1 2024-06-28T00:45:07.019626400Z [2024-06-28T00:45:07.019+0000] {scheduler_job.py:635} INFO - Setting external_id for to 951ddf03-0983-400c-91b6-147a22c719ce 2024-06-28T00:45:07.019845959Z [2024-06-28T00:45:07.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T00:40:00+00:00, map_index=-1, run_start_date=2024-06-28 00:45:05.418658+00:00, run_end_date=2024-06-28 00:45:05.893701+00:00, run_duration=0.475043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=592, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:45:03.361786+00:00, queued_by_job_id=2, pid=8675 2024-06-28T00:45:09.951293432Z [2024-06-28T00:45:09.950+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:45:09.951320398Z 2024-06-28T00:45:09.951496041Z [2024-06-28T00:45:09.951+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:45:09.952788531Z [2024-06-28T00:45:09.952+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:45:09.952801288Z 2024-06-28T00:45:09.957567011Z [2024-06-28T00:45:09.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:45:09.957710322Z [2024-06-28T00:45:09.957+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:45:10.019651828Z [2024-06-28T00:45:10.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:40:00+00:00 exited with status queued for try_number 1 2024-06-28T00:45:10.019805995Z [2024-06-28T00:45:10.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:40:00+00:00 exited with status success for try_number 1 2024-06-28T00:45:10.028269688Z [2024-06-28T00:45:10.027+0000] {scheduler_job.py:635} INFO - Setting external_id for to 753494f4-770e-474f-bf8e-e06a2302c53a 2024-06-28T00:45:10.028933583Z [2024-06-28T00:45:10.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T00:40:00+00:00, map_index=0, run_start_date=2024-06-28 00:45:08.817965+00:00, run_end_date=2024-06-28 00:45:09.149396+00:00, run_duration=0.331431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=593, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:45:06.943545+00:00, queued_by_job_id=2, pid=8683 2024-06-28T00:45:12.233138693Z [2024-06-28T00:45:12.232+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:45:12.233478979Z [2024-06-28T00:45:12.233+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:40:00+00:00, run_id=scheduled__2024-06-28T00:40:00+00:00, run_start_date=2024-06-28 00:45:00.451799+00:00, run_end_date=2024-06-28 00:45:12.233007+00:00, run_duration=11.781208, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:40:00+00:00, data_interval_end=2024-06-28 00:45:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T00:45:12.239467830Z [2024-06-28T00:45:12.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:45:00+00:00, run_after=2024-06-28T00:50:00+00:00 2024-06-28T00:45:12.275784714Z [2024-06-28T00:45:12.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:40:00+00:00 exited with status success for try_number 1 2024-06-28T00:45:12.283073105Z [2024-06-28T00:45:12.282+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T00:40:00+00:00, map_index=-1, run_start_date=2024-06-28 00:45:11.525650+00:00, run_end_date=2024-06-28 00:45:11.894082+00:00, run_duration=0.368432, state=success, executor_state=success, try_number=1, max_tries=1, job_id=594, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:45:09.953536+00:00, queued_by_job_id=2, pid=8691 2024-06-28T00:46:00.788419655Z [2024-06-28T00:46:00.787+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:46:00.815750995Z [2024-06-28T00:46:00.815+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:46:00+00:00, run_after=2024-06-28T00:47:00+00:00 2024-06-28T00:46:00.828197995Z [2024-06-28T00:46:00.827+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:46:00.843876190Z [2024-06-28T00:46:00.843+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:46:00+00:00, run_after=2024-06-28T00:47:00+00:00 2024-06-28T00:46:00.948706758Z [2024-06-28T00:46:00.948+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:46:00.948738225Z 2024-06-28T00:46:00.948745626Z 2024-06-28T00:46:00.948751693Z 2024-06-28T00:46:00.948757653Z 2024-06-28T00:46:00.949028653Z [2024-06-28T00:46:00.948+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:46:00.949417188Z [2024-06-28T00:46:00.949+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:46:00.949781708Z [2024-06-28T00:46:00.949+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:46:00.950183334Z [2024-06-28T00:46:00.949+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:46:00.951241071Z [2024-06-28T00:46:00.950+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:46:00.951273549Z 2024-06-28T00:46:00.951279557Z 2024-06-28T00:46:00.951284336Z 2024-06-28T00:46:00.951288915Z 2024-06-28T00:46:00.956101222Z [2024-06-28T00:46:00.955+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:46:00.956342311Z [2024-06-28T00:46:00.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:46:00.956767286Z [2024-06-28T00:46:00.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:46:00.956948627Z [2024-06-28T00:46:00.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:46:00.957164565Z [2024-06-28T00:46:00.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:46:00.957284189Z [2024-06-28T00:46:00.957+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:46:00.957501001Z [2024-06-28T00:46:00.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:46:00.957628847Z [2024-06-28T00:46:00.957+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:46:01.335434416Z [2024-06-28T00:46:01.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:44:00+00:00 exited with status queued for try_number 1 2024-06-28T00:46:01.335641097Z [2024-06-28T00:46:01.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:45:00+00:00 exited with status queued for try_number 1 2024-06-28T00:46:01.335792817Z [2024-06-28T00:46:01.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:45:00+00:00 exited with status queued for try_number 1 2024-06-28T00:46:01.335925980Z [2024-06-28T00:46:01.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:45:00+00:00 exited with status queued for try_number 1 2024-06-28T00:46:01.352135775Z [2024-06-28T00:46:01.351+0000] {scheduler_job.py:635} INFO - Setting external_id for to fece608e-d12b-4d78-a829-dfde538c2a7d 2024-06-28T00:46:01.352785388Z [2024-06-28T00:46:01.352+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a83f14b-a365-4a6d-846e-fd2ddfccc112 2024-06-28T00:46:01.353056265Z [2024-06-28T00:46:01.352+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19f06759-2119-4b56-a34b-b8391664b09a 2024-06-28T00:46:01.353301262Z [2024-06-28T00:46:01.353+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b8ced11-2ab3-445d-813e-565f925447dd 2024-06-28T00:46:02.612661585Z [2024-06-28T00:46:02.612+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:46:02.613231790Z [2024-06-28T00:46:02.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:44:00+00:00, run_id=scheduled__2024-06-28T00:44:00+00:00, run_start_date=2024-06-28 00:46:00.856942+00:00, run_end_date=2024-06-28 00:46:02.612837+00:00, run_duration=1.755895, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:44:00+00:00, data_interval_end=2024-06-28 00:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:46:02.636179859Z [2024-06-28T00:46:02.635+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:46:00+00:00, run_after=2024-06-28T00:48:00+00:00 2024-06-28T00:46:02.766576860Z [2024-06-28T00:46:02.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:44:00+00:00 exited with status success for try_number 1 2024-06-28T00:46:02.778694242Z [2024-06-28T00:46:02.778+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:44:00+00:00, map_index=-1, run_start_date=2024-06-28 00:46:01.960486+00:00, run_end_date=2024-06-28 00:46:02.441727+00:00, run_duration=0.481241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=595, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:46:00.952713+00:00, queued_by_job_id=2, pid=8709 2024-06-28T00:46:03.922299722Z [2024-06-28T00:46:03.921+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:46:03.923282494Z [2024-06-28T00:46:03.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:45:00+00:00, run_id=scheduled__2024-06-28T00:45:00+00:00, run_start_date=2024-06-28 00:46:00.858384+00:00, run_end_date=2024-06-28 00:46:03.922884+00:00, run_duration=3.0645, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:45:00+00:00, data_interval_end=2024-06-28 00:46:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:46:03.936966898Z [2024-06-28T00:46:03.936+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:46:00+00:00, run_after=2024-06-28T00:47:00+00:00 2024-06-28T00:46:04.011620932Z [2024-06-28T00:46:04.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:45:00+00:00 exited with status success for try_number 1 2024-06-28T00:46:04.027713141Z [2024-06-28T00:46:04.027+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:45:00+00:00, map_index=-1, run_start_date=2024-06-28 00:46:02.348392+00:00, run_end_date=2024-06-28 00:46:02.859743+00:00, run_duration=0.511351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=596, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:46:00.952713+00:00, queued_by_job_id=2, pid=8720 2024-06-28T00:46:05.970671392Z [2024-06-28T00:46:05.970+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:46:05.971001767Z [2024-06-28T00:46:05.970+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:45:00+00:00, run_id=scheduled__2024-06-28T00:45:00+00:00, run_start_date=2024-06-28 00:46:00.859534+00:00, run_end_date=2024-06-28 00:46:05.970663+00:00, run_duration=5.111129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:45:00+00:00, data_interval_end=2024-06-28 00:46:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:46:05.979219950Z [2024-06-28T00:46:05.979+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:46:00+00:00, run_after=2024-06-28T00:47:00+00:00 2024-06-28T00:46:05.985567086Z [2024-06-28T00:46:05.985+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:46:05.985817077Z [2024-06-28T00:46:05.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:45:00+00:00, run_id=scheduled__2024-06-28T00:45:00+00:00, run_start_date=2024-06-28 00:46:00.860588+00:00, run_end_date=2024-06-28 00:46:05.985561+00:00, run_duration=5.124973, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:45:00+00:00, data_interval_end=2024-06-28 00:46:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:46:05.994752128Z [2024-06-28T00:46:05.994+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:46:00+00:00, run_after=2024-06-28T00:47:00+00:00 2024-06-28T00:46:06.030591329Z [2024-06-28T00:46:06.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:45:00+00:00 exited with status success for try_number 1 2024-06-28T00:46:06.032682020Z [2024-06-28T00:46:06.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:45:00+00:00 exited with status success for try_number 1 2024-06-28T00:46:06.040055540Z [2024-06-28T00:46:06.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:45:00+00:00, map_index=-1, run_start_date=2024-06-28 00:46:03.799839+00:00, run_end_date=2024-06-28 00:46:05.406412+00:00, run_duration=1.606573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=597, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:46:00.952713+00:00, queued_by_job_id=2, pid=8738 2024-06-28T00:46:06.040273912Z [2024-06-28T00:46:06.040+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:45:00+00:00, map_index=-1, run_start_date=2024-06-28 00:46:03.840692+00:00, run_end_date=2024-06-28 00:46:05.746400+00:00, run_duration=1.905708, state=success, executor_state=success, try_number=1, max_tries=1, job_id=598, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:46:00.952713+00:00, queued_by_job_id=2, pid=8739 2024-06-28T00:46:45.847109485Z [2024-06-28T00:46:45.846+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T00:47:00.849341752Z [2024-06-28T00:47:00.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:47:00+00:00, run_after=2024-06-28T00:48:00+00:00 2024-06-28T00:47:00.868799035Z [2024-06-28T00:47:00.868+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:47:00+00:00, run_after=2024-06-28T00:48:00+00:00 2024-06-28T00:47:00.877506938Z [2024-06-28T00:47:00.877+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:47:00.984393405Z [2024-06-28T00:47:00.983+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:47:00.984435629Z 2024-06-28T00:47:00.984446237Z 2024-06-28T00:47:00.984455165Z 2024-06-28T00:47:00.985023638Z [2024-06-28T00:47:00.984+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:47:00.985464671Z [2024-06-28T00:47:00.984+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:47:00.985692532Z [2024-06-28T00:47:00.985+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:47:00.986787490Z [2024-06-28T00:47:00.986+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:47:00.986803453Z 2024-06-28T00:47:00.986807023Z 2024-06-28T00:47:00.986810322Z 2024-06-28T00:47:00.994304891Z [2024-06-28T00:47:00.993+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:47:00.994982903Z [2024-06-28T00:47:00.994+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:47:00.995493519Z [2024-06-28T00:47:00.995+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:47:00.995992933Z [2024-06-28T00:47:00.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:47:00.996327192Z [2024-06-28T00:47:00.996+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:47:00.996488420Z [2024-06-28T00:47:00.996+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:47:01.388450450Z [2024-06-28T00:47:01.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:46:00+00:00 exited with status queued for try_number 1 2024-06-28T00:47:01.388495007Z [2024-06-28T00:47:01.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:46:00+00:00 exited with status queued for try_number 1 2024-06-28T00:47:01.388659531Z [2024-06-28T00:47:01.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:46:00+00:00 exited with status queued for try_number 1 2024-06-28T00:47:01.402776242Z [2024-06-28T00:47:01.402+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb661036-5637-4186-9a04-d8d7c83d39ac 2024-06-28T00:47:01.403519458Z [2024-06-28T00:47:01.403+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35df6ae5-1c88-4402-91e9-1af4d1e7db7c 2024-06-28T00:47:01.404493986Z [2024-06-28T00:47:01.403+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17e0d6da-d03b-455b-88a5-bc53affd66bc 2024-06-28T00:47:02.711500603Z [2024-06-28T00:47:02.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:47:02.712224679Z [2024-06-28T00:47:02.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:46:00+00:00, run_id=scheduled__2024-06-28T00:46:00+00:00, run_start_date=2024-06-28 00:47:00.890157+00:00, run_end_date=2024-06-28 00:47:02.711839+00:00, run_duration=1.821682, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:46:00+00:00, data_interval_end=2024-06-28 00:47:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:47:02.723505425Z [2024-06-28T00:47:02.723+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:47:00+00:00, run_after=2024-06-28T00:48:00+00:00 2024-06-28T00:47:02.827848236Z [2024-06-28T00:47:02.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:46:00+00:00 exited with status success for try_number 1 2024-06-28T00:47:02.835037781Z [2024-06-28T00:47:02.834+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:46:00+00:00, map_index=-1, run_start_date=2024-06-28 00:47:01.990842+00:00, run_end_date=2024-06-28 00:47:02.549883+00:00, run_duration=0.559041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=599, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:47:00.989589+00:00, queued_by_job_id=2, pid=8771 2024-06-28T00:47:05.115639073Z [2024-06-28T00:47:05.115+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:47:05.115839894Z [2024-06-28T00:47:05.115+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:46:00+00:00, run_id=scheduled__2024-06-28T00:46:00+00:00, run_start_date=2024-06-28 00:47:00.891645+00:00, run_end_date=2024-06-28 00:47:05.115575+00:00, run_duration=4.22393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:46:00+00:00, data_interval_end=2024-06-28 00:47:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:47:05.137497414Z [2024-06-28T00:47:05.137+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:47:00+00:00, run_after=2024-06-28T00:48:00+00:00 2024-06-28T00:47:06.231872114Z [2024-06-28T00:47:06.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:47:06.232637815Z [2024-06-28T00:47:06.232+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:46:00+00:00, run_id=scheduled__2024-06-28T00:46:00+00:00, run_start_date=2024-06-28 00:47:00.892832+00:00, run_end_date=2024-06-28 00:47:06.231839+00:00, run_duration=5.339007, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:46:00+00:00, data_interval_end=2024-06-28 00:47:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:47:06.246516894Z [2024-06-28T00:47:06.245+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:47:00+00:00, run_after=2024-06-28T00:48:00+00:00 2024-06-28T00:47:06.303559764Z [2024-06-28T00:47:06.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:46:00+00:00 exited with status success for try_number 1 2024-06-28T00:47:06.303676526Z [2024-06-28T00:47:06.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:46:00+00:00 exited with status success for try_number 1 2024-06-28T00:47:06.317963036Z [2024-06-28T00:47:06.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:46:00+00:00, map_index=-1, run_start_date=2024-06-28 00:47:03.584506+00:00, run_end_date=2024-06-28 00:47:05.072453+00:00, run_duration=1.487947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=601, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:47:00.989589+00:00, queued_by_job_id=2, pid=8790 2024-06-28T00:47:06.317989383Z [2024-06-28T00:47:06.316+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:46:00+00:00, map_index=-1, run_start_date=2024-06-28 00:47:03.263924+00:00, run_end_date=2024-06-28 00:47:05.069219+00:00, run_duration=1.805295, state=success, executor_state=success, try_number=1, max_tries=1, job_id=600, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:47:00.989589+00:00, queued_by_job_id=2, pid=8784 2024-06-28T00:48:00.214298340Z [2024-06-28T00:48:00.214+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:48:00+00:00, run_after=2024-06-28T00:49:00+00:00 2024-06-28T00:48:00.222048317Z [2024-06-28T00:48:00.221+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:48:00.228540185Z [2024-06-28T00:48:00.228+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:48:00.249042048Z [2024-06-28T00:48:00.248+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:48:00+00:00, run_after=2024-06-28T00:49:00+00:00 2024-06-28T00:48:00.357846074Z [2024-06-28T00:48:00.357+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:48:00.357865319Z 2024-06-28T00:48:00.357869518Z 2024-06-28T00:48:00.357872938Z 2024-06-28T00:48:00.357876130Z 2024-06-28T00:48:00.358001056Z [2024-06-28T00:48:00.357+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:48:00.358150499Z [2024-06-28T00:48:00.358+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:48:00.358297631Z [2024-06-28T00:48:00.358+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:48:00.358454601Z [2024-06-28T00:48:00.358+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:48:00.359180365Z [2024-06-28T00:48:00.358+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:48:00.359196179Z 2024-06-28T00:48:00.359216260Z 2024-06-28T00:48:00.359220196Z 2024-06-28T00:48:00.359223804Z 2024-06-28T00:48:00.362549506Z [2024-06-28T00:48:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:48:00.362779225Z [2024-06-28T00:48:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:48:00.363240010Z [2024-06-28T00:48:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:48:00.363421404Z [2024-06-28T00:48:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:48:00.363670076Z [2024-06-28T00:48:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:48:00.363835226Z [2024-06-28T00:48:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:48:00.364112693Z [2024-06-28T00:48:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:48:00.364274829Z [2024-06-28T00:48:00.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:48:00.685714605Z [2024-06-28T00:48:00.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:46:00+00:00 exited with status queued for try_number 1 2024-06-28T00:48:00.685975685Z [2024-06-28T00:48:00.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:47:00+00:00 exited with status queued for try_number 1 2024-06-28T00:48:00.686181547Z [2024-06-28T00:48:00.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:47:00+00:00 exited with status queued for try_number 1 2024-06-28T00:48:00.686416830Z [2024-06-28T00:48:00.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:47:00+00:00 exited with status queued for try_number 1 2024-06-28T00:48:00.697082809Z [2024-06-28T00:48:00.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3de13e3-54e0-4aeb-b81b-f8c802788e27 2024-06-28T00:48:00.697345720Z [2024-06-28T00:48:00.697+0000] {scheduler_job.py:635} INFO - Setting external_id for to df7bc30e-2b1c-4546-9950-a470dd3d2f81 2024-06-28T00:48:00.697551466Z [2024-06-28T00:48:00.697+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c81fbce-76e7-4022-bb9c-f64a0665dda1 2024-06-28T00:48:00.697756493Z [2024-06-28T00:48:00.697+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a49d638-cd70-4881-885b-a4200cd7641b 2024-06-28T00:48:01.937431301Z [2024-06-28T00:48:01.937+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:48:01.938588972Z [2024-06-28T00:48:01.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:46:00+00:00, run_id=scheduled__2024-06-28T00:46:00+00:00, run_start_date=2024-06-28 00:48:00.274214+00:00, run_end_date=2024-06-28 00:48:01.937363+00:00, run_duration=1.663149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:46:00+00:00, data_interval_end=2024-06-28 00:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:48:01.949627969Z [2024-06-28T00:48:01.949+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:48:00+00:00, run_after=2024-06-28T00:50:00+00:00 2024-06-28T00:48:02.273589445Z [2024-06-28T00:48:02.273+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:48:02.274270260Z [2024-06-28T00:48:02.273+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:47:00+00:00, run_id=scheduled__2024-06-28T00:47:00+00:00, run_start_date=2024-06-28 00:48:00.277327+00:00, run_end_date=2024-06-28 00:48:02.273525+00:00, run_duration=1.996198, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:47:00+00:00, data_interval_end=2024-06-28 00:48:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:48:02.283619537Z [2024-06-28T00:48:02.283+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:48:00+00:00, run_after=2024-06-28T00:49:00+00:00 2024-06-28T00:48:02.351549963Z [2024-06-28T00:48:02.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:46:00+00:00 exited with status success for try_number 1 2024-06-28T00:48:02.351596104Z [2024-06-28T00:48:02.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:47:00+00:00 exited with status success for try_number 1 2024-06-28T00:48:02.359562463Z [2024-06-28T00:48:02.359+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:46:00+00:00, map_index=-1, run_start_date=2024-06-28 00:48:01.357089+00:00, run_end_date=2024-06-28 00:48:01.878591+00:00, run_duration=0.521502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=602, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:48:00.360028+00:00, queued_by_job_id=2, pid=8824 2024-06-28T00:48:02.359731143Z [2024-06-28T00:48:02.359+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:47:00+00:00, map_index=-1, run_start_date=2024-06-28 00:48:01.569281+00:00, run_end_date=2024-06-28 00:48:02.094717+00:00, run_duration=0.525436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=603, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:48:00.360028+00:00, queued_by_job_id=2, pid=8825 2024-06-28T00:48:04.554156428Z [2024-06-28T00:48:04.553+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:48:04.554296074Z [2024-06-28T00:48:04.554+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:47:00+00:00, run_id=scheduled__2024-06-28T00:47:00+00:00, run_start_date=2024-06-28 00:48:00.279885+00:00, run_end_date=2024-06-28 00:48:04.553948+00:00, run_duration=4.274063, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:47:00+00:00, data_interval_end=2024-06-28 00:48:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:48:04.573611493Z [2024-06-28T00:48:04.573+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:48:00+00:00, run_after=2024-06-28T00:49:00+00:00 2024-06-28T00:48:04.659186455Z [2024-06-28T00:48:04.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:47:00+00:00 exited with status success for try_number 1 2024-06-28T00:48:04.692070093Z [2024-06-28T00:48:04.691+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:47:00+00:00, map_index=-1, run_start_date=2024-06-28 00:48:02.889445+00:00, run_end_date=2024-06-28 00:48:04.228757+00:00, run_duration=1.339312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=605, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:48:00.360028+00:00, queued_by_job_id=2, pid=8849 2024-06-28T00:48:05.754407419Z [2024-06-28T00:48:05.754+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:48:05.754732348Z [2024-06-28T00:48:05.754+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:47:00+00:00, run_id=scheduled__2024-06-28T00:47:00+00:00, run_start_date=2024-06-28 00:48:00.281701+00:00, run_end_date=2024-06-28 00:48:05.754455+00:00, run_duration=5.472754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:47:00+00:00, data_interval_end=2024-06-28 00:48:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:48:05.763717027Z [2024-06-28T00:48:05.763+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:48:00+00:00, run_after=2024-06-28T00:49:00+00:00 2024-06-28T00:48:05.804660320Z [2024-06-28T00:48:05.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:47:00+00:00 exited with status success for try_number 1 2024-06-28T00:48:05.813172034Z [2024-06-28T00:48:05.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:47:00+00:00, map_index=-1, run_start_date=2024-06-28 00:48:02.798072+00:00, run_end_date=2024-06-28 00:48:04.661924+00:00, run_duration=1.863852, state=success, executor_state=success, try_number=1, max_tries=1, job_id=604, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:48:00.360028+00:00, queued_by_job_id=2, pid=8848 2024-06-28T00:49:00.470423233Z [2024-06-28T00:49:00.469+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:49:00+00:00, run_after=2024-06-28T00:50:00+00:00 2024-06-28T00:49:00.478853924Z [2024-06-28T00:49:00.478+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:49:00.491550197Z [2024-06-28T00:49:00.491+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:49:00+00:00, run_after=2024-06-28T00:50:00+00:00 2024-06-28T00:49:00.567934118Z [2024-06-28T00:49:00.567+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:49:00.567956002Z 2024-06-28T00:49:00.567963256Z 2024-06-28T00:49:00.567966966Z 2024-06-28T00:49:00.568509765Z [2024-06-28T00:49:00.567+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:49:00.568718865Z [2024-06-28T00:49:00.568+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:49:00.568928320Z [2024-06-28T00:49:00.568+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:49:00.569675728Z [2024-06-28T00:49:00.569+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:49:00.569685582Z 2024-06-28T00:49:00.569688946Z 2024-06-28T00:49:00.569692189Z 2024-06-28T00:49:00.573237212Z [2024-06-28T00:49:00.573+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:49:00.573461023Z [2024-06-28T00:49:00.573+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:49:00.573783709Z [2024-06-28T00:49:00.573+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:49:00.573935993Z [2024-06-28T00:49:00.573+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:49:00.574317027Z [2024-06-28T00:49:00.574+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:49:00.574417898Z [2024-06-28T00:49:00.574+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:49:00.873821219Z [2024-06-28T00:49:00.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:48:00+00:00 exited with status queued for try_number 1 2024-06-28T00:49:00.874064986Z [2024-06-28T00:49:00.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:48:00+00:00 exited with status queued for try_number 1 2024-06-28T00:49:00.874262999Z [2024-06-28T00:49:00.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:48:00+00:00 exited with status queued for try_number 1 2024-06-28T00:49:00.887320146Z [2024-06-28T00:49:00.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6da55f0c-1be7-4099-83ad-6fafc83b2c44 2024-06-28T00:49:00.891045589Z [2024-06-28T00:49:00.890+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c155469-a2ba-4659-9c25-57ab55b41091 2024-06-28T00:49:00.891281965Z [2024-06-28T00:49:00.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to f97e5cc3-9533-4bbb-b1ba-b4ef09599b2f 2024-06-28T00:49:03.273742398Z [2024-06-28T00:49:03.273+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:49:03.274256389Z [2024-06-28T00:49:03.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:48:00+00:00, run_id=scheduled__2024-06-28T00:48:00+00:00, run_start_date=2024-06-28 00:49:00.502621+00:00, run_end_date=2024-06-28 00:49:03.273677+00:00, run_duration=2.771056, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:48:00+00:00, data_interval_end=2024-06-28 00:49:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:49:03.296513923Z [2024-06-28T00:49:03.296+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:49:00+00:00, run_after=2024-06-28T00:50:00+00:00 2024-06-28T00:49:03.389828294Z [2024-06-28T00:49:03.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:48:00+00:00 exited with status success for try_number 1 2024-06-28T00:49:03.396508275Z [2024-06-28T00:49:03.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:48:00+00:00, map_index=-1, run_start_date=2024-06-28 00:49:02.128623+00:00, run_end_date=2024-06-28 00:49:02.640006+00:00, run_duration=0.511383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=606, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:49:00.570332+00:00, queued_by_job_id=2, pid=8881 2024-06-28T00:49:05.628770525Z [2024-06-28T00:49:05.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:49:05.629169079Z [2024-06-28T00:49:05.628+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:48:00+00:00, run_id=scheduled__2024-06-28T00:48:00+00:00, run_start_date=2024-06-28 00:49:00.506429+00:00, run_end_date=2024-06-28 00:49:05.628889+00:00, run_duration=5.12246, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:48:00+00:00, data_interval_end=2024-06-28 00:49:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:49:05.638288409Z [2024-06-28T00:49:05.638+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:49:00+00:00, run_after=2024-06-28T00:50:00+00:00 2024-06-28T00:49:05.647546433Z [2024-06-28T00:49:05.647+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:49:05.649394601Z [2024-06-28T00:49:05.649+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:48:00+00:00, run_id=scheduled__2024-06-28T00:48:00+00:00, run_start_date=2024-06-28 00:49:00.511505+00:00, run_end_date=2024-06-28 00:49:05.649014+00:00, run_duration=5.137509, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:48:00+00:00, data_interval_end=2024-06-28 00:49:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:49:05.663696804Z [2024-06-28T00:49:05.663+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:49:00+00:00, run_after=2024-06-28T00:50:00+00:00 2024-06-28T00:49:05.749850170Z [2024-06-28T00:49:05.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:48:00+00:00 exited with status success for try_number 1 2024-06-28T00:49:05.750046051Z [2024-06-28T00:49:05.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:48:00+00:00 exited with status success for try_number 1 2024-06-28T00:49:05.756403460Z [2024-06-28T00:49:05.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:48:00+00:00, map_index=-1, run_start_date=2024-06-28 00:49:03.295875+00:00, run_end_date=2024-06-28 00:49:04.566345+00:00, run_duration=1.27047, state=success, executor_state=success, try_number=1, max_tries=1, job_id=608, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:49:00.570332+00:00, queued_by_job_id=2, pid=8900 2024-06-28T00:49:05.756812033Z [2024-06-28T00:49:05.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:48:00+00:00, map_index=-1, run_start_date=2024-06-28 00:49:03.122299+00:00, run_end_date=2024-06-28 00:49:04.750579+00:00, run_duration=1.62828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=607, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:49:00.570332+00:00, queued_by_job_id=2, pid=8899 2024-06-28T00:50:00.424033552Z [2024-06-28T00:50:00.423+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:50:00.433674194Z [2024-06-28T00:50:00.433+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:50:00.448748210Z [2024-06-28T00:50:00.448+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:50:00+00:00, run_after=2024-06-28T00:51:00+00:00 2024-06-28T00:50:00.463975375Z [2024-06-28T00:50:00.463+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:50:00+00:00, run_after=2024-06-28T00:51:00+00:00 2024-06-28T00:50:00.480455595Z [2024-06-28T00:50:00.479+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:50:00+00:00, run_after=2024-06-28T00:55:00+00:00 2024-06-28T00:50:00.614381769Z [2024-06-28T00:50:00.613+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-28T00:50:00.614403432Z 2024-06-28T00:50:00.614407742Z 2024-06-28T00:50:00.614412362Z 2024-06-28T00:50:00.614416566Z 2024-06-28T00:50:00.614436152Z 2024-06-28T00:50:00.614627543Z [2024-06-28T00:50:00.614+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:50:00.614996261Z [2024-06-28T00:50:00.614+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:50:00.615370541Z [2024-06-28T00:50:00.615+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:50:00.615654212Z [2024-06-28T00:50:00.615+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:50:00.615917227Z [2024-06-28T00:50:00.615+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:50:00.617074250Z [2024-06-28T00:50:00.616+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:50:00.617089514Z 2024-06-28T00:50:00.617115975Z 2024-06-28T00:50:00.617121432Z 2024-06-28T00:50:00.617126729Z 2024-06-28T00:50:00.617131165Z 2024-06-28T00:50:00.628816982Z [2024-06-28T00:50:00.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T00:50:00.629178865Z [2024-06-28T00:50:00.628+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:50:00.629608467Z [2024-06-28T00:50:00.629+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:50:00.629808808Z [2024-06-28T00:50:00.629+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:50:00.630150176Z [2024-06-28T00:50:00.629+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:50:00.630325550Z [2024-06-28T00:50:00.630+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:50:00.630652942Z [2024-06-28T00:50:00.630+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:50:00.630885406Z [2024-06-28T00:50:00.630+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:50:00.631253327Z [2024-06-28T00:50:00.631+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:50:00.631473584Z [2024-06-28T00:50:00.631+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:50:01.230101320Z [2024-06-28T00:50:01.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:45:00+00:00 exited with status queued for try_number 1 2024-06-28T00:50:01.230303795Z [2024-06-28T00:50:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:48:00+00:00 exited with status queued for try_number 1 2024-06-28T00:50:01.230390748Z [2024-06-28T00:50:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:49:00+00:00 exited with status queued for try_number 1 2024-06-28T00:50:01.230565417Z [2024-06-28T00:50:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:49:00+00:00 exited with status queued for try_number 1 2024-06-28T00:50:01.230593418Z [2024-06-28T00:50:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:49:00+00:00 exited with status queued for try_number 1 2024-06-28T00:50:01.244809847Z [2024-06-28T00:50:01.242+0000] {scheduler_job.py:635} INFO - Setting external_id for to 825e480f-854a-4ec0-b8d9-23b8f6a4eb57 2024-06-28T00:50:01.245024221Z [2024-06-28T00:50:01.244+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce9cf0fd-65da-48d5-9270-fb0155825796 2024-06-28T00:50:01.245215235Z [2024-06-28T00:50:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a146e7f-dcf7-46d8-a2ef-62bd0575122c 2024-06-28T00:50:01.245348390Z [2024-06-28T00:50:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to e400d417-3e64-472d-b7ed-9fc7716d83ca 2024-06-28T00:50:01.245511892Z [2024-06-28T00:50:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 508fb453-9e67-4cf9-8ab9-36d83f9ef3c7 2024-06-28T00:50:02.580472674Z [2024-06-28T00:50:02.580+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:50:02.580909758Z [2024-06-28T00:50:02.580+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:49:00+00:00, run_id=scheduled__2024-06-28T00:49:00+00:00, run_start_date=2024-06-28 00:50:00.498908+00:00, run_end_date=2024-06-28 00:50:02.580547+00:00, run_duration=2.081639, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:49:00+00:00, data_interval_end=2024-06-28 00:50:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:50:02.591269453Z [2024-06-28T00:50:02.590+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:50:00+00:00, run_after=2024-06-28T00:51:00+00:00 2024-06-28T00:50:03.768626180Z [2024-06-28T00:50:03.768+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:50:03.769423056Z [2024-06-28T00:50:03.768+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:48:00+00:00, run_id=scheduled__2024-06-28T00:48:00+00:00, run_start_date=2024-06-28 00:50:00.497880+00:00, run_end_date=2024-06-28 00:50:03.768554+00:00, run_duration=3.270674, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:48:00+00:00, data_interval_end=2024-06-28 00:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:50:03.780856736Z [2024-06-28T00:50:03.780+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:50:00+00:00, run_after=2024-06-28T00:52:00+00:00 2024-06-28T00:50:03.931916470Z [2024-06-28T00:50:03.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:48:00+00:00 exited with status success for try_number 1 2024-06-28T00:50:03.932751027Z [2024-06-28T00:50:03.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:49:00+00:00 exited with status success for try_number 1 2024-06-28T00:50:03.960859392Z [2024-06-28T00:50:03.958+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:49:00+00:00, map_index=-1, run_start_date=2024-06-28 00:50:01.815936+00:00, run_end_date=2024-06-28 00:50:02.493601+00:00, run_duration=0.677665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=609, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:50:00.624023+00:00, queued_by_job_id=2, pid=8934 2024-06-28T00:50:03.962560891Z [2024-06-28T00:50:03.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:48:00+00:00, map_index=-1, run_start_date=2024-06-28 00:50:01.985441+00:00, run_end_date=2024-06-28 00:50:02.629286+00:00, run_duration=0.643845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=610, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:50:00.624023+00:00, queued_by_job_id=2, pid=8935 2024-06-28T00:50:05.714706635Z [2024-06-28T00:50:05.714+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:50:05.714938127Z [2024-06-28T00:50:05.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:49:00+00:00, run_id=scheduled__2024-06-28T00:49:00+00:00, run_start_date=2024-06-28 00:50:00.499942+00:00, run_end_date=2024-06-28 00:50:05.714614+00:00, run_duration=5.214672, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:49:00+00:00, data_interval_end=2024-06-28 00:50:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:50:05.730972212Z [2024-06-28T00:50:05.730+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:50:00+00:00, run_after=2024-06-28T00:51:00+00:00 2024-06-28T00:50:05.774803849Z [2024-06-28T00:50:05.774+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:50:05.774826779Z 2024-06-28T00:50:05.774837058Z [2024-06-28T00:50:05.774+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:50:05.778579682Z [2024-06-28T00:50:05.775+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:50:05.778604548Z 2024-06-28T00:50:05.781741152Z [2024-06-28T00:50:05.781+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T00:50:05.781812841Z [2024-06-28T00:50:05.781+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:50:05.839863066Z [2024-06-28T00:50:05.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:45:00+00:00 exited with status queued for try_number 1 2024-06-28T00:50:05.839939000Z [2024-06-28T00:50:05.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:45:00+00:00 exited with status success for try_number 1 2024-06-28T00:50:05.840060267Z [2024-06-28T00:50:05.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:49:00+00:00 exited with status success for try_number 1 2024-06-28T00:50:05.847654166Z [2024-06-28T00:50:05.847+0000] {scheduler_job.py:635} INFO - Setting external_id for to 648534db-8443-4a4b-9e2c-40d4a8f213db 2024-06-28T00:50:05.847829809Z [2024-06-28T00:50:05.847+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T00:45:00+00:00, map_index=-1, run_start_date=2024-06-28 00:50:04.545295+00:00, run_end_date=2024-06-28 00:50:05.208090+00:00, run_duration=0.662795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=613, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:50:00.624023+00:00, queued_by_job_id=2, pid=8971 2024-06-28T00:50:05.848002417Z [2024-06-28T00:50:05.847+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:49:00+00:00, map_index=-1, run_start_date=2024-06-28 00:50:03.568266+00:00, run_end_date=2024-06-28 00:50:05.328977+00:00, run_duration=1.760711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=611, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:50:00.624023+00:00, queued_by_job_id=2, pid=8954 2024-06-28T00:50:07.128584392Z [2024-06-28T00:50:07.128+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:50:07.128839025Z [2024-06-28T00:50:07.128+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:49:00+00:00, run_id=scheduled__2024-06-28T00:49:00+00:00, run_start_date=2024-06-28 00:50:00.500918+00:00, run_end_date=2024-06-28 00:50:07.128519+00:00, run_duration=6.627601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:49:00+00:00, data_interval_end=2024-06-28 00:50:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:50:07.141912349Z [2024-06-28T00:50:07.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:50:00+00:00, run_after=2024-06-28T00:51:00+00:00 2024-06-28T00:50:07.208568876Z [2024-06-28T00:50:07.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:49:00+00:00 exited with status success for try_number 1 2024-06-28T00:50:07.214625789Z [2024-06-28T00:50:07.214+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:49:00+00:00, map_index=-1, run_start_date=2024-06-28 00:50:03.988804+00:00, run_end_date=2024-06-28 00:50:06.509172+00:00, run_duration=2.520368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=612, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:50:00.624023+00:00, queued_by_job_id=2, pid=8963 2024-06-28T00:50:09.179007942Z [2024-06-28T00:50:09.178+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:50:09.179082970Z 2024-06-28T00:50:09.179094815Z [2024-06-28T00:50:09.178+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:50:09.179703498Z [2024-06-28T00:50:09.179+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:50:09.179727126Z 2024-06-28T00:50:09.181784280Z [2024-06-28T00:50:09.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T00:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T00:50:09.181916459Z [2024-06-28T00:50:09.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T00:50:09.238052314Z [2024-06-28T00:50:09.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:45:00+00:00 exited with status queued for try_number 1 2024-06-28T00:50:09.238499964Z [2024-06-28T00:50:09.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:45:00+00:00 exited with status success for try_number 1 2024-06-28T00:50:09.245184912Z [2024-06-28T00:50:09.244+0000] {scheduler_job.py:635} INFO - Setting external_id for to aed13f15-186b-4feb-8902-864d29b2369a 2024-06-28T00:50:09.245445727Z [2024-06-28T00:50:09.245+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T00:45:00+00:00, map_index=-1, run_start_date=2024-06-28 00:50:07.879901+00:00, run_end_date=2024-06-28 00:50:08.274927+00:00, run_duration=0.395026, state=success, executor_state=success, try_number=1, max_tries=1, job_id=614, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:50:05.779438+00:00, queued_by_job_id=2, pid=8989 2024-06-28T00:50:12.051570889Z [2024-06-28T00:50:12.051+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:50:12.051596348Z 2024-06-28T00:50:12.054448825Z [2024-06-28T00:50:12.052+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:50:12.056298136Z [2024-06-28T00:50:12.056+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:50:12.056311916Z 2024-06-28T00:50:12.060650757Z [2024-06-28T00:50:12.060+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:50:12.060970910Z [2024-06-28T00:50:12.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:50:12.144358543Z [2024-06-28T00:50:12.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:45:00+00:00 exited with status queued for try_number 1 2024-06-28T00:50:12.144536185Z [2024-06-28T00:50:12.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:45:00+00:00 exited with status success for try_number 1 2024-06-28T00:50:12.156751228Z [2024-06-28T00:50:12.156+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40b61181-80ef-4622-b9c3-28540faa3318 2024-06-28T00:50:12.157223936Z [2024-06-28T00:50:12.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T00:45:00+00:00, map_index=0, run_start_date=2024-06-28 00:50:11.191398+00:00, run_end_date=2024-06-28 00:50:11.598460+00:00, run_duration=0.407062, state=success, executor_state=success, try_number=1, max_tries=1, job_id=615, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:50:09.180001+00:00, queued_by_job_id=2, pid=8997 2024-06-28T00:50:14.794782937Z [2024-06-28T00:50:14.794+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:50:14.795003364Z [2024-06-28T00:50:14.794+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:45:00+00:00, run_id=scheduled__2024-06-28T00:45:00+00:00, run_start_date=2024-06-28 00:50:00.496576+00:00, run_end_date=2024-06-28 00:50:14.794707+00:00, run_duration=14.298131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:45:00+00:00, data_interval_end=2024-06-28 00:50:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T00:50:14.802473600Z [2024-06-28T00:50:14.802+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:50:00+00:00, run_after=2024-06-28T00:55:00+00:00 2024-06-28T00:50:14.848643454Z [2024-06-28T00:50:14.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:45:00+00:00 exited with status success for try_number 1 2024-06-28T00:50:14.854548844Z [2024-06-28T00:50:14.854+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T00:45:00+00:00, map_index=-1, run_start_date=2024-06-28 00:50:13.734370+00:00, run_end_date=2024-06-28 00:50:14.052607+00:00, run_duration=0.318237, state=success, executor_state=success, try_number=1, max_tries=1, job_id=616, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:50:12.056872+00:00, queued_by_job_id=2, pid=9005 2024-06-28T00:51:00.572858242Z [2024-06-28T00:51:00.572+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:51:00+00:00, run_after=2024-06-28T00:52:00+00:00 2024-06-28T00:51:00.587790059Z [2024-06-28T00:51:00.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:51:00+00:00, run_after=2024-06-28T00:52:00+00:00 2024-06-28T00:51:00.597793369Z [2024-06-28T00:51:00.597+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:51:00.702920619Z [2024-06-28T00:51:00.702+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:51:00.702991469Z 2024-06-28T00:51:00.702997736Z 2024-06-28T00:51:00.703031522Z 2024-06-28T00:51:00.703456549Z [2024-06-28T00:51:00.702+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:51:00.703721247Z [2024-06-28T00:51:00.703+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:51:00.704917007Z [2024-06-28T00:51:00.703+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:51:00.705618575Z [2024-06-28T00:51:00.705+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:51:00.705633151Z 2024-06-28T00:51:00.705638747Z 2024-06-28T00:51:00.705643850Z 2024-06-28T00:51:00.709329572Z [2024-06-28T00:51:00.709+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:51:00.709380978Z [2024-06-28T00:51:00.709+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:51:00.710133823Z [2024-06-28T00:51:00.709+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:51:00.710298990Z [2024-06-28T00:51:00.710+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:51:00.710557446Z [2024-06-28T00:51:00.710+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:51:00.710661646Z [2024-06-28T00:51:00.710+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:51:00.995814172Z [2024-06-28T00:51:00.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:50:00+00:00 exited with status queued for try_number 1 2024-06-28T00:51:00.996013558Z [2024-06-28T00:51:00.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:50:00+00:00 exited with status queued for try_number 1 2024-06-28T00:51:00.996206190Z [2024-06-28T00:51:00.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:50:00+00:00 exited with status queued for try_number 1 2024-06-28T00:51:01.020279759Z [2024-06-28T00:51:01.019+0000] {scheduler_job.py:635} INFO - Setting external_id for to 827c4042-1105-4050-a033-ceb5a1ff55a5 2024-06-28T00:51:01.020508556Z [2024-06-28T00:51:01.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to a78fbe65-32f7-43f3-a262-8800569f4237 2024-06-28T00:51:01.020704189Z [2024-06-28T00:51:01.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to dcd26cba-7777-4cc6-b857-d224eaa7921b 2024-06-28T00:51:02.208819284Z [2024-06-28T00:51:02.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:51:02.209029873Z [2024-06-28T00:51:02.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:50:00+00:00, run_id=scheduled__2024-06-28T00:50:00+00:00, run_start_date=2024-06-28 00:51:00.612832+00:00, run_end_date=2024-06-28 00:51:02.208719+00:00, run_duration=1.595887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:50:00+00:00, data_interval_end=2024-06-28 00:51:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:51:02.226871479Z [2024-06-28T00:51:02.226+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:51:00+00:00, run_after=2024-06-28T00:52:00+00:00 2024-06-28T00:51:03.448262877Z [2024-06-28T00:51:03.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:50:00+00:00 exited with status success for try_number 1 2024-06-28T00:51:03.455107793Z [2024-06-28T00:51:03.454+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:50:00+00:00, map_index=-1, run_start_date=2024-06-28 00:51:01.673940+00:00, run_end_date=2024-06-28 00:51:02.148997+00:00, run_duration=0.475057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=617, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:51:00.706383+00:00, queued_by_job_id=2, pid=9027 2024-06-28T00:51:04.524981070Z [2024-06-28T00:51:04.524+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:51:04.525010232Z [2024-06-28T00:51:04.524+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:50:00+00:00, run_id=scheduled__2024-06-28T00:50:00+00:00, run_start_date=2024-06-28 00:51:00.614350+00:00, run_end_date=2024-06-28 00:51:04.524651+00:00, run_duration=3.910301, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:50:00+00:00, data_interval_end=2024-06-28 00:51:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:51:04.539930131Z [2024-06-28T00:51:04.539+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:51:00+00:00, run_after=2024-06-28T00:52:00+00:00 2024-06-28T00:51:05.716561378Z [2024-06-28T00:51:05.716+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:51:05.716793444Z [2024-06-28T00:51:05.716+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:50:00+00:00, run_id=scheduled__2024-06-28T00:50:00+00:00, run_start_date=2024-06-28 00:51:00.615626+00:00, run_end_date=2024-06-28 00:51:05.716531+00:00, run_duration=5.100905, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:50:00+00:00, data_interval_end=2024-06-28 00:51:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:51:05.732003680Z [2024-06-28T00:51:05.731+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:51:00+00:00, run_after=2024-06-28T00:52:00+00:00 2024-06-28T00:51:05.776288536Z [2024-06-28T00:51:05.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:50:00+00:00 exited with status success for try_number 1 2024-06-28T00:51:05.776460387Z [2024-06-28T00:51:05.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:50:00+00:00 exited with status success for try_number 1 2024-06-28T00:51:05.785153930Z [2024-06-28T00:51:05.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:50:00+00:00, map_index=-1, run_start_date=2024-06-28 00:51:02.870595+00:00, run_end_date=2024-06-28 00:51:04.928645+00:00, run_duration=2.05805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=618, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:51:00.706383+00:00, queued_by_job_id=2, pid=9045 2024-06-28T00:51:05.785453932Z [2024-06-28T00:51:05.785+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:50:00+00:00, map_index=-1, run_start_date=2024-06-28 00:51:02.903130+00:00, run_end_date=2024-06-28 00:51:04.467761+00:00, run_duration=1.564631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=619, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:51:00.706383+00:00, queued_by_job_id=2, pid=9046 2024-06-28T00:51:45.923604196Z [2024-06-28T00:51:45.919+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T00:52:00.244581108Z [2024-06-28T00:52:00.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:52:00+00:00, run_after=2024-06-28T00:53:00+00:00 2024-06-28T00:52:00.253542927Z [2024-06-28T00:52:00.253+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:52:00.266891091Z [2024-06-28T00:52:00.266+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:52:00+00:00, run_after=2024-06-28T00:53:00+00:00 2024-06-28T00:52:00.273832003Z [2024-06-28T00:52:00.273+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:52:00.364943564Z [2024-06-28T00:52:00.364+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:52:00.364958061Z 2024-06-28T00:52:00.364962764Z 2024-06-28T00:52:00.364980077Z 2024-06-28T00:52:00.364983898Z 2024-06-28T00:52:00.365518396Z [2024-06-28T00:52:00.364+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:52:00.365761984Z [2024-06-28T00:52:00.365+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:52:00.365946552Z [2024-06-28T00:52:00.365+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:52:00.366107931Z [2024-06-28T00:52:00.365+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:52:00.366831355Z [2024-06-28T00:52:00.366+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:52:00.366844574Z 2024-06-28T00:52:00.366848679Z 2024-06-28T00:52:00.366851993Z 2024-06-28T00:52:00.366855361Z 2024-06-28T00:52:00.371049100Z [2024-06-28T00:52:00.370+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:52:00.371292242Z [2024-06-28T00:52:00.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:52:00.371602375Z [2024-06-28T00:52:00.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:52:00.371794733Z [2024-06-28T00:52:00.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:52:00.372067087Z [2024-06-28T00:52:00.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:52:00.372243409Z [2024-06-28T00:52:00.372+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:52:00.372504308Z [2024-06-28T00:52:00.372+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:52:00.372668411Z [2024-06-28T00:52:00.372+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:52:00.829886225Z [2024-06-28T00:52:00.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:50:00+00:00 exited with status queued for try_number 1 2024-06-28T00:52:00.830101727Z [2024-06-28T00:52:00.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:51:00+00:00 exited with status queued for try_number 1 2024-06-28T00:52:00.830300388Z [2024-06-28T00:52:00.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:51:00+00:00 exited with status queued for try_number 1 2024-06-28T00:52:00.830449958Z [2024-06-28T00:52:00.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:51:00+00:00 exited with status queued for try_number 1 2024-06-28T00:52:00.841364936Z [2024-06-28T00:52:00.841+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad617750-b54b-43d0-92ac-39829adb6509 2024-06-28T00:52:00.844395377Z [2024-06-28T00:52:00.841+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfebfa7c-9318-491c-b5d7-52b67dd45f61 2024-06-28T00:52:00.844408735Z [2024-06-28T00:52:00.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to efd37bc8-ac2d-4697-8d94-41229b2025b9 2024-06-28T00:52:00.844412065Z [2024-06-28T00:52:00.844+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48863b17-07d8-49bb-93d1-776694c9eb13 2024-06-28T00:52:01.896499794Z [2024-06-28T00:52:01.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:52:01.896999148Z [2024-06-28T00:52:01.896+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:50:00+00:00, run_id=scheduled__2024-06-28T00:50:00+00:00, run_start_date=2024-06-28 00:52:00.287459+00:00, run_end_date=2024-06-28 00:52:01.896417+00:00, run_duration=1.608958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:50:00+00:00, data_interval_end=2024-06-28 00:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:52:01.904712423Z [2024-06-28T00:52:01.904+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:52:00+00:00, run_after=2024-06-28T00:54:00+00:00 2024-06-28T00:52:01.959615985Z [2024-06-28T00:52:01.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:50:00+00:00 exited with status success for try_number 1 2024-06-28T00:52:01.967677376Z [2024-06-28T00:52:01.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:50:00+00:00, map_index=-1, run_start_date=2024-06-28 00:52:01.290434+00:00, run_end_date=2024-06-28 00:52:01.651288+00:00, run_duration=0.360854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=620, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:52:00.367805+00:00, queued_by_job_id=2, pid=9078 2024-06-28T00:52:03.045533137Z [2024-06-28T00:52:03.045+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:52:03.046018030Z [2024-06-28T00:52:03.045+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:51:00+00:00, run_id=scheduled__2024-06-28T00:51:00+00:00, run_start_date=2024-06-28 00:52:00.288685+00:00, run_end_date=2024-06-28 00:52:03.045709+00:00, run_duration=2.757024, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:51:00+00:00, data_interval_end=2024-06-28 00:52:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:52:03.057672682Z [2024-06-28T00:52:03.057+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:52:00+00:00, run_after=2024-06-28T00:53:00+00:00 2024-06-28T00:52:03.111869312Z [2024-06-28T00:52:03.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:51:00+00:00 exited with status success for try_number 1 2024-06-28T00:52:03.118107850Z [2024-06-28T00:52:03.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:51:00+00:00, map_index=-1, run_start_date=2024-06-28 00:52:01.477323+00:00, run_end_date=2024-06-28 00:52:01.927355+00:00, run_duration=0.450032, state=success, executor_state=success, try_number=1, max_tries=1, job_id=621, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:52:00.367805+00:00, queued_by_job_id=2, pid=9079 2024-06-28T00:52:05.323229940Z [2024-06-28T00:52:05.322+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:52:05.323550847Z [2024-06-28T00:52:05.323+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:51:00+00:00, run_id=scheduled__2024-06-28T00:51:00+00:00, run_start_date=2024-06-28 00:52:00.289704+00:00, run_end_date=2024-06-28 00:52:05.323230+00:00, run_duration=5.033526, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:51:00+00:00, data_interval_end=2024-06-28 00:52:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:52:05.332623728Z [2024-06-28T00:52:05.332+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:52:00+00:00, run_after=2024-06-28T00:53:00+00:00 2024-06-28T00:52:05.340182904Z [2024-06-28T00:52:05.339+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:52:05.340659010Z [2024-06-28T00:52:05.340+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:51:00+00:00, run_id=scheduled__2024-06-28T00:51:00+00:00, run_start_date=2024-06-28 00:52:00.290657+00:00, run_end_date=2024-06-28 00:52:05.340380+00:00, run_duration=5.049723, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:51:00+00:00, data_interval_end=2024-06-28 00:52:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:52:05.349209869Z [2024-06-28T00:52:05.349+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:52:00+00:00, run_after=2024-06-28T00:53:00+00:00 2024-06-28T00:52:05.398756492Z [2024-06-28T00:52:05.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:51:00+00:00 exited with status success for try_number 1 2024-06-28T00:52:05.398888076Z [2024-06-28T00:52:05.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:51:00+00:00 exited with status success for try_number 1 2024-06-28T00:52:05.410785523Z [2024-06-28T00:52:05.410+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:51:00+00:00, map_index=-1, run_start_date=2024-06-28 00:52:02.380906+00:00, run_end_date=2024-06-28 00:52:04.198072+00:00, run_duration=1.817166, state=success, executor_state=success, try_number=1, max_tries=1, job_id=622, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:52:00.367805+00:00, queued_by_job_id=2, pid=9097 2024-06-28T00:52:05.411305326Z [2024-06-28T00:52:05.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:51:00+00:00, map_index=-1, run_start_date=2024-06-28 00:52:02.774547+00:00, run_end_date=2024-06-28 00:52:04.324038+00:00, run_duration=1.549491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=623, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:52:00.367805+00:00, queued_by_job_id=2, pid=9108 2024-06-28T00:53:00.472198120Z [2024-06-28T00:53:00.471+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:53:00.486245898Z [2024-06-28T00:53:00.485+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:53:00+00:00, run_after=2024-06-28T00:54:00+00:00 2024-06-28T00:53:00.501848920Z [2024-06-28T00:53:00.501+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:53:00+00:00, run_after=2024-06-28T00:54:00+00:00 2024-06-28T00:53:00.638051667Z [2024-06-28T00:53:00.637+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:53:00.638071032Z 2024-06-28T00:53:00.638137156Z 2024-06-28T00:53:00.638144929Z 2024-06-28T00:53:00.638163256Z [2024-06-28T00:53:00.637+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:53:00.638226216Z [2024-06-28T00:53:00.638+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:53:00.638312142Z [2024-06-28T00:53:00.638+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:53:00.638913232Z [2024-06-28T00:53:00.638+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:53:00.638929764Z 2024-06-28T00:53:00.638934728Z 2024-06-28T00:53:00.638971407Z 2024-06-28T00:53:00.642117521Z [2024-06-28T00:53:00.641+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:53:00.642228571Z [2024-06-28T00:53:00.642+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:53:00.642398638Z [2024-06-28T00:53:00.642+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:53:00.642489766Z [2024-06-28T00:53:00.642+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:53:00.642630457Z [2024-06-28T00:53:00.642+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:53:00.642730715Z [2024-06-28T00:53:00.642+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:53:00.937550098Z [2024-06-28T00:53:00.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:52:00+00:00 exited with status queued for try_number 1 2024-06-28T00:53:00.937601113Z [2024-06-28T00:53:00.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:52:00+00:00 exited with status queued for try_number 1 2024-06-28T00:53:00.937640890Z [2024-06-28T00:53:00.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:52:00+00:00 exited with status queued for try_number 1 2024-06-28T00:53:00.946692154Z [2024-06-28T00:53:00.946+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9c1f781-871b-4816-88be-a5d7d3d0f12f 2024-06-28T00:53:00.947082202Z [2024-06-28T00:53:00.946+0000] {scheduler_job.py:635} INFO - Setting external_id for to f321b647-f7a2-439b-b247-4d76532a51dc 2024-06-28T00:53:00.948265092Z [2024-06-28T00:53:00.947+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ae3b944-7496-41a1-892f-f2334b501ca0 2024-06-28T00:53:02.114087457Z [2024-06-28T00:53:02.113+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:53:02.114595266Z [2024-06-28T00:53:02.114+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:52:00+00:00, run_id=scheduled__2024-06-28T00:52:00+00:00, run_start_date=2024-06-28 00:53:00.524598+00:00, run_end_date=2024-06-28 00:53:02.114238+00:00, run_duration=1.58964, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:52:00+00:00, data_interval_end=2024-06-28 00:53:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:53:02.125637579Z [2024-06-28T00:53:02.125+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:53:00+00:00, run_after=2024-06-28T00:54:00+00:00 2024-06-28T00:53:02.211732261Z [2024-06-28T00:53:02.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:52:00+00:00 exited with status success for try_number 1 2024-06-28T00:53:02.220925785Z [2024-06-28T00:53:02.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:52:00+00:00, map_index=-1, run_start_date=2024-06-28 00:53:01.478496+00:00, run_end_date=2024-06-28 00:53:01.949957+00:00, run_duration=0.471461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=624, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:53:00.639616+00:00, queued_by_job_id=2, pid=9135 2024-06-28T00:53:05.241536678Z [2024-06-28T00:53:05.241+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:53:05.242463757Z [2024-06-28T00:53:05.242+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:52:00+00:00, run_id=scheduled__2024-06-28T00:52:00+00:00, run_start_date=2024-06-28 00:53:00.527551+00:00, run_end_date=2024-06-28 00:53:05.242147+00:00, run_duration=4.714596, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:52:00+00:00, data_interval_end=2024-06-28 00:53:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:53:05.251694081Z [2024-06-28T00:53:05.251+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:53:00+00:00, run_after=2024-06-28T00:54:00+00:00 2024-06-28T00:53:05.259177578Z [2024-06-28T00:53:05.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:53:05.259562681Z [2024-06-28T00:53:05.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:52:00+00:00, run_id=scheduled__2024-06-28T00:52:00+00:00, run_start_date=2024-06-28 00:53:00.529634+00:00, run_end_date=2024-06-28 00:53:05.259262+00:00, run_duration=4.729628, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:52:00+00:00, data_interval_end=2024-06-28 00:53:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:53:05.267974072Z [2024-06-28T00:53:05.267+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:53:00+00:00, run_after=2024-06-28T00:54:00+00:00 2024-06-28T00:53:05.317383146Z [2024-06-28T00:53:05.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:52:00+00:00 exited with status success for try_number 1 2024-06-28T00:53:05.317639467Z [2024-06-28T00:53:05.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:52:00+00:00 exited with status success for try_number 1 2024-06-28T00:53:05.324961922Z [2024-06-28T00:53:05.324+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:52:00+00:00, map_index=-1, run_start_date=2024-06-28 00:53:02.750505+00:00, run_end_date=2024-06-28 00:53:04.558160+00:00, run_duration=1.807655, state=success, executor_state=success, try_number=1, max_tries=1, job_id=625, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:53:00.639616+00:00, queued_by_job_id=2, pid=9153 2024-06-28T00:53:05.325565979Z [2024-06-28T00:53:05.325+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:52:00+00:00, map_index=-1, run_start_date=2024-06-28 00:53:02.771388+00:00, run_end_date=2024-06-28 00:53:04.960231+00:00, run_duration=2.188843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=626, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:53:00.639616+00:00, queued_by_job_id=2, pid=9154 2024-06-28T00:54:00.769325145Z [2024-06-28T00:54:00.769+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:54:00.787924566Z [2024-06-28T00:54:00.787+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:54:00+00:00, run_after=2024-06-28T00:55:00+00:00 2024-06-28T00:54:00.799823182Z [2024-06-28T00:54:00.799+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:54:00+00:00, run_after=2024-06-28T00:55:00+00:00 2024-06-28T00:54:00.806456490Z [2024-06-28T00:54:00.806+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:54:00.895494972Z [2024-06-28T00:54:00.895+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:54:00.895537567Z 2024-06-28T00:54:00.895543070Z 2024-06-28T00:54:00.895580921Z 2024-06-28T00:54:00.895586196Z 2024-06-28T00:54:00.895621903Z [2024-06-28T00:54:00.895+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:54:00.895791225Z [2024-06-28T00:54:00.895+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:54:00.896021463Z [2024-06-28T00:54:00.895+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:54:00.896197433Z [2024-06-28T00:54:00.896+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:54:00.896819765Z [2024-06-28T00:54:00.896+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:54:00.896831151Z 2024-06-28T00:54:00.896834898Z 2024-06-28T00:54:00.896838084Z 2024-06-28T00:54:00.896841783Z 2024-06-28T00:54:00.900722087Z [2024-06-28T00:54:00.900+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:54:00.900951546Z [2024-06-28T00:54:00.900+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:54:00.901266985Z [2024-06-28T00:54:00.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:54:00.901386202Z [2024-06-28T00:54:00.901+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:54:00.901617918Z [2024-06-28T00:54:00.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:54:00.901718277Z [2024-06-28T00:54:00.901+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:54:00.901924839Z [2024-06-28T00:54:00.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:54:00.902069297Z [2024-06-28T00:54:00.901+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:54:01.366497354Z [2024-06-28T00:54:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:52:00+00:00 exited with status queued for try_number 1 2024-06-28T00:54:01.366856208Z [2024-06-28T00:54:01.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:53:00+00:00 exited with status queued for try_number 1 2024-06-28T00:54:01.367523169Z [2024-06-28T00:54:01.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:53:00+00:00 exited with status queued for try_number 1 2024-06-28T00:54:01.367788603Z [2024-06-28T00:54:01.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:53:00+00:00 exited with status queued for try_number 1 2024-06-28T00:54:01.380664174Z [2024-06-28T00:54:01.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90324ac0-8986-457a-9e91-932b3f184ead 2024-06-28T00:54:01.381026374Z [2024-06-28T00:54:01.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7bd35ae4-cb1d-4a4a-8407-220d5dd4c0ba 2024-06-28T00:54:01.383270084Z [2024-06-28T00:54:01.383+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3fc20253-41ca-4007-b791-234ff302a98a 2024-06-28T00:54:01.383576985Z [2024-06-28T00:54:01.383+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56a42535-c2b6-4a07-9267-86e4a9adbacb 2024-06-28T00:54:02.633886917Z [2024-06-28T00:54:02.633+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:54:02.635347974Z [2024-06-28T00:54:02.635+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:52:00+00:00, run_id=scheduled__2024-06-28T00:52:00+00:00, run_start_date=2024-06-28 00:54:00.820188+00:00, run_end_date=2024-06-28 00:54:02.634930+00:00, run_duration=1.814742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:52:00+00:00, data_interval_end=2024-06-28 00:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:54:02.645328954Z [2024-06-28T00:54:02.645+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:54:00+00:00, run_after=2024-06-28T00:56:00+00:00 2024-06-28T00:54:02.672071630Z [2024-06-28T00:54:02.671+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:54:02.672469372Z [2024-06-28T00:54:02.672+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:53:00+00:00, run_id=scheduled__2024-06-28T00:53:00+00:00, run_start_date=2024-06-28 00:54:00.821748+00:00, run_end_date=2024-06-28 00:54:02.672173+00:00, run_duration=1.850425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:53:00+00:00, data_interval_end=2024-06-28 00:54:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:54:02.690604389Z [2024-06-28T00:54:02.690+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:54:00+00:00, run_after=2024-06-28T00:55:00+00:00 2024-06-28T00:54:02.806103792Z [2024-06-28T00:54:02.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:52:00+00:00 exited with status success for try_number 1 2024-06-28T00:54:02.817213891Z [2024-06-28T00:54:02.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:52:00+00:00, map_index=-1, run_start_date=2024-06-28 00:54:01.729694+00:00, run_end_date=2024-06-28 00:54:02.185614+00:00, run_duration=0.45592, state=success, executor_state=success, try_number=1, max_tries=1, job_id=627, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:54:00.897655+00:00, queued_by_job_id=2, pid=9187 2024-06-28T00:54:03.912428482Z [2024-06-28T00:54:03.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:53:00+00:00 exited with status success for try_number 1 2024-06-28T00:54:03.925162132Z [2024-06-28T00:54:03.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:53:00+00:00, map_index=-1, run_start_date=2024-06-28 00:54:02.009019+00:00, run_end_date=2024-06-28 00:54:02.538975+00:00, run_duration=0.529956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=628, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:54:00.897655+00:00, queued_by_job_id=2, pid=9188 2024-06-28T00:54:05.133019549Z [2024-06-28T00:54:05.132+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:54:05.133352731Z [2024-06-28T00:54:05.133+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:53:00+00:00, run_id=scheduled__2024-06-28T00:53:00+00:00, run_start_date=2024-06-28 00:54:00.823920+00:00, run_end_date=2024-06-28 00:54:05.133029+00:00, run_duration=4.309109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:53:00+00:00, data_interval_end=2024-06-28 00:54:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:54:05.141905872Z [2024-06-28T00:54:05.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:54:00+00:00, run_after=2024-06-28T00:55:00+00:00 2024-06-28T00:54:05.192108212Z [2024-06-28T00:54:05.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:53:00+00:00 exited with status success for try_number 1 2024-06-28T00:54:05.197118362Z [2024-06-28T00:54:05.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:53:00+00:00, map_index=-1, run_start_date=2024-06-28 00:54:03.188627+00:00, run_end_date=2024-06-28 00:54:04.939225+00:00, run_duration=1.750598, state=success, executor_state=success, try_number=1, max_tries=1, job_id=629, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:54:00.897655+00:00, queued_by_job_id=2, pid=9206 2024-06-28T00:54:06.258904779Z [2024-06-28T00:54:06.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:54:06.259276448Z [2024-06-28T00:54:06.258+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:53:00+00:00, run_id=scheduled__2024-06-28T00:53:00+00:00, run_start_date=2024-06-28 00:54:00.825232+00:00, run_end_date=2024-06-28 00:54:06.258878+00:00, run_duration=5.433646, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:53:00+00:00, data_interval_end=2024-06-28 00:54:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:54:06.269113667Z [2024-06-28T00:54:06.268+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:54:00+00:00, run_after=2024-06-28T00:55:00+00:00 2024-06-28T00:54:06.299320323Z [2024-06-28T00:54:06.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:53:00+00:00 exited with status success for try_number 1 2024-06-28T00:54:06.305419941Z [2024-06-28T00:54:06.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:53:00+00:00, map_index=-1, run_start_date=2024-06-28 00:54:03.488837+00:00, run_end_date=2024-06-28 00:54:05.404959+00:00, run_duration=1.916122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=630, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:54:00.897655+00:00, queued_by_job_id=2, pid=9217 2024-06-28T00:55:01.067459874Z [2024-06-28T00:55:01.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:55:00+00:00, run_after=2024-06-28T00:56:00+00:00 2024-06-28T00:55:01.077729828Z [2024-06-28T00:55:01.077+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:55:01.088745060Z [2024-06-28T00:55:01.088+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:55:00+00:00, run_after=2024-06-28T01:00:00+00:00 2024-06-28T00:55:01.101337508Z [2024-06-28T00:55:01.100+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:55:00+00:00, run_after=2024-06-28T00:56:00+00:00 2024-06-28T00:55:01.202999850Z [2024-06-28T00:55:01.202+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:55:01.203044217Z 2024-06-28T00:55:01.203050591Z 2024-06-28T00:55:01.203055654Z 2024-06-28T00:55:01.203060332Z 2024-06-28T00:55:01.203409383Z [2024-06-28T00:55:01.202+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:55:01.203776270Z [2024-06-28T00:55:01.203+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:55:01.204133617Z [2024-06-28T00:55:01.203+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:55:01.204482115Z [2024-06-28T00:55:01.204+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:55:01.205581717Z [2024-06-28T00:55:01.205+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:55:01.205594918Z 2024-06-28T00:55:01.205599163Z 2024-06-28T00:55:01.205603140Z 2024-06-28T00:55:01.205606702Z 2024-06-28T00:55:01.210191382Z [2024-06-28T00:55:01.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T00:55:01.210623044Z [2024-06-28T00:55:01.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:55:01.211198576Z [2024-06-28T00:55:01.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:55:01.211508887Z [2024-06-28T00:55:01.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:55:01.211960562Z [2024-06-28T00:55:01.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:55:01.212275487Z [2024-06-28T00:55:01.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:55:01.212795719Z [2024-06-28T00:55:01.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:55:01.213152337Z [2024-06-28T00:55:01.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:55:01.637646825Z [2024-06-28T00:55:01.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:50:00+00:00 exited with status queued for try_number 1 2024-06-28T00:55:01.638013803Z [2024-06-28T00:55:01.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:54:00+00:00 exited with status queued for try_number 1 2024-06-28T00:55:01.638353763Z [2024-06-28T00:55:01.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:54:00+00:00 exited with status queued for try_number 1 2024-06-28T00:55:01.638491480Z [2024-06-28T00:55:01.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:54:00+00:00 exited with status queued for try_number 1 2024-06-28T00:55:01.649447344Z [2024-06-28T00:55:01.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to 758d6cf9-628f-4519-aab5-46995ae6c06f 2024-06-28T00:55:01.649775790Z [2024-06-28T00:55:01.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97fe3091-2c61-4594-a799-a7dab7548754 2024-06-28T00:55:01.649969348Z [2024-06-28T00:55:01.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to 279407d9-e416-41fa-bfa4-499c955a5394 2024-06-28T00:55:01.650178365Z [2024-06-28T00:55:01.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9404db78-1c8d-4f6a-a8b2-8b7ed0a1c904 2024-06-28T00:55:02.888516686Z [2024-06-28T00:55:02.888+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:55:02.888772867Z [2024-06-28T00:55:02.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:54:00+00:00, run_id=scheduled__2024-06-28T00:54:00+00:00, run_start_date=2024-06-28 00:55:01.113933+00:00, run_end_date=2024-06-28 00:55:02.888460+00:00, run_duration=1.774527, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:54:00+00:00, data_interval_end=2024-06-28 00:55:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:55:02.899187416Z [2024-06-28T00:55:02.898+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:55:00+00:00, run_after=2024-06-28T00:56:00+00:00 2024-06-28T00:55:02.987763040Z [2024-06-28T00:55:02.987+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:54:00+00:00 exited with status success for try_number 1 2024-06-28T00:55:03.008009416Z [2024-06-28T00:55:03.007+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:54:00+00:00, map_index=-1, run_start_date=2024-06-28 00:55:02.256040+00:00, run_end_date=2024-06-28 00:55:02.697881+00:00, run_duration=0.441841, state=success, executor_state=success, try_number=1, max_tries=1, job_id=631, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:55:01.206560+00:00, queued_by_job_id=2, pid=9245 2024-06-28T00:55:05.086508057Z [2024-06-28T00:55:05.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:55:05.086643838Z [2024-06-28T00:55:05.086+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:54:00+00:00, run_id=scheduled__2024-06-28T00:54:00+00:00, run_start_date=2024-06-28 00:55:01.115099+00:00, run_end_date=2024-06-28 00:55:05.086408+00:00, run_duration=3.971309, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:54:00+00:00, data_interval_end=2024-06-28 00:55:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:55:05.097964672Z [2024-06-28T00:55:05.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:55:00+00:00, run_after=2024-06-28T00:56:00+00:00 2024-06-28T00:55:05.192310641Z [2024-06-28T00:55:05.192+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:55:05.192322199Z 2024-06-28T00:55:05.192375005Z [2024-06-28T00:55:05.192+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:55:05.192904609Z [2024-06-28T00:55:05.192+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:55:05.192914106Z 2024-06-28T00:55:05.199832408Z [2024-06-28T00:55:05.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T00:55:05.199924435Z [2024-06-28T00:55:05.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:55:05.250528230Z [2024-06-28T00:55:05.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:50:00+00:00 exited with status queued for try_number 1 2024-06-28T00:55:05.250551524Z [2024-06-28T00:55:05.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:50:00+00:00 exited with status success for try_number 1 2024-06-28T00:55:05.256794017Z [2024-06-28T00:55:05.255+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63099b52-dd47-4381-9604-602776195f63 2024-06-28T00:55:05.256802226Z [2024-06-28T00:55:05.256+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T00:50:00+00:00, map_index=-1, run_start_date=2024-06-28 00:55:03.644381+00:00, run_end_date=2024-06-28 00:55:04.215052+00:00, run_duration=0.570671, state=success, executor_state=success, try_number=1, max_tries=1, job_id=633, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:55:01.206560+00:00, queued_by_job_id=2, pid=9270 2024-06-28T00:55:05.483885669Z [2024-06-28T00:55:05.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:54:00+00:00 exited with status success for try_number 1 2024-06-28T00:55:05.491880973Z [2024-06-28T00:55:05.491+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:54:00+00:00, map_index=-1, run_start_date=2024-06-28 00:55:03.465408+00:00, run_end_date=2024-06-28 00:55:05.040106+00:00, run_duration=1.574698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=632, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:55:01.206560+00:00, queued_by_job_id=2, pid=9269 2024-06-28T00:55:06.531304833Z [2024-06-28T00:55:06.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:55:06.531580621Z [2024-06-28T00:55:06.531+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:54:00+00:00, run_id=scheduled__2024-06-28T00:54:00+00:00, run_start_date=2024-06-28 00:55:01.116112+00:00, run_end_date=2024-06-28 00:55:06.531301+00:00, run_duration=5.415189, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:54:00+00:00, data_interval_end=2024-06-28 00:55:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:55:06.540721834Z [2024-06-28T00:55:06.540+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:55:00+00:00, run_after=2024-06-28T00:56:00+00:00 2024-06-28T00:55:06.582253373Z [2024-06-28T00:55:06.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:54:00+00:00 exited with status success for try_number 1 2024-06-28T00:55:06.589153945Z [2024-06-28T00:55:06.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:54:00+00:00, map_index=-1, run_start_date=2024-06-28 00:55:03.670385+00:00, run_end_date=2024-06-28 00:55:05.833013+00:00, run_duration=2.162628, state=success, executor_state=success, try_number=1, max_tries=1, job_id=634, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:55:01.206560+00:00, queued_by_job_id=2, pid=9271 2024-06-28T00:55:08.806868379Z [2024-06-28T00:55:08.806+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:55:08.806923258Z 2024-06-28T00:55:08.807071686Z [2024-06-28T00:55:08.806+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:55:08.807728723Z [2024-06-28T00:55:08.807+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:55:08.807743014Z 2024-06-28T00:55:08.809998691Z [2024-06-28T00:55:08.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T00:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T00:55:08.810230022Z [2024-06-28T00:55:08.810+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T00:55:08.865016927Z [2024-06-28T00:55:08.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:50:00+00:00 exited with status queued for try_number 1 2024-06-28T00:55:08.865284208Z [2024-06-28T00:55:08.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:50:00+00:00 exited with status success for try_number 1 2024-06-28T00:55:08.870905672Z [2024-06-28T00:55:08.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec15038b-d5c7-4c03-9487-b021b2af0215 2024-06-28T00:55:08.871319655Z [2024-06-28T00:55:08.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T00:50:00+00:00, map_index=-1, run_start_date=2024-06-28 00:55:07.478801+00:00, run_end_date=2024-06-28 00:55:07.871335+00:00, run_duration=0.392534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=635, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:55:05.193212+00:00, queued_by_job_id=2, pid=9294 2024-06-28T00:55:11.558896458Z [2024-06-28T00:55:11.552+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T00:55:11.558924684Z 2024-06-28T00:55:11.558929176Z [2024-06-28T00:55:11.553+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:55:11.558933131Z [2024-06-28T00:55:11.553+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:55:11.558936314Z 2024-06-28T00:55:11.560045061Z [2024-06-28T00:55:11.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:55:11.560768687Z [2024-06-28T00:55:11.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T00:55:11.612396420Z [2024-06-28T00:55:11.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:50:00+00:00 exited with status queued for try_number 1 2024-06-28T00:55:11.612462298Z [2024-06-28T00:55:11.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:50:00+00:00 exited with status success for try_number 1 2024-06-28T00:55:11.619491655Z [2024-06-28T00:55:11.619+0000] {scheduler_job.py:635} INFO - Setting external_id for to 526d344c-2524-4753-a7e7-be4777e01e18 2024-06-28T00:55:11.619651082Z [2024-06-28T00:55:11.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T00:50:00+00:00, map_index=0, run_start_date=2024-06-28 00:55:10.569962+00:00, run_end_date=2024-06-28 00:55:10.986853+00:00, run_duration=0.416891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=636, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:55:08.808136+00:00, queued_by_job_id=2, pid=9302 2024-06-28T00:55:13.901480028Z [2024-06-28T00:55:13.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:55:13.901809328Z [2024-06-28T00:55:13.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:50:00+00:00, run_id=scheduled__2024-06-28T00:50:00+00:00, run_start_date=2024-06-28 00:55:01.112741+00:00, run_end_date=2024-06-28 00:55:13.901427+00:00, run_duration=12.788686, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:50:00+00:00, data_interval_end=2024-06-28 00:55:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T00:55:13.909889141Z [2024-06-28T00:55:13.909+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:55:00+00:00, run_after=2024-06-28T01:00:00+00:00 2024-06-28T00:55:13.953670191Z [2024-06-28T00:55:13.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:50:00+00:00 exited with status success for try_number 1 2024-06-28T00:55:13.961127230Z [2024-06-28T00:55:13.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T00:50:00+00:00, map_index=-1, run_start_date=2024-06-28 00:55:13.376197+00:00, run_end_date=2024-06-28 00:55:13.813399+00:00, run_duration=0.437202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=637, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:55:11.554634+00:00, queued_by_job_id=2, pid=9310 2024-06-28T00:56:00.120850596Z [2024-06-28T00:56:00.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:56:00+00:00, run_after=2024-06-28T00:57:00+00:00 2024-06-28T00:56:00.127981008Z [2024-06-28T00:56:00.127+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:56:00.133469163Z [2024-06-28T00:56:00.133+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:56:00.144345732Z [2024-06-28T00:56:00.143+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:56:00+00:00, run_after=2024-06-28T00:57:00+00:00 2024-06-28T00:56:00.221380078Z [2024-06-28T00:56:00.220+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:56:00.221441667Z 2024-06-28T00:56:00.221449930Z 2024-06-28T00:56:00.221455964Z 2024-06-28T00:56:00.221462134Z 2024-06-28T00:56:00.221639944Z [2024-06-28T00:56:00.221+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:56:00.222088815Z [2024-06-28T00:56:00.221+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:56:00.222336375Z [2024-06-28T00:56:00.222+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:56:00.222893394Z [2024-06-28T00:56:00.222+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:56:00.224507370Z [2024-06-28T00:56:00.224+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:56:00.224549162Z 2024-06-28T00:56:00.224554876Z 2024-06-28T00:56:00.224559101Z 2024-06-28T00:56:00.224563156Z 2024-06-28T00:56:00.230541414Z [2024-06-28T00:56:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:56:00.230639024Z [2024-06-28T00:56:00.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:56:00.231264686Z [2024-06-28T00:56:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:56:00.231449635Z [2024-06-28T00:56:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:56:00.232114042Z [2024-06-28T00:56:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:56:00.232188166Z [2024-06-28T00:56:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:56:00.232674351Z [2024-06-28T00:56:00.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:56:00.232889298Z [2024-06-28T00:56:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:56:00.735899628Z [2024-06-28T00:56:00.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:54:00+00:00 exited with status queued for try_number 1 2024-06-28T00:56:00.738830791Z [2024-06-28T00:56:00.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:55:00+00:00 exited with status queued for try_number 1 2024-06-28T00:56:00.739304936Z [2024-06-28T00:56:00.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:55:00+00:00 exited with status queued for try_number 1 2024-06-28T00:56:00.739581433Z [2024-06-28T00:56:00.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:55:00+00:00 exited with status queued for try_number 1 2024-06-28T00:56:00.759895146Z [2024-06-28T00:56:00.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to 762e47c3-a5b7-40c8-8b7e-76e1ed77cf4c 2024-06-28T00:56:00.760280542Z [2024-06-28T00:56:00.760+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c47d140-b215-4d3f-84e5-f5f951988a2c 2024-06-28T00:56:00.760595312Z [2024-06-28T00:56:00.760+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b58be7d-7ebe-4bd3-8bdd-5c70865605d6 2024-06-28T00:56:00.760961563Z [2024-06-28T00:56:00.760+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cdd5401-9742-4f33-a8a2-226725b8a915 2024-06-28T00:56:02.611488304Z [2024-06-28T00:56:02.611+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:56:02.611816088Z [2024-06-28T00:56:02.611+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:54:00+00:00, run_id=scheduled__2024-06-28T00:54:00+00:00, run_start_date=2024-06-28 00:56:00.154616+00:00, run_end_date=2024-06-28 00:56:02.611423+00:00, run_duration=2.456807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:54:00+00:00, data_interval_end=2024-06-28 00:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:56:02.638132455Z [2024-06-28T00:56:02.637+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:56:00+00:00, run_after=2024-06-28T00:58:00+00:00 2024-06-28T00:56:02.663692864Z [2024-06-28T00:56:02.662+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:56:02.668336319Z [2024-06-28T00:56:02.667+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:55:00+00:00, run_id=scheduled__2024-06-28T00:55:00+00:00, run_start_date=2024-06-28 00:56:00.156380+00:00, run_end_date=2024-06-28 00:56:02.663576+00:00, run_duration=2.507196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:55:00+00:00, data_interval_end=2024-06-28 00:56:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:56:02.703010133Z [2024-06-28T00:56:02.698+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:56:00+00:00, run_after=2024-06-28T00:57:00+00:00 2024-06-28T00:56:02.801696149Z [2024-06-28T00:56:02.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:54:00+00:00 exited with status success for try_number 1 2024-06-28T00:56:02.801866117Z [2024-06-28T00:56:02.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:55:00+00:00 exited with status success for try_number 1 2024-06-28T00:56:02.817539960Z [2024-06-28T00:56:02.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:55:00+00:00, map_index=-1, run_start_date=2024-06-28 00:56:01.319065+00:00, run_end_date=2024-06-28 00:56:01.779844+00:00, run_duration=0.460779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=639, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:56:00.226887+00:00, queued_by_job_id=2, pid=9334 2024-06-28T00:56:02.819002970Z [2024-06-28T00:56:02.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:54:00+00:00, map_index=-1, run_start_date=2024-06-28 00:56:01.213644+00:00, run_end_date=2024-06-28 00:56:01.646894+00:00, run_duration=0.43325, state=success, executor_state=success, try_number=1, max_tries=1, job_id=638, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:56:00.226887+00:00, queued_by_job_id=2, pid=9333 2024-06-28T00:56:04.938868454Z [2024-06-28T00:56:04.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:56:04.939265175Z [2024-06-28T00:56:04.939+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:55:00+00:00, run_id=scheduled__2024-06-28T00:55:00+00:00, run_start_date=2024-06-28 00:56:00.157445+00:00, run_end_date=2024-06-28 00:56:04.938797+00:00, run_duration=4.781352, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:55:00+00:00, data_interval_end=2024-06-28 00:56:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:56:04.957558907Z [2024-06-28T00:56:04.957+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:56:00+00:00, run_after=2024-06-28T00:57:00+00:00 2024-06-28T00:56:05.019776196Z [2024-06-28T00:56:05.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:55:00+00:00 exited with status success for try_number 1 2024-06-28T00:56:05.044772273Z [2024-06-28T00:56:05.044+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:55:00+00:00, map_index=-1, run_start_date=2024-06-28 00:56:02.869118+00:00, run_end_date=2024-06-28 00:56:04.409270+00:00, run_duration=1.540152, state=success, executor_state=success, try_number=1, max_tries=1, job_id=640, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:56:00.226887+00:00, queued_by_job_id=2, pid=9355 2024-06-28T00:56:06.107548243Z [2024-06-28T00:56:06.106+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:56:06.108063878Z [2024-06-28T00:56:06.107+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:55:00+00:00, run_id=scheduled__2024-06-28T00:55:00+00:00, run_start_date=2024-06-28 00:56:00.158747+00:00, run_end_date=2024-06-28 00:56:06.107751+00:00, run_duration=5.949004, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:55:00+00:00, data_interval_end=2024-06-28 00:56:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:56:06.118376844Z [2024-06-28T00:56:06.118+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:56:00+00:00, run_after=2024-06-28T00:57:00+00:00 2024-06-28T00:56:06.153675375Z [2024-06-28T00:56:06.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:55:00+00:00 exited with status success for try_number 1 2024-06-28T00:56:06.158105908Z [2024-06-28T00:56:06.157+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:55:00+00:00, map_index=-1, run_start_date=2024-06-28 00:56:03.129577+00:00, run_end_date=2024-06-28 00:56:05.383907+00:00, run_duration=2.25433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=641, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:56:00.226887+00:00, queued_by_job_id=2, pid=9358 2024-06-28T00:56:45.982228326Z [2024-06-28T00:56:45.981+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T00:57:00.535884973Z [2024-06-28T00:57:00.535+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:57:00.550912416Z [2024-06-28T00:57:00.550+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:57:00+00:00, run_after=2024-06-28T00:58:00+00:00 2024-06-28T00:57:00.563220249Z [2024-06-28T00:57:00.562+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:57:00+00:00, run_after=2024-06-28T00:58:00+00:00 2024-06-28T00:57:00.655428338Z [2024-06-28T00:57:00.654+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:57:00.655463199Z 2024-06-28T00:57:00.655474350Z 2024-06-28T00:57:00.655483820Z 2024-06-28T00:57:00.656043276Z [2024-06-28T00:57:00.655+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:57:00.656600654Z [2024-06-28T00:57:00.656+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:57:00.657111897Z [2024-06-28T00:57:00.656+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:57:00.659173554Z [2024-06-28T00:57:00.658+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:57:00.659202075Z 2024-06-28T00:57:00.659206479Z 2024-06-28T00:57:00.659210562Z 2024-06-28T00:57:00.667727262Z [2024-06-28T00:57:00.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:57:00.667905437Z [2024-06-28T00:57:00.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:57:00.668140401Z [2024-06-28T00:57:00.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:57:00.668163585Z [2024-06-28T00:57:00.668+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:57:00.668359126Z [2024-06-28T00:57:00.668+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:57:00.668431820Z [2024-06-28T00:57:00.668+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:57:01.020626452Z [2024-06-28T00:57:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:56:00+00:00 exited with status queued for try_number 1 2024-06-28T00:57:01.020922879Z [2024-06-28T00:57:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:56:00+00:00 exited with status queued for try_number 1 2024-06-28T00:57:01.021093271Z [2024-06-28T00:57:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:56:00+00:00 exited with status queued for try_number 1 2024-06-28T00:57:01.029353214Z [2024-06-28T00:57:01.029+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1e00393-f36e-49c6-a415-33b72457bf8b 2024-06-28T00:57:01.029673866Z [2024-06-28T00:57:01.029+0000] {scheduler_job.py:635} INFO - Setting external_id for to bef86e87-3bdf-48ca-9ecb-9eaa2fe888ba 2024-06-28T00:57:01.030019564Z [2024-06-28T00:57:01.029+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ef6e34e-eae0-4dd6-b485-93b301e2c97a 2024-06-28T00:57:02.282308869Z [2024-06-28T00:57:02.281+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:57:02.282802407Z [2024-06-28T00:57:02.282+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:56:00+00:00, run_id=scheduled__2024-06-28T00:56:00+00:00, run_start_date=2024-06-28 00:57:00.579242+00:00, run_end_date=2024-06-28 00:57:02.282421+00:00, run_duration=1.703179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:56:00+00:00, data_interval_end=2024-06-28 00:57:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:57:02.292753264Z [2024-06-28T00:57:02.292+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:57:00+00:00, run_after=2024-06-28T00:58:00+00:00 2024-06-28T00:57:02.352627231Z [2024-06-28T00:57:02.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:56:00+00:00 exited with status success for try_number 1 2024-06-28T00:57:02.360979290Z [2024-06-28T00:57:02.360+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:56:00+00:00, map_index=-1, run_start_date=2024-06-28 00:57:01.733731+00:00, run_end_date=2024-06-28 00:57:02.158866+00:00, run_duration=0.425135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=642, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:57:00.660926+00:00, queued_by_job_id=2, pid=9391 2024-06-28T00:57:04.519986705Z [2024-06-28T00:57:04.519+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:57:04.528629460Z [2024-06-28T00:57:04.528+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:56:00+00:00, run_id=scheduled__2024-06-28T00:56:00+00:00, run_start_date=2024-06-28 00:57:00.581220+00:00, run_end_date=2024-06-28 00:57:04.519927+00:00, run_duration=3.938707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:56:00+00:00, data_interval_end=2024-06-28 00:57:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:57:04.540947224Z [2024-06-28T00:57:04.540+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:57:00+00:00, run_after=2024-06-28T00:58:00+00:00 2024-06-28T00:57:05.671342605Z [2024-06-28T00:57:05.670+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:57:05.671636610Z [2024-06-28T00:57:05.671+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:56:00+00:00, run_id=scheduled__2024-06-28T00:56:00+00:00, run_start_date=2024-06-28 00:57:00.582678+00:00, run_end_date=2024-06-28 00:57:05.671285+00:00, run_duration=5.088607, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:56:00+00:00, data_interval_end=2024-06-28 00:57:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:57:05.697407878Z [2024-06-28T00:57:05.687+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:57:00+00:00, run_after=2024-06-28T00:58:00+00:00 2024-06-28T00:57:05.763514751Z [2024-06-28T00:57:05.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:56:00+00:00 exited with status success for try_number 1 2024-06-28T00:57:05.765660531Z [2024-06-28T00:57:05.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:56:00+00:00 exited with status success for try_number 1 2024-06-28T00:57:05.805164959Z [2024-06-28T00:57:05.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:56:00+00:00, map_index=-1, run_start_date=2024-06-28 00:57:02.886712+00:00, run_end_date=2024-06-28 00:57:04.475996+00:00, run_duration=1.589284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=644, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:57:00.660926+00:00, queued_by_job_id=2, pid=9409 2024-06-28T00:57:05.814663550Z [2024-06-28T00:57:05.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:56:00+00:00, map_index=-1, run_start_date=2024-06-28 00:57:02.629079+00:00, run_end_date=2024-06-28 00:57:04.716020+00:00, run_duration=2.086941, state=success, executor_state=success, try_number=1, max_tries=1, job_id=643, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:57:00.660926+00:00, queued_by_job_id=2, pid=9403 2024-06-28T00:58:00.368125226Z [2024-06-28T00:58:00.367+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:58:00.395456306Z [2024-06-28T00:58:00.395+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:58:00+00:00, run_after=2024-06-28T00:59:00+00:00 2024-06-28T00:58:00.411891395Z [2024-06-28T00:58:00.411+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:58:00+00:00, run_after=2024-06-28T00:59:00+00:00 2024-06-28T00:58:00.421016106Z [2024-06-28T00:58:00.420+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:58:00.521567918Z [2024-06-28T00:58:00.521+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T00:58:00.521584419Z 2024-06-28T00:58:00.521588209Z 2024-06-28T00:58:00.521591272Z 2024-06-28T00:58:00.521605936Z 2024-06-28T00:58:00.521609735Z [2024-06-28T00:58:00.521+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T00:58:00.521813569Z [2024-06-28T00:58:00.521+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:58:00.521979755Z [2024-06-28T00:58:00.521+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:58:00.522155029Z [2024-06-28T00:58:00.521+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:58:00.522955881Z [2024-06-28T00:58:00.522+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:58:00.522968736Z 2024-06-28T00:58:00.522974509Z 2024-06-28T00:58:00.522979649Z 2024-06-28T00:58:00.522985040Z 2024-06-28T00:58:00.527219444Z [2024-06-28T00:58:00.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:58:00.527434007Z [2024-06-28T00:58:00.527+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T00:58:00.527784377Z [2024-06-28T00:58:00.527+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:58:00.527946622Z [2024-06-28T00:58:00.527+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:58:00.528235150Z [2024-06-28T00:58:00.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:58:00.528409769Z [2024-06-28T00:58:00.528+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:58:00.528663217Z [2024-06-28T00:58:00.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:58:00.528839429Z [2024-06-28T00:58:00.528+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:58:00.832662214Z [2024-06-28T00:58:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:56:00+00:00 exited with status queued for try_number 1 2024-06-28T00:58:00.832836142Z [2024-06-28T00:58:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:57:00+00:00 exited with status queued for try_number 1 2024-06-28T00:58:00.832981559Z [2024-06-28T00:58:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:57:00+00:00 exited with status queued for try_number 1 2024-06-28T00:58:00.833114969Z [2024-06-28T00:58:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:57:00+00:00 exited with status queued for try_number 1 2024-06-28T00:58:00.841811230Z [2024-06-28T00:58:00.841+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f04fbde-f771-478d-a34a-65369ea77663 2024-06-28T00:58:00.841953979Z [2024-06-28T00:58:00.841+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94387791-a9a0-42ba-a0db-8bbe9b5e82c7 2024-06-28T00:58:00.842108717Z [2024-06-28T00:58:00.841+0000] {scheduler_job.py:635} INFO - Setting external_id for to b30f2410-6b14-4a69-a731-46f9d7508d06 2024-06-28T00:58:00.842271386Z [2024-06-28T00:58:00.842+0000] {scheduler_job.py:635} INFO - Setting external_id for to edd9d9f0-bf84-4e3e-9095-b6e8d55453fb 2024-06-28T00:58:02.925659422Z [2024-06-28T00:58:02.925+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:58:02.926260653Z [2024-06-28T00:58:02.925+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:56:00+00:00, run_id=scheduled__2024-06-28T00:56:00+00:00, run_start_date=2024-06-28 00:58:00.436965+00:00, run_end_date=2024-06-28 00:58:02.925611+00:00, run_duration=2.488646, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:56:00+00:00, data_interval_end=2024-06-28 00:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T00:58:02.938459322Z [2024-06-28T00:58:02.937+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T00:58:00+00:00, run_after=2024-06-28T01:00:00+00:00 2024-06-28T00:58:02.949346611Z [2024-06-28T00:58:02.948+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:58:02.949820834Z [2024-06-28T00:58:02.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:57:00+00:00, run_id=scheduled__2024-06-28T00:57:00+00:00, run_start_date=2024-06-28 00:58:00.438522+00:00, run_end_date=2024-06-28 00:58:02.949301+00:00, run_duration=2.510779, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:57:00+00:00, data_interval_end=2024-06-28 00:58:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:58:02.982129169Z [2024-06-28T00:58:02.981+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:58:00+00:00, run_after=2024-06-28T00:59:00+00:00 2024-06-28T00:58:03.099279237Z [2024-06-28T00:58:03.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:56:00+00:00 exited with status success for try_number 1 2024-06-28T00:58:03.099831341Z [2024-06-28T00:58:03.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:57:00+00:00 exited with status success for try_number 1 2024-06-28T00:58:03.116428026Z [2024-06-28T00:58:03.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:56:00+00:00, map_index=-1, run_start_date=2024-06-28 00:58:01.374718+00:00, run_end_date=2024-06-28 00:58:01.803959+00:00, run_duration=0.429241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=645, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:58:00.523969+00:00, queued_by_job_id=2, pid=9440 2024-06-28T00:58:03.116945502Z [2024-06-28T00:58:03.116+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:57:00+00:00, map_index=-1, run_start_date=2024-06-28 00:58:01.658933+00:00, run_end_date=2024-06-28 00:58:02.253577+00:00, run_duration=0.594644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=646, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:58:00.523969+00:00, queued_by_job_id=2, pid=9443 2024-06-28T00:58:05.654639631Z [2024-06-28T00:58:05.654+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:58:05.655736819Z [2024-06-28T00:58:05.654+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:57:00+00:00, run_id=scheduled__2024-06-28T00:57:00+00:00, run_start_date=2024-06-28 00:58:00.441314+00:00, run_end_date=2024-06-28 00:58:05.654565+00:00, run_duration=5.213251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:57:00+00:00, data_interval_end=2024-06-28 00:58:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:58:05.699198311Z [2024-06-28T00:58:05.698+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:58:00+00:00, run_after=2024-06-28T00:59:00+00:00 2024-06-28T00:58:05.707239514Z [2024-06-28T00:58:05.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:58:05.707406067Z [2024-06-28T00:58:05.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:57:00+00:00, run_id=scheduled__2024-06-28T00:57:00+00:00, run_start_date=2024-06-28 00:58:00.439972+00:00, run_end_date=2024-06-28 00:58:05.707183+00:00, run_duration=5.267211, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:57:00+00:00, data_interval_end=2024-06-28 00:58:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:58:05.718558279Z [2024-06-28T00:58:05.718+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:58:00+00:00, run_after=2024-06-28T00:59:00+00:00 2024-06-28T00:58:05.792663863Z [2024-06-28T00:58:05.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:57:00+00:00 exited with status success for try_number 1 2024-06-28T00:58:05.792943957Z [2024-06-28T00:58:05.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:57:00+00:00 exited with status success for try_number 1 2024-06-28T00:58:05.800103162Z [2024-06-28T00:58:05.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:57:00+00:00, map_index=-1, run_start_date=2024-06-28 00:58:03.353034+00:00, run_end_date=2024-06-28 00:58:04.850553+00:00, run_duration=1.497519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=648, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:58:00.523969+00:00, queued_by_job_id=2, pid=9467 2024-06-28T00:58:05.800474798Z [2024-06-28T00:58:05.800+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:57:00+00:00, map_index=-1, run_start_date=2024-06-28 00:58:03.183730+00:00, run_end_date=2024-06-28 00:58:05.025739+00:00, run_duration=1.842009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=647, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:58:00.523969+00:00, queued_by_job_id=2, pid=9466 2024-06-28T00:59:00.416272341Z [2024-06-28T00:59:00.415+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:59:00+00:00, run_after=2024-06-28T01:00:00+00:00 2024-06-28T00:59:00.426336652Z [2024-06-28T00:59:00.425+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T00:59:00.440984659Z [2024-06-28T00:59:00.440+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:59:00+00:00, run_after=2024-06-28T01:00:00+00:00 2024-06-28T00:59:00.519084813Z [2024-06-28T00:59:00.518+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T00:59:00.519103696Z 2024-06-28T00:59:00.519108618Z 2024-06-28T00:59:00.519113425Z 2024-06-28T00:59:00.519282883Z [2024-06-28T00:59:00.519+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:59:00.519470858Z [2024-06-28T00:59:00.519+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T00:59:00.519618646Z [2024-06-28T00:59:00.519+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T00:59:00.520390085Z [2024-06-28T00:59:00.520+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T00:59:00.520398176Z 2024-06-28T00:59:00.520401393Z 2024-06-28T00:59:00.520404362Z 2024-06-28T00:59:00.525418381Z [2024-06-28T00:59:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:59:00.525648486Z [2024-06-28T00:59:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T00:59:00.525951321Z [2024-06-28T00:59:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:59:00.526097733Z [2024-06-28T00:59:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T00:59:00.526387493Z [2024-06-28T00:59:00.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T00:59:00.526511086Z [2024-06-28T00:59:00.526+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T00:59:00.834728990Z [2024-06-28T00:59:00.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:58:00+00:00 exited with status queued for try_number 1 2024-06-28T00:59:00.834787021Z [2024-06-28T00:59:00.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:58:00+00:00 exited with status queued for try_number 1 2024-06-28T00:59:00.834874216Z [2024-06-28T00:59:00.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:58:00+00:00 exited with status queued for try_number 1 2024-06-28T00:59:00.846586299Z [2024-06-28T00:59:00.846+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0047e20-0a14-43a6-acb3-5965529e80ff 2024-06-28T00:59:00.846668380Z [2024-06-28T00:59:00.846+0000] {scheduler_job.py:635} INFO - Setting external_id for to cae52b2e-33d4-48d0-a7c2-20b020b2e39b 2024-06-28T00:59:00.847126454Z [2024-06-28T00:59:00.846+0000] {scheduler_job.py:635} INFO - Setting external_id for to 082b184f-4333-4831-9f7a-0a4b59c32758 2024-06-28T00:59:02.298403364Z [2024-06-28T00:59:02.298+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:59:02.299040960Z [2024-06-28T00:59:02.298+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:58:00+00:00, run_id=scheduled__2024-06-28T00:58:00+00:00, run_start_date=2024-06-28 00:59:00.453554+00:00, run_end_date=2024-06-28 00:59:02.298630+00:00, run_duration=1.845076, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:58:00+00:00, data_interval_end=2024-06-28 00:59:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T00:59:02.308722538Z [2024-06-28T00:59:02.308+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T00:59:00+00:00, run_after=2024-06-28T01:00:00+00:00 2024-06-28T00:59:02.357918563Z [2024-06-28T00:59:02.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:58:00+00:00 exited with status success for try_number 1 2024-06-28T00:59:02.363355445Z [2024-06-28T00:59:02.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:58:00+00:00, map_index=-1, run_start_date=2024-06-28 00:59:01.362491+00:00, run_end_date=2024-06-28 00:59:01.791097+00:00, run_duration=0.428606, state=success, executor_state=success, try_number=1, max_tries=1, job_id=649, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:59:00.521315+00:00, queued_by_job_id=2, pid=9498 2024-06-28T00:59:04.461340047Z [2024-06-28T00:59:04.460+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:59:04.461364688Z [2024-06-28T00:59:04.460+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:58:00+00:00, run_id=scheduled__2024-06-28T00:58:00+00:00, run_start_date=2024-06-28 00:59:00.455367+00:00, run_end_date=2024-06-28 00:59:04.460376+00:00, run_duration=4.005009, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:58:00+00:00, data_interval_end=2024-06-28 00:59:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T00:59:04.478526095Z [2024-06-28T00:59:04.478+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:59:00+00:00, run_after=2024-06-28T01:00:00+00:00 2024-06-28T00:59:04.485909938Z [2024-06-28T00:59:04.485+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T00:59:04.486786560Z [2024-06-28T00:59:04.486+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:58:00+00:00, run_id=scheduled__2024-06-28T00:58:00+00:00, run_start_date=2024-06-28 00:59:00.459630+00:00, run_end_date=2024-06-28 00:59:04.486446+00:00, run_duration=4.026816, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:58:00+00:00, data_interval_end=2024-06-28 00:59:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T00:59:04.499843389Z [2024-06-28T00:59:04.499+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T00:59:00+00:00, run_after=2024-06-28T01:00:00+00:00 2024-06-28T00:59:04.578536604Z [2024-06-28T00:59:04.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:58:00+00:00 exited with status success for try_number 1 2024-06-28T00:59:04.578699333Z [2024-06-28T00:59:04.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:58:00+00:00 exited with status success for try_number 1 2024-06-28T00:59:04.586748707Z [2024-06-28T00:59:04.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:58:00+00:00, map_index=-1, run_start_date=2024-06-28 00:59:02.586968+00:00, run_end_date=2024-06-28 00:59:03.817684+00:00, run_duration=1.230716, state=success, executor_state=success, try_number=1, max_tries=1, job_id=650, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:59:00.521315+00:00, queued_by_job_id=2, pid=9516 2024-06-28T00:59:04.586977181Z [2024-06-28T00:59:04.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:58:00+00:00, map_index=-1, run_start_date=2024-06-28 00:59:02.630404+00:00, run_end_date=2024-06-28 00:59:04.318526+00:00, run_duration=1.688122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=651, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 00:59:00.521315+00:00, queued_by_job_id=2, pid=9517 2024-06-28T01:00:00.369631487Z [2024-06-28T01:00:00.369+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:00:00+00:00, run_after=2024-06-28T01:05:00+00:00 2024-06-28T01:00:00.384634483Z [2024-06-28T01:00:00.384+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:00:00.409181331Z [2024-06-28T01:00:00.408+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:00:00+00:00, run_after=2024-06-28T01:01:00+00:00 2024-06-28T01:00:00.431419543Z [2024-06-28T01:00:00.431+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:00:00+00:00, run_after=2024-06-28T01:01:00+00:00 2024-06-28T01:00:00.441696206Z [2024-06-28T01:00:00.441+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:00:00.553158054Z [2024-06-28T01:00:00.552+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-28T01:00:00.553176491Z 2024-06-28T01:00:00.553179895Z 2024-06-28T01:00:00.553187849Z 2024-06-28T01:00:00.553191251Z 2024-06-28T01:00:00.553194510Z 2024-06-28T01:00:00.553388118Z [2024-06-28T01:00:00.553+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:00:00.553572438Z [2024-06-28T01:00:00.553+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:00:00.553737535Z [2024-06-28T01:00:00.553+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:00:00.553909127Z [2024-06-28T01:00:00.553+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:00:00.554065259Z [2024-06-28T01:00:00.553+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:00:00.554951326Z [2024-06-28T01:00:00.554+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:00:00.554969248Z 2024-06-28T01:00:00.555007496Z 2024-06-28T01:00:00.555016442Z 2024-06-28T01:00:00.555022995Z 2024-06-28T01:00:00.555029157Z 2024-06-28T01:00:00.558562495Z [2024-06-28T01:00:00.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T01:00:00.558722404Z [2024-06-28T01:00:00.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:00:00.558902307Z [2024-06-28T01:00:00.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:00:00.559003519Z [2024-06-28T01:00:00.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:00:00.559338662Z [2024-06-28T01:00:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:00:00.559485530Z [2024-06-28T01:00:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:00:00.559719895Z [2024-06-28T01:00:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:00:00.559839481Z [2024-06-28T01:00:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:00:00.560008923Z [2024-06-28T01:00:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:00:00.560123401Z [2024-06-28T01:00:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:00:01.086000364Z [2024-06-28T01:00:01.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:55:00+00:00 exited with status queued for try_number 1 2024-06-28T01:00:01.087958091Z [2024-06-28T01:00:01.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:58:00+00:00 exited with status queued for try_number 1 2024-06-28T01:00:01.088153769Z [2024-06-28T01:00:01.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:59:00+00:00 exited with status queued for try_number 1 2024-06-28T01:00:01.088321158Z [2024-06-28T01:00:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:59:00+00:00 exited with status queued for try_number 1 2024-06-28T01:00:01.088503394Z [2024-06-28T01:00:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:59:00+00:00 exited with status queued for try_number 1 2024-06-28T01:00:01.113565767Z [2024-06-28T01:00:01.113+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7efda2d-0ae6-4217-827a-e01a9e00a990 2024-06-28T01:00:01.113864992Z [2024-06-28T01:00:01.113+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc00991f-7c83-4ac4-8d20-c5d5049e1f7f 2024-06-28T01:00:01.114179973Z [2024-06-28T01:00:01.113+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5f34c2e-6433-4c1c-ab87-d18d4a8593a2 2024-06-28T01:00:01.114502674Z [2024-06-28T01:00:01.114+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1bcaa8ae-95b6-4b74-b10d-c1e3f85060a9 2024-06-28T01:00:01.114783384Z [2024-06-28T01:00:01.114+0000] {scheduler_job.py:635} INFO - Setting external_id for to 700680d6-6c10-4146-add8-60323ad0dd8e 2024-06-28T01:00:02.780584983Z [2024-06-28T01:00:02.780+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:00:02.780927062Z [2024-06-28T01:00:02.780+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 00:58:00+00:00, run_id=scheduled__2024-06-28T00:58:00+00:00, run_start_date=2024-06-28 01:00:00.462944+00:00, run_end_date=2024-06-28 01:00:02.780509+00:00, run_duration=2.317565, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:58:00+00:00, data_interval_end=2024-06-28 01:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:00:02.815161013Z [2024-06-28T01:00:02.814+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:00:00+00:00, run_after=2024-06-28T01:02:00+00:00 2024-06-28T01:00:02.942334663Z [2024-06-28T01:00:02.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T00:58:00+00:00 exited with status success for try_number 1 2024-06-28T01:00:02.955787705Z [2024-06-28T01:00:02.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T00:58:00+00:00, map_index=-1, run_start_date=2024-06-28 01:00:01.503037+00:00, run_end_date=2024-06-28 01:00:02.096149+00:00, run_duration=0.593112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=652, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:00:00.555867+00:00, queued_by_job_id=2, pid=9546 2024-06-28T01:00:04.039775725Z [2024-06-28T01:00:04.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:00:04.040187741Z [2024-06-28T01:00:04.039+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 00:59:00+00:00, run_id=scheduled__2024-06-28T00:59:00+00:00, run_start_date=2024-06-28 01:00:00.464559+00:00, run_end_date=2024-06-28 01:00:04.039688+00:00, run_duration=3.575129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:59:00+00:00, data_interval_end=2024-06-28 01:00:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:00:04.058310688Z [2024-06-28T01:00:04.053+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:00:00+00:00, run_after=2024-06-28T01:01:00+00:00 2024-06-28T01:00:04.125312252Z [2024-06-28T01:00:04.125+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:00:04.125348276Z 2024-06-28T01:00:04.126233419Z [2024-06-28T01:00:04.125+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:00:04.127249257Z [2024-06-28T01:00:04.127+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:00:04.127262320Z 2024-06-28T01:00:04.131600234Z [2024-06-28T01:00:04.130+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T01:00:04.131615792Z [2024-06-28T01:00:04.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:00:04.246921433Z [2024-06-28T01:00:04.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:55:00+00:00 exited with status queued for try_number 1 2024-06-28T01:00:04.246962687Z [2024-06-28T01:00:04.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T00:55:00+00:00 exited with status success for try_number 1 2024-06-28T01:00:04.247043861Z [2024-06-28T01:00:04.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:59:00+00:00 exited with status success for try_number 1 2024-06-28T01:00:04.262812108Z [2024-06-28T01:00:04.261+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:59:00+00:00, map_index=-1, run_start_date=2024-06-28 01:00:02.364046+00:00, run_end_date=2024-06-28 01:00:02.848208+00:00, run_duration=0.484162, state=success, executor_state=success, try_number=1, max_tries=1, job_id=653, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:00:00.555867+00:00, queued_by_job_id=2, pid=9560 2024-06-28T01:00:04.263201673Z [2024-06-28T01:00:04.262+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T00:55:00+00:00, map_index=-1, run_start_date=2024-06-28 01:00:03.392485+00:00, run_end_date=2024-06-28 01:00:03.793514+00:00, run_duration=0.401029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=656, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:00:00.555867+00:00, queued_by_job_id=2, pid=9583 2024-06-28T01:00:04.265559017Z [2024-06-28T01:00:04.265+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9987078-2733-4351-b259-96eaaf5038ef 2024-06-28T01:00:05.498567141Z [2024-06-28T01:00:05.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:00:05.499104633Z [2024-06-28T01:00:05.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:59:00+00:00, run_id=scheduled__2024-06-28T00:59:00+00:00, run_start_date=2024-06-28 01:00:00.465959+00:00, run_end_date=2024-06-28 01:00:05.498472+00:00, run_duration=5.032513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:59:00+00:00, data_interval_end=2024-06-28 01:00:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:00:05.520839038Z [2024-06-28T01:00:05.520+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:00:00+00:00, run_after=2024-06-28T01:01:00+00:00 2024-06-28T01:00:05.559046271Z [2024-06-28T01:00:05.546+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:00:05.559071605Z [2024-06-28T01:00:05.555+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:59:00+00:00, run_id=scheduled__2024-06-28T00:59:00+00:00, run_start_date=2024-06-28 01:00:00.467466+00:00, run_end_date=2024-06-28 01:00:05.555434+00:00, run_duration=5.087968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:59:00+00:00, data_interval_end=2024-06-28 01:00:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:00:05.602486131Z [2024-06-28T01:00:05.600+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:00:00+00:00, run_after=2024-06-28T01:01:00+00:00 2024-06-28T01:00:05.760704333Z [2024-06-28T01:00:05.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:59:00+00:00 exited with status success for try_number 1 2024-06-28T01:00:05.760733765Z [2024-06-28T01:00:05.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T00:59:00+00:00 exited with status success for try_number 1 2024-06-28T01:00:05.768378431Z [2024-06-28T01:00:05.766+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:59:00+00:00, map_index=-1, run_start_date=2024-06-28 01:00:03.285253+00:00, run_end_date=2024-06-28 01:00:05.107235+00:00, run_duration=1.821982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=654, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:00:00.555867+00:00, queued_by_job_id=2, pid=9581 2024-06-28T01:00:05.768547490Z [2024-06-28T01:00:05.768+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T00:59:00+00:00, map_index=-1, run_start_date=2024-06-28 01:00:03.308493+00:00, run_end_date=2024-06-28 01:00:04.596554+00:00, run_duration=1.288061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=655, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:00:00.555867+00:00, queued_by_job_id=2, pid=9582 2024-06-28T01:00:07.411344680Z [2024-06-28T01:00:07.410+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:00:07.411374746Z 2024-06-28T01:00:07.411388056Z [2024-06-28T01:00:07.411+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:00:07.411981923Z [2024-06-28T01:00:07.411+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:00:07.411994202Z 2024-06-28T01:00:07.414584922Z [2024-06-28T01:00:07.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T00:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T01:00:07.414807371Z [2024-06-28T01:00:07.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T01:00:07.489245519Z [2024-06-28T01:00:07.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:55:00+00:00 exited with status queued for try_number 1 2024-06-28T01:00:07.489582870Z [2024-06-28T01:00:07.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T00:55:00+00:00 exited with status success for try_number 1 2024-06-28T01:00:07.498307129Z [2024-06-28T01:00:07.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdbdadc8-2e7b-4bf5-819d-ba720024197d 2024-06-28T01:00:07.499017343Z [2024-06-28T01:00:07.498+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T00:55:00+00:00, map_index=-1, run_start_date=2024-06-28 01:00:06.459251+00:00, run_end_date=2024-06-28 01:00:06.823304+00:00, run_duration=0.364053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=657, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:00:04.127988+00:00, queued_by_job_id=2, pid=9606 2024-06-28T01:00:09.808819233Z [2024-06-28T01:00:09.808+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:00:09.808870702Z 2024-06-28T01:00:09.808886210Z [2024-06-28T01:00:09.808+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:00:09.809435902Z [2024-06-28T01:00:09.809+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:00:09.809454254Z 2024-06-28T01:00:09.811765467Z [2024-06-28T01:00:09.811+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:00:09.812142328Z [2024-06-28T01:00:09.811+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:00:09.878926493Z [2024-06-28T01:00:09.878+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:55:00+00:00 exited with status queued for try_number 1 2024-06-28T01:00:09.879137923Z [2024-06-28T01:00:09.878+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T00:55:00+00:00 exited with status success for try_number 1 2024-06-28T01:00:09.889905314Z [2024-06-28T01:00:09.889+0000] {scheduler_job.py:635} INFO - Setting external_id for to 412705bb-d528-4720-bb45-e54aa0d7404d 2024-06-28T01:00:09.891135495Z [2024-06-28T01:00:09.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T00:55:00+00:00, map_index=0, run_start_date=2024-06-28 01:00:09.151113+00:00, run_end_date=2024-06-28 01:00:09.550947+00:00, run_duration=0.399834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=658, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:00:07.412381+00:00, queued_by_job_id=2, pid=9614 2024-06-28T01:00:12.513465037Z [2024-06-28T01:00:12.512+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:00:12.514205956Z [2024-06-28T01:00:12.513+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 00:55:00+00:00, run_id=scheduled__2024-06-28T00:55:00+00:00, run_start_date=2024-06-28 01:00:00.461023+00:00, run_end_date=2024-06-28 01:00:12.513572+00:00, run_duration=12.052549, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 00:55:00+00:00, data_interval_end=2024-06-28 01:00:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T01:00:12.522314451Z [2024-06-28T01:00:12.522+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:00:00+00:00, run_after=2024-06-28T01:05:00+00:00 2024-06-28T01:00:12.577169538Z [2024-06-28T01:00:12.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T00:55:00+00:00 exited with status success for try_number 1 2024-06-28T01:00:12.581714035Z [2024-06-28T01:00:12.581+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T00:55:00+00:00, map_index=-1, run_start_date=2024-06-28 01:00:11.613589+00:00, run_end_date=2024-06-28 01:00:11.997894+00:00, run_duration=0.384305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=659, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:00:09.809912+00:00, queued_by_job_id=2, pid=9622 2024-06-28T01:01:00.223976165Z [2024-06-28T01:01:00.223+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:01:00+00:00, run_after=2024-06-28T01:02:00+00:00 2024-06-28T01:01:00.232227763Z [2024-06-28T01:01:00.231+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:01:00.244363645Z [2024-06-28T01:01:00.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:01:00+00:00, run_after=2024-06-28T01:02:00+00:00 2024-06-28T01:01:00.321363409Z [2024-06-28T01:01:00.321+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:01:00.321382097Z 2024-06-28T01:01:00.321407112Z 2024-06-28T01:01:00.321412267Z 2024-06-28T01:01:00.321746202Z [2024-06-28T01:01:00.321+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:01:00.322047092Z [2024-06-28T01:01:00.321+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:01:00.322316881Z [2024-06-28T01:01:00.322+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:01:00.323298746Z [2024-06-28T01:01:00.323+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:01:00.323314439Z 2024-06-28T01:01:00.323318977Z 2024-06-28T01:01:00.323323396Z 2024-06-28T01:01:00.327112882Z [2024-06-28T01:01:00.326+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:01:00.327370941Z [2024-06-28T01:01:00.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:01:00.327746905Z [2024-06-28T01:01:00.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:01:00.327979395Z [2024-06-28T01:01:00.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:01:00.328325436Z [2024-06-28T01:01:00.328+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:01:00.328553996Z [2024-06-28T01:01:00.328+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:01:00.636741057Z [2024-06-28T01:01:00.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:00:00+00:00 exited with status queued for try_number 1 2024-06-28T01:01:00.637160571Z [2024-06-28T01:01:00.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:00:00+00:00 exited with status queued for try_number 1 2024-06-28T01:01:00.637545881Z [2024-06-28T01:01:00.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:00:00+00:00 exited with status queued for try_number 1 2024-06-28T01:01:00.667688985Z [2024-06-28T01:01:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 873b58e8-7461-4f3f-bea5-3615a17d9fae 2024-06-28T01:01:00.668212880Z [2024-06-28T01:01:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e835655-05cd-4bc8-82d6-eef4a884109a 2024-06-28T01:01:00.669530612Z [2024-06-28T01:01:00.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3457ee3-8e40-4715-9f86-8b6852f89770 2024-06-28T01:01:01.818778727Z [2024-06-28T01:01:01.818+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:01:01.819368514Z [2024-06-28T01:01:01.819+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:00:00+00:00, run_id=scheduled__2024-06-28T01:00:00+00:00, run_start_date=2024-06-28 01:01:00.254383+00:00, run_end_date=2024-06-28 01:01:01.818656+00:00, run_duration=1.564273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:00:00+00:00, data_interval_end=2024-06-28 01:01:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:01:01.830370303Z [2024-06-28T01:01:01.830+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:01:00+00:00, run_after=2024-06-28T01:02:00+00:00 2024-06-28T01:01:02.139498571Z [2024-06-28T01:01:02.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:00:00+00:00 exited with status success for try_number 1 2024-06-28T01:01:02.145750559Z [2024-06-28T01:01:02.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:00:00+00:00, map_index=-1, run_start_date=2024-06-28 01:01:01.305500+00:00, run_end_date=2024-06-28 01:01:01.754499+00:00, run_duration=0.448999, state=success, executor_state=success, try_number=1, max_tries=1, job_id=660, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:01:00.324430+00:00, queued_by_job_id=2, pid=9643 2024-06-28T01:01:04.505523211Z [2024-06-28T01:01:04.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:01:04.505671332Z [2024-06-28T01:01:04.505+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:00:00+00:00, run_id=scheduled__2024-06-28T01:00:00+00:00, run_start_date=2024-06-28 01:01:00.256228+00:00, run_end_date=2024-06-28 01:01:04.505368+00:00, run_duration=4.24914, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:00:00+00:00, data_interval_end=2024-06-28 01:01:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:01:04.521484877Z [2024-06-28T01:01:04.520+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:01:00+00:00, run_after=2024-06-28T01:02:00+00:00 2024-06-28T01:01:04.531272677Z [2024-06-28T01:01:04.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:01:04.531803610Z [2024-06-28T01:01:04.531+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:00:00+00:00, run_id=scheduled__2024-06-28T01:00:00+00:00, run_start_date=2024-06-28 01:01:00.257264+00:00, run_end_date=2024-06-28 01:01:04.531296+00:00, run_duration=4.274032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:00:00+00:00, data_interval_end=2024-06-28 01:01:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:01:04.542237051Z [2024-06-28T01:01:04.541+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:01:00+00:00, run_after=2024-06-28T01:02:00+00:00 2024-06-28T01:01:04.576791882Z [2024-06-28T01:01:04.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:00:00+00:00 exited with status success for try_number 1 2024-06-28T01:01:04.578748532Z [2024-06-28T01:01:04.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:00:00+00:00 exited with status success for try_number 1 2024-06-28T01:01:04.585293246Z [2024-06-28T01:01:04.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:00:00+00:00, map_index=-1, run_start_date=2024-06-28 01:01:02.362054+00:00, run_end_date=2024-06-28 01:01:04.077474+00:00, run_duration=1.71542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=661, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:01:00.324430+00:00, queued_by_job_id=2, pid=9661 2024-06-28T01:01:04.585494263Z [2024-06-28T01:01:04.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:00:00+00:00, map_index=-1, run_start_date=2024-06-28 01:01:02.364783+00:00, run_end_date=2024-06-28 01:01:03.731842+00:00, run_duration=1.367059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=662, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:01:00.324430+00:00, queued_by_job_id=2, pid=9662 2024-06-28T01:01:46.058401002Z [2024-06-28T01:01:46.057+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T01:02:00.160684895Z [2024-06-28T01:02:00.160+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:02:00+00:00, run_after=2024-06-28T01:03:00+00:00 2024-06-28T01:02:00.174090070Z [2024-06-28T01:02:00.173+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:02:00.195084092Z [2024-06-28T01:02:00.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:02:00+00:00, run_after=2024-06-28T01:03:00+00:00 2024-06-28T01:02:00.207766534Z [2024-06-28T01:02:00.207+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:02:00.335314163Z [2024-06-28T01:02:00.334+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:02:00.335327419Z 2024-06-28T01:02:00.335333715Z 2024-06-28T01:02:00.335339858Z 2024-06-28T01:02:00.335344819Z 2024-06-28T01:02:00.335695445Z [2024-06-28T01:02:00.335+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:02:00.335809712Z [2024-06-28T01:02:00.335+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:02:00.335982920Z [2024-06-28T01:02:00.335+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:02:00.336127181Z [2024-06-28T01:02:00.335+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:02:00.337069146Z [2024-06-28T01:02:00.336+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:02:00.337137663Z 2024-06-28T01:02:00.337142908Z 2024-06-28T01:02:00.337146275Z 2024-06-28T01:02:00.337149364Z 2024-06-28T01:02:00.342255727Z [2024-06-28T01:02:00.341+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:02:00.342280611Z [2024-06-28T01:02:00.342+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:02:00.342500857Z [2024-06-28T01:02:00.342+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:02:00.342601185Z [2024-06-28T01:02:00.342+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:02:00.342823734Z [2024-06-28T01:02:00.342+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:02:00.342924002Z [2024-06-28T01:02:00.342+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:02:00.343156657Z [2024-06-28T01:02:00.342+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:02:00.343194959Z [2024-06-28T01:02:00.343+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:02:00.999832839Z [2024-06-28T01:02:00.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:00:00+00:00 exited with status queued for try_number 1 2024-06-28T01:02:01.010771230Z [2024-06-28T01:02:00.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:01:00+00:00 exited with status queued for try_number 1 2024-06-28T01:02:01.019044702Z [2024-06-28T01:02:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:01:00+00:00 exited with status queued for try_number 1 2024-06-28T01:02:01.019396419Z [2024-06-28T01:02:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:01:00+00:00 exited with status queued for try_number 1 2024-06-28T01:02:01.031914276Z [2024-06-28T01:02:01.030+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac3595bb-555e-4800-b271-2dbccaf13d70 2024-06-28T01:02:01.032346445Z [2024-06-28T01:02:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79ef04d0-f166-4721-9ccb-ab4ac4fe7a68 2024-06-28T01:02:01.032622558Z [2024-06-28T01:02:01.032+0000] {scheduler_job.py:635} INFO - Setting external_id for to 916a2a90-1553-42fd-88b8-5c85341c327e 2024-06-28T01:02:01.032838220Z [2024-06-28T01:02:01.032+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ac872c9-4b32-47d2-a2d9-e3ff01ce7d46 2024-06-28T01:02:02.240443033Z [2024-06-28T01:02:02.240+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:02:02.241077046Z [2024-06-28T01:02:02.240+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:00:00+00:00, run_id=scheduled__2024-06-28T01:00:00+00:00, run_start_date=2024-06-28 01:02:00.223447+00:00, run_end_date=2024-06-28 01:02:02.240339+00:00, run_duration=2.016892, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:00:00+00:00, data_interval_end=2024-06-28 01:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:02:02.250054828Z [2024-06-28T01:02:02.249+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:02:00+00:00, run_after=2024-06-28T01:04:00+00:00 2024-06-28T01:02:02.257512946Z [2024-06-28T01:02:02.257+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:02:02.257851235Z [2024-06-28T01:02:02.257+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:01:00+00:00, run_id=scheduled__2024-06-28T01:01:00+00:00, run_start_date=2024-06-28 01:02:00.225399+00:00, run_end_date=2024-06-28 01:02:02.257396+00:00, run_duration=2.031997, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:01:00+00:00, data_interval_end=2024-06-28 01:02:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:02:02.268054501Z [2024-06-28T01:02:02.267+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:02:00+00:00, run_after=2024-06-28T01:03:00+00:00 2024-06-28T01:02:02.321387023Z [2024-06-28T01:02:02.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:00:00+00:00 exited with status success for try_number 1 2024-06-28T01:02:02.321603339Z [2024-06-28T01:02:02.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:01:00+00:00 exited with status success for try_number 1 2024-06-28T01:02:02.331546492Z [2024-06-28T01:02:02.331+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:01:00+00:00, map_index=-1, run_start_date=2024-06-28 01:02:01.375453+00:00, run_end_date=2024-06-28 01:02:01.867251+00:00, run_duration=0.491798, state=success, executor_state=success, try_number=1, max_tries=1, job_id=663, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:02:00.338618+00:00, queued_by_job_id=2, pid=9695 2024-06-28T01:02:02.331866923Z [2024-06-28T01:02:02.331+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:00:00+00:00, map_index=-1, run_start_date=2024-06-28 01:02:01.479664+00:00, run_end_date=2024-06-28 01:02:01.915866+00:00, run_duration=0.436202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=664, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:02:00.338618+00:00, queued_by_job_id=2, pid=9696 2024-06-28T01:02:05.077145112Z [2024-06-28T01:02:05.076+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:02:05.077734497Z [2024-06-28T01:02:05.077+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:01:00+00:00, run_id=scheduled__2024-06-28T01:01:00+00:00, run_start_date=2024-06-28 01:02:00.228684+00:00, run_end_date=2024-06-28 01:02:05.077413+00:00, run_duration=4.848729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:01:00+00:00, data_interval_end=2024-06-28 01:02:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:02:05.087239583Z [2024-06-28T01:02:05.086+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:02:00+00:00, run_after=2024-06-28T01:03:00+00:00 2024-06-28T01:02:05.093455263Z [2024-06-28T01:02:05.093+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:02:05.093934821Z [2024-06-28T01:02:05.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:01:00+00:00, run_id=scheduled__2024-06-28T01:01:00+00:00, run_start_date=2024-06-28 01:02:00.226642+00:00, run_end_date=2024-06-28 01:02:05.093634+00:00, run_duration=4.866992, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:01:00+00:00, data_interval_end=2024-06-28 01:02:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:02:05.103273198Z [2024-06-28T01:02:05.102+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:02:00+00:00, run_after=2024-06-28T01:03:00+00:00 2024-06-28T01:02:05.144671631Z [2024-06-28T01:02:05.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:01:00+00:00 exited with status success for try_number 1 2024-06-28T01:02:05.154872118Z [2024-06-28T01:02:05.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:01:00+00:00, map_index=-1, run_start_date=2024-06-28 01:02:02.680559+00:00, run_end_date=2024-06-28 01:02:04.266994+00:00, run_duration=1.586435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=666, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:02:00.338618+00:00, queued_by_job_id=2, pid=9720 2024-06-28T01:02:06.225977976Z [2024-06-28T01:02:06.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:01:00+00:00 exited with status success for try_number 1 2024-06-28T01:02:06.230953123Z [2024-06-28T01:02:06.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:01:00+00:00, map_index=-1, run_start_date=2024-06-28 01:02:02.641547+00:00, run_end_date=2024-06-28 01:02:04.979197+00:00, run_duration=2.33765, state=success, executor_state=success, try_number=1, max_tries=1, job_id=665, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:02:00.338618+00:00, queued_by_job_id=2, pid=9719 2024-06-28T01:03:00.130972908Z [2024-06-28T01:03:00.130+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:03:00+00:00, run_after=2024-06-28T01:04:00+00:00 2024-06-28T01:03:00.146624628Z [2024-06-28T01:03:00.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:03:00+00:00, run_after=2024-06-28T01:04:00+00:00 2024-06-28T01:03:00.156124646Z [2024-06-28T01:03:00.155+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:03:00.235752199Z [2024-06-28T01:03:00.235+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:03:00.235798749Z 2024-06-28T01:03:00.235813551Z 2024-06-28T01:03:00.235825136Z 2024-06-28T01:03:00.236105213Z [2024-06-28T01:03:00.235+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:03:00.236288896Z [2024-06-28T01:03:00.236+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:03:00.236469676Z [2024-06-28T01:03:00.236+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:03:00.237386827Z [2024-06-28T01:03:00.237+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:03:00.237403678Z 2024-06-28T01:03:00.237408223Z 2024-06-28T01:03:00.237412460Z 2024-06-28T01:03:00.242409654Z [2024-06-28T01:03:00.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:03:00.242596150Z [2024-06-28T01:03:00.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:03:00.242984730Z [2024-06-28T01:03:00.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:03:00.243139325Z [2024-06-28T01:03:00.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:03:00.243432930Z [2024-06-28T01:03:00.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:03:00.243590963Z [2024-06-28T01:03:00.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:03:00.552377386Z [2024-06-28T01:03:00.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:02:00+00:00 exited with status queued for try_number 1 2024-06-28T01:03:00.552650012Z [2024-06-28T01:03:00.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:02:00+00:00 exited with status queued for try_number 1 2024-06-28T01:03:00.552822796Z [2024-06-28T01:03:00.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:02:00+00:00 exited with status queued for try_number 1 2024-06-28T01:03:00.561037675Z [2024-06-28T01:03:00.560+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf06f60a-4dce-4124-bd19-33b33a7a0837 2024-06-28T01:03:00.561355638Z [2024-06-28T01:03:00.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c7d64e9-2783-4f67-9d71-1cf29375ec6c 2024-06-28T01:03:00.561565924Z [2024-06-28T01:03:00.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc756984-a1b1-46e5-aae5-8832ff30c97a 2024-06-28T01:03:01.766075766Z [2024-06-28T01:03:01.765+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:03:01.766336367Z [2024-06-28T01:03:01.766+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:02:00+00:00, run_id=scheduled__2024-06-28T01:02:00+00:00, run_start_date=2024-06-28 01:03:00.165677+00:00, run_end_date=2024-06-28 01:03:01.766010+00:00, run_duration=1.600333, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:02:00+00:00, data_interval_end=2024-06-28 01:03:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:03:01.775389420Z [2024-06-28T01:03:01.775+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:03:00+00:00, run_after=2024-06-28T01:04:00+00:00 2024-06-28T01:03:01.835406170Z [2024-06-28T01:03:01.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:02:00+00:00 exited with status success for try_number 1 2024-06-28T01:03:01.844861668Z [2024-06-28T01:03:01.844+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:02:00+00:00, map_index=-1, run_start_date=2024-06-28 01:03:01.147201+00:00, run_end_date=2024-06-28 01:03:01.596338+00:00, run_duration=0.449137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=667, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:03:00.238907+00:00, queued_by_job_id=2, pid=9752 2024-06-28T01:03:04.147559410Z [2024-06-28T01:03:04.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:03:04.147964890Z [2024-06-28T01:03:04.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:02:00+00:00, run_id=scheduled__2024-06-28T01:02:00+00:00, run_start_date=2024-06-28 01:03:00.166830+00:00, run_end_date=2024-06-28 01:03:04.147489+00:00, run_duration=3.980659, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:02:00+00:00, data_interval_end=2024-06-28 01:03:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:03:04.176050230Z [2024-06-28T01:03:04.175+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:03:00+00:00, run_after=2024-06-28T01:04:00+00:00 2024-06-28T01:03:04.198972124Z [2024-06-28T01:03:04.198+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:03:04.201021015Z [2024-06-28T01:03:04.200+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:02:00+00:00, run_id=scheduled__2024-06-28T01:02:00+00:00, run_start_date=2024-06-28 01:03:00.167857+00:00, run_end_date=2024-06-28 01:03:04.200510+00:00, run_duration=4.032653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:02:00+00:00, data_interval_end=2024-06-28 01:03:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:03:04.216508120Z [2024-06-28T01:03:04.216+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:03:00+00:00, run_after=2024-06-28T01:04:00+00:00 2024-06-28T01:03:04.251188945Z [2024-06-28T01:03:04.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:02:00+00:00 exited with status success for try_number 1 2024-06-28T01:03:04.251413858Z [2024-06-28T01:03:04.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:02:00+00:00 exited with status success for try_number 1 2024-06-28T01:03:04.257531043Z [2024-06-28T01:03:04.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:02:00+00:00, map_index=-1, run_start_date=2024-06-28 01:03:02.327596+00:00, run_end_date=2024-06-28 01:03:03.642535+00:00, run_duration=1.314939, state=success, executor_state=success, try_number=1, max_tries=1, job_id=669, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:03:00.238907+00:00, queued_by_job_id=2, pid=9771 2024-06-28T01:03:04.257823820Z [2024-06-28T01:03:04.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:02:00+00:00, map_index=-1, run_start_date=2024-06-28 01:03:02.295506+00:00, run_end_date=2024-06-28 01:03:03.986873+00:00, run_duration=1.691367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=668, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:03:00.238907+00:00, queued_by_job_id=2, pid=9770 2024-06-28T01:04:00.036239663Z [2024-06-28T01:04:00.035+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:04:00.044547832Z [2024-06-28T01:04:00.044+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:04:00.071750055Z [2024-06-28T01:04:00.071+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:04:00+00:00, run_after=2024-06-28T01:05:00+00:00 2024-06-28T01:04:00.084958128Z [2024-06-28T01:04:00.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:04:00+00:00, run_after=2024-06-28T01:05:00+00:00 2024-06-28T01:04:00.157678736Z [2024-06-28T01:04:00.157+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:04:00.157696944Z 2024-06-28T01:04:00.157701022Z 2024-06-28T01:04:00.157704313Z 2024-06-28T01:04:00.157707546Z 2024-06-28T01:04:00.157976392Z [2024-06-28T01:04:00.157+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:04:00.158137846Z [2024-06-28T01:04:00.157+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:04:00.158296971Z [2024-06-28T01:04:00.158+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:04:00.158438508Z [2024-06-28T01:04:00.158+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:04:00.159148795Z [2024-06-28T01:04:00.158+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:04:00.159157003Z 2024-06-28T01:04:00.159171636Z 2024-06-28T01:04:00.159175060Z 2024-06-28T01:04:00.159178250Z 2024-06-28T01:04:00.165771638Z [2024-06-28T01:04:00.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:04:00.165938264Z [2024-06-28T01:04:00.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:04:00.166254788Z [2024-06-28T01:04:00.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:04:00.166413508Z [2024-06-28T01:04:00.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:04:00.166615963Z [2024-06-28T01:04:00.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:04:00.166736712Z [2024-06-28T01:04:00.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:04:00.166985684Z [2024-06-28T01:04:00.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:04:00.167117449Z [2024-06-28T01:04:00.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:04:00.713413342Z [2024-06-28T01:04:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:02:00+00:00 exited with status queued for try_number 1 2024-06-28T01:04:00.713584222Z [2024-06-28T01:04:00.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:03:00+00:00 exited with status queued for try_number 1 2024-06-28T01:04:00.713693167Z [2024-06-28T01:04:00.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:03:00+00:00 exited with status queued for try_number 1 2024-06-28T01:04:00.713796546Z [2024-06-28T01:04:00.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:03:00+00:00 exited with status queued for try_number 1 2024-06-28T01:04:00.740022706Z [2024-06-28T01:04:00.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54a1fcd8-b5e0-440a-8f1b-42c37384c68e 2024-06-28T01:04:00.740566119Z [2024-06-28T01:04:00.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 216e2e02-d9cf-4943-b8c6-642533af8f80 2024-06-28T01:04:00.740842408Z [2024-06-28T01:04:00.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 464c5591-4902-4cbc-ad2c-c9f487fceb89 2024-06-28T01:04:00.741603220Z [2024-06-28T01:04:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2aced03c-8781-47cc-a832-6e2aa3bc625e 2024-06-28T01:04:03.374840926Z [2024-06-28T01:04:03.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:04:03.375471137Z [2024-06-28T01:04:03.375+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:02:00+00:00, run_id=scheduled__2024-06-28T01:02:00+00:00, run_start_date=2024-06-28 01:04:00.094911+00:00, run_end_date=2024-06-28 01:04:03.375058+00:00, run_duration=3.280147, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:02:00+00:00, data_interval_end=2024-06-28 01:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:04:03.390582863Z [2024-06-28T01:04:03.390+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:04:00+00:00, run_after=2024-06-28T01:06:00+00:00 2024-06-28T01:04:03.398021602Z [2024-06-28T01:04:03.397+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:04:03.398278374Z [2024-06-28T01:04:03.398+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:03:00+00:00, run_id=scheduled__2024-06-28T01:03:00+00:00, run_start_date=2024-06-28 01:04:00.096186+00:00, run_end_date=2024-06-28 01:04:03.398011+00:00, run_duration=3.301825, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:03:00+00:00, data_interval_end=2024-06-28 01:04:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:04:03.407592487Z [2024-06-28T01:04:03.407+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:04:00+00:00, run_after=2024-06-28T01:05:00+00:00 2024-06-28T01:04:03.463771653Z [2024-06-28T01:04:03.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:02:00+00:00 exited with status success for try_number 1 2024-06-28T01:04:03.464023869Z [2024-06-28T01:04:03.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:03:00+00:00 exited with status success for try_number 1 2024-06-28T01:04:03.470542712Z [2024-06-28T01:04:03.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:03:00+00:00, map_index=-1, run_start_date=2024-06-28 01:04:01.803760+00:00, run_end_date=2024-06-28 01:04:02.335640+00:00, run_duration=0.53188, state=success, executor_state=success, try_number=1, max_tries=1, job_id=670, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:04:00.162798+00:00, queued_by_job_id=2, pid=9804 2024-06-28T01:04:03.470795665Z [2024-06-28T01:04:03.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:02:00+00:00, map_index=-1, run_start_date=2024-06-28 01:04:01.851898+00:00, run_end_date=2024-06-28 01:04:02.332522+00:00, run_duration=0.480624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=671, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:04:00.162798+00:00, queued_by_job_id=2, pid=9806 2024-06-28T01:04:04.580460338Z [2024-06-28T01:04:04.580+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:04:04.580608201Z [2024-06-28T01:04:04.580+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:03:00+00:00, run_id=scheduled__2024-06-28T01:03:00+00:00, run_start_date=2024-06-28 01:04:00.098007+00:00, run_end_date=2024-06-28 01:04:04.580373+00:00, run_duration=4.482366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:03:00+00:00, data_interval_end=2024-06-28 01:04:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:04:04.605549883Z [2024-06-28T01:04:04.603+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:04:00+00:00, run_after=2024-06-28T01:05:00+00:00 2024-06-28T01:04:04.690942720Z [2024-06-28T01:04:04.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:03:00+00:00 exited with status success for try_number 1 2024-06-28T01:04:04.697394433Z [2024-06-28T01:04:04.697+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:03:00+00:00, map_index=-1, run_start_date=2024-06-28 01:04:02.805861+00:00, run_end_date=2024-06-28 01:04:04.385677+00:00, run_duration=1.579816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=672, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:04:00.162798+00:00, queued_by_job_id=2, pid=9822 2024-06-28T01:04:04.868100669Z [2024-06-28T01:04:04.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:04:04.868580973Z [2024-06-28T01:04:04.868+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:03:00+00:00, run_id=scheduled__2024-06-28T01:03:00+00:00, run_start_date=2024-06-28 01:04:00.097123+00:00, run_end_date=2024-06-28 01:04:04.868253+00:00, run_duration=4.77113, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:03:00+00:00, data_interval_end=2024-06-28 01:04:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:04:04.878967892Z [2024-06-28T01:04:04.878+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:04:00+00:00, run_after=2024-06-28T01:05:00+00:00 2024-06-28T01:04:04.919477355Z [2024-06-28T01:04:04.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:03:00+00:00 exited with status success for try_number 1 2024-06-28T01:04:04.930788370Z [2024-06-28T01:04:04.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:03:00+00:00, map_index=-1, run_start_date=2024-06-28 01:04:03.084058+00:00, run_end_date=2024-06-28 01:04:04.588557+00:00, run_duration=1.504499, state=success, executor_state=success, try_number=1, max_tries=1, job_id=673, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:04:00.162798+00:00, queued_by_job_id=2, pid=9828 2024-06-28T01:05:00.911539235Z [2024-06-28T01:05:00.910+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:05:00+00:00, run_after=2024-06-28T01:06:00+00:00 2024-06-28T01:05:00.927719841Z [2024-06-28T01:05:00.927+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:05:00+00:00, run_after=2024-06-28T01:10:00+00:00 2024-06-28T01:05:00.940479356Z [2024-06-28T01:05:00.940+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:05:00+00:00, run_after=2024-06-28T01:06:00+00:00 2024-06-28T01:05:00.949279723Z [2024-06-28T01:05:00.949+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:05:01.093247982Z [2024-06-28T01:05:01.092+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:05:01.093283399Z 2024-06-28T01:05:01.093436551Z 2024-06-28T01:05:01.093443927Z 2024-06-28T01:05:01.093450593Z 2024-06-28T01:05:01.093470127Z [2024-06-28T01:05:01.093+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:05:01.093574831Z [2024-06-28T01:05:01.093+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:05:01.093643264Z [2024-06-28T01:05:01.093+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:05:01.093683908Z [2024-06-28T01:05:01.093+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:05:01.094613412Z [2024-06-28T01:05:01.094+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:05:01.094636558Z 2024-06-28T01:05:01.094661941Z 2024-06-28T01:05:01.094668201Z 2024-06-28T01:05:01.094674003Z 2024-06-28T01:05:01.098717798Z [2024-06-28T01:05:01.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T01:05:01.098902697Z [2024-06-28T01:05:01.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:05:01.099141831Z [2024-06-28T01:05:01.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:05:01.099220121Z [2024-06-28T01:05:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:05:01.099503744Z [2024-06-28T01:05:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:05:01.099588874Z [2024-06-28T01:05:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:05:01.099803388Z [2024-06-28T01:05:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:05:01.099931744Z [2024-06-28T01:05:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:05:01.503703772Z [2024-06-28T01:05:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:00:00+00:00 exited with status queued for try_number 1 2024-06-28T01:05:01.503751670Z [2024-06-28T01:05:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:04:00+00:00 exited with status queued for try_number 1 2024-06-28T01:05:01.503801685Z [2024-06-28T01:05:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:04:00+00:00 exited with status queued for try_number 1 2024-06-28T01:05:01.503940673Z [2024-06-28T01:05:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:04:00+00:00 exited with status queued for try_number 1 2024-06-28T01:05:01.519034850Z [2024-06-28T01:05:01.517+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4bb2760-079d-46f5-a7f1-af0a7cd532bc 2024-06-28T01:05:01.519213582Z [2024-06-28T01:05:01.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to dcaf3fba-3bb2-4dde-8ae2-8315534cd3a3 2024-06-28T01:05:01.519479017Z [2024-06-28T01:05:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7f8bb7d-9d1f-4bae-9db7-60b7463a59c4 2024-06-28T01:05:01.519592824Z [2024-06-28T01:05:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d36d295-c8a2-4dcd-956e-523b2f99d2ec 2024-06-28T01:05:03.751379147Z [2024-06-28T01:05:03.744+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:05:03.752132715Z [2024-06-28T01:05:03.751+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:04:00+00:00, run_id=scheduled__2024-06-28T01:04:00+00:00, run_start_date=2024-06-28 01:05:00.980706+00:00, run_end_date=2024-06-28 01:05:03.751690+00:00, run_duration=2.770984, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:04:00+00:00, data_interval_end=2024-06-28 01:05:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:05:03.764133442Z [2024-06-28T01:05:03.763+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:05:00+00:00, run_after=2024-06-28T01:06:00+00:00 2024-06-28T01:05:03.974305084Z [2024-06-28T01:05:03.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:04:00+00:00 exited with status success for try_number 1 2024-06-28T01:05:03.988570143Z [2024-06-28T01:05:03.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:04:00+00:00, map_index=-1, run_start_date=2024-06-28 01:05:02.236280+00:00, run_end_date=2024-06-28 01:05:02.871700+00:00, run_duration=0.63542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=674, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:05:01.095533+00:00, queued_by_job_id=2, pid=9861 2024-06-28T01:05:05.130844638Z [2024-06-28T01:05:05.130+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:05:05.131498550Z [2024-06-28T01:05:05.130+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:04:00+00:00, run_id=scheduled__2024-06-28T01:04:00+00:00, run_start_date=2024-06-28 01:05:00.983117+00:00, run_end_date=2024-06-28 01:05:05.130785+00:00, run_duration=4.147668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:04:00+00:00, data_interval_end=2024-06-28 01:05:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:05:05.156432341Z [2024-06-28T01:05:05.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:05:00+00:00, run_after=2024-06-28T01:06:00+00:00 2024-06-28T01:05:05.201582393Z [2024-06-28T01:05:05.201+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:05:05.201600968Z 2024-06-28T01:05:05.201746948Z [2024-06-28T01:05:05.201+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:05:05.202836291Z [2024-06-28T01:05:05.202+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:05:05.202847171Z 2024-06-28T01:05:05.205666328Z [2024-06-28T01:05:05.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T01:05:05.205818480Z [2024-06-28T01:05:05.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:05:05.353221993Z [2024-06-28T01:05:05.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:00:00+00:00 exited with status queued for try_number 1 2024-06-28T01:05:05.355141618Z [2024-06-28T01:05:05.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:00:00+00:00 exited with status success for try_number 1 2024-06-28T01:05:05.364999321Z [2024-06-28T01:05:05.364+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3464aa06-ccd7-4011-8391-7562c6d8bf9a 2024-06-28T01:05:05.369611395Z [2024-06-28T01:05:05.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T01:00:00+00:00, map_index=-1, run_start_date=2024-06-28 01:05:03.935995+00:00, run_end_date=2024-06-28 01:05:04.692960+00:00, run_duration=0.756965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=677, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:05:01.095533+00:00, queued_by_job_id=2, pid=9892 2024-06-28T01:05:05.683066571Z [2024-06-28T01:05:05.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:04:00+00:00 exited with status success for try_number 1 2024-06-28T01:05:05.706785955Z [2024-06-28T01:05:05.706+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:04:00+00:00, map_index=-1, run_start_date=2024-06-28 01:05:03.394955+00:00, run_end_date=2024-06-28 01:05:05.001828+00:00, run_duration=1.606873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=675, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:05:01.095533+00:00, queued_by_job_id=2, pid=9875 2024-06-28T01:05:06.754181733Z [2024-06-28T01:05:06.753+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:05:06.754418641Z [2024-06-28T01:05:06.754+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:04:00+00:00, run_id=scheduled__2024-06-28T01:04:00+00:00, run_start_date=2024-06-28 01:05:00.984803+00:00, run_end_date=2024-06-28 01:05:06.754081+00:00, run_duration=5.769278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:04:00+00:00, data_interval_end=2024-06-28 01:05:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:05:06.772653456Z [2024-06-28T01:05:06.772+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:05:00+00:00, run_after=2024-06-28T01:06:00+00:00 2024-06-28T01:05:06.849191727Z [2024-06-28T01:05:06.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:04:00+00:00 exited with status success for try_number 1 2024-06-28T01:05:06.853788132Z [2024-06-28T01:05:06.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:04:00+00:00, map_index=-1, run_start_date=2024-06-28 01:05:03.653621+00:00, run_end_date=2024-06-28 01:05:05.919184+00:00, run_duration=2.265563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=676, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:05:01.095533+00:00, queued_by_job_id=2, pid=9891 2024-06-28T01:05:09.076808691Z [2024-06-28T01:05:09.076+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:05:09.076827621Z 2024-06-28T01:05:09.077691638Z [2024-06-28T01:05:09.077+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:05:09.079619472Z [2024-06-28T01:05:09.079+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:05:09.079630648Z 2024-06-28T01:05:09.084877243Z [2024-06-28T01:05:09.084+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T01:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T01:05:09.085413488Z [2024-06-28T01:05:09.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T01:05:09.135416171Z [2024-06-28T01:05:09.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:00:00+00:00 exited with status queued for try_number 1 2024-06-28T01:05:09.135441887Z [2024-06-28T01:05:09.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:00:00+00:00 exited with status success for try_number 1 2024-06-28T01:05:09.140491904Z [2024-06-28T01:05:09.140+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e80685b-d108-48c7-ace6-d892b11430d3 2024-06-28T01:05:09.140631787Z [2024-06-28T01:05:09.140+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T01:00:00+00:00, map_index=-1, run_start_date=2024-06-28 01:05:07.602820+00:00, run_end_date=2024-06-28 01:05:08.206050+00:00, run_duration=0.60323, state=success, executor_state=success, try_number=1, max_tries=1, job_id=678, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:05:05.203130+00:00, queued_by_job_id=2, pid=9910 2024-06-28T01:05:11.568590018Z [2024-06-28T01:05:11.567+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:05:11.568611686Z 2024-06-28T01:05:11.568989290Z [2024-06-28T01:05:11.568+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:05:11.569864309Z [2024-06-28T01:05:11.569+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:05:11.569880595Z 2024-06-28T01:05:11.576216429Z [2024-06-28T01:05:11.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:05:11.577368061Z [2024-06-28T01:05:11.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:05:11.657369801Z [2024-06-28T01:05:11.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:00:00+00:00 exited with status queued for try_number 1 2024-06-28T01:05:11.657474107Z [2024-06-28T01:05:11.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:00:00+00:00 exited with status success for try_number 1 2024-06-28T01:05:11.671683897Z [2024-06-28T01:05:11.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15551cae-ecdd-494f-a59a-65e67e941c05 2024-06-28T01:05:11.672009997Z [2024-06-28T01:05:11.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T01:00:00+00:00, map_index=0, run_start_date=2024-06-28 01:05:10.906919+00:00, run_end_date=2024-06-28 01:05:11.252527+00:00, run_duration=0.345608, state=success, executor_state=success, try_number=1, max_tries=1, job_id=679, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:05:09.080428+00:00, queued_by_job_id=2, pid=9918 2024-06-28T01:05:14.185453887Z [2024-06-28T01:05:14.185+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:05:14.185756840Z [2024-06-28T01:05:14.185+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:00:00+00:00, run_id=scheduled__2024-06-28T01:00:00+00:00, run_start_date=2024-06-28 01:05:00.978256+00:00, run_end_date=2024-06-28 01:05:14.185376+00:00, run_duration=13.20712, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:00:00+00:00, data_interval_end=2024-06-28 01:05:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T01:05:14.195675217Z [2024-06-28T01:05:14.192+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:05:00+00:00, run_after=2024-06-28T01:10:00+00:00 2024-06-28T01:05:14.223486745Z [2024-06-28T01:05:14.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:00:00+00:00 exited with status success for try_number 1 2024-06-28T01:05:14.230150069Z [2024-06-28T01:05:14.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T01:00:00+00:00, map_index=-1, run_start_date=2024-06-28 01:05:13.465635+00:00, run_end_date=2024-06-28 01:05:13.865580+00:00, run_duration=0.399945, state=success, executor_state=success, try_number=1, max_tries=1, job_id=680, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:05:11.570740+00:00, queued_by_job_id=2, pid=9926 2024-06-28T01:06:00.811972536Z [2024-06-28T01:06:00.811+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:06:00.819121034Z [2024-06-28T01:06:00.818+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:06:00.832330027Z [2024-06-28T01:06:00.831+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:06:00+00:00, run_after=2024-06-28T01:07:00+00:00 2024-06-28T01:06:00.850259781Z [2024-06-28T01:06:00.850+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:06:00+00:00, run_after=2024-06-28T01:07:00+00:00 2024-06-28T01:06:00.958761313Z [2024-06-28T01:06:00.958+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:06:00.958788795Z 2024-06-28T01:06:00.958811024Z 2024-06-28T01:06:00.958815470Z 2024-06-28T01:06:00.958819630Z 2024-06-28T01:06:00.959122412Z [2024-06-28T01:06:00.958+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:06:00.959385024Z [2024-06-28T01:06:00.959+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:06:00.959887111Z [2024-06-28T01:06:00.959+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:06:00.960078661Z [2024-06-28T01:06:00.959+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:06:00.961008360Z [2024-06-28T01:06:00.960+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:06:00.961020380Z 2024-06-28T01:06:00.961024466Z 2024-06-28T01:06:00.961027933Z 2024-06-28T01:06:00.961031036Z 2024-06-28T01:06:00.967070857Z [2024-06-28T01:06:00.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:06:00.967535504Z [2024-06-28T01:06:00.967+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:06:00.968066654Z [2024-06-28T01:06:00.967+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:06:00.968260838Z [2024-06-28T01:06:00.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:06:00.968584178Z [2024-06-28T01:06:00.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:06:00.968878381Z [2024-06-28T01:06:00.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:06:00.969299814Z [2024-06-28T01:06:00.969+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:06:00.969571725Z [2024-06-28T01:06:00.969+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:06:01.546580899Z [2024-06-28T01:06:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:04:00+00:00 exited with status queued for try_number 1 2024-06-28T01:06:01.547099538Z [2024-06-28T01:06:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:05:00+00:00 exited with status queued for try_number 1 2024-06-28T01:06:01.547392919Z [2024-06-28T01:06:01.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:05:00+00:00 exited with status queued for try_number 1 2024-06-28T01:06:01.550918500Z [2024-06-28T01:06:01.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:05:00+00:00 exited with status queued for try_number 1 2024-06-28T01:06:01.566568235Z [2024-06-28T01:06:01.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f2f4928-30c9-4a62-b09c-a7ffdc6a7988 2024-06-28T01:06:01.567176638Z [2024-06-28T01:06:01.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to 764db840-e521-4dbe-9e64-c34acc7a283b 2024-06-28T01:06:01.567386904Z [2024-06-28T01:06:01.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb57e993-2fe3-421a-a117-6221f8056caf 2024-06-28T01:06:01.567741392Z [2024-06-28T01:06:01.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed5814bb-bf62-4f98-8bb0-5a42ce3a864f 2024-06-28T01:06:02.722837869Z [2024-06-28T01:06:02.722+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:06:02.723240184Z [2024-06-28T01:06:02.723+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:04:00+00:00, run_id=scheduled__2024-06-28T01:04:00+00:00, run_start_date=2024-06-28 01:06:00.860742+00:00, run_end_date=2024-06-28 01:06:02.722850+00:00, run_duration=1.862108, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:04:00+00:00, data_interval_end=2024-06-28 01:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:06:02.733075986Z [2024-06-28T01:06:02.732+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:06:00+00:00, run_after=2024-06-28T01:08:00+00:00 2024-06-28T01:06:02.742055567Z [2024-06-28T01:06:02.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:06:02.742729111Z [2024-06-28T01:06:02.742+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:05:00+00:00, run_id=scheduled__2024-06-28T01:05:00+00:00, run_start_date=2024-06-28 01:06:00.861954+00:00, run_end_date=2024-06-28 01:06:02.742370+00:00, run_duration=1.880416, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:05:00+00:00, data_interval_end=2024-06-28 01:06:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:06:02.754364346Z [2024-06-28T01:06:02.754+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:06:00+00:00, run_after=2024-06-28T01:07:00+00:00 2024-06-28T01:06:02.834222716Z [2024-06-28T01:06:02.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:04:00+00:00 exited with status success for try_number 1 2024-06-28T01:06:02.834404982Z [2024-06-28T01:06:02.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:05:00+00:00 exited with status success for try_number 1 2024-06-28T01:06:02.858362231Z [2024-06-28T01:06:02.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:04:00+00:00, map_index=-1, run_start_date=2024-06-28 01:06:02.015454+00:00, run_end_date=2024-06-28 01:06:02.522119+00:00, run_duration=0.506665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=681, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:06:00.962145+00:00, queued_by_job_id=2, pid=9949 2024-06-28T01:06:02.859043483Z [2024-06-28T01:06:02.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:05:00+00:00, map_index=-1, run_start_date=2024-06-28 01:06:02.018547+00:00, run_end_date=2024-06-28 01:06:02.552660+00:00, run_duration=0.534113, state=success, executor_state=success, try_number=1, max_tries=1, job_id=682, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:06:00.962145+00:00, queued_by_job_id=2, pid=9950 2024-06-28T01:06:05.387687528Z [2024-06-28T01:06:05.387+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:06:05.387964190Z [2024-06-28T01:06:05.387+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:05:00+00:00, run_id=scheduled__2024-06-28T01:05:00+00:00, run_start_date=2024-06-28 01:06:00.863007+00:00, run_end_date=2024-06-28 01:06:05.387711+00:00, run_duration=4.524704, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:05:00+00:00, data_interval_end=2024-06-28 01:06:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:06:05.397039271Z [2024-06-28T01:06:05.396+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:06:00+00:00, run_after=2024-06-28T01:07:00+00:00 2024-06-28T01:06:05.441332179Z [2024-06-28T01:06:05.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:05:00+00:00 exited with status success for try_number 1 2024-06-28T01:06:05.462906861Z [2024-06-28T01:06:05.462+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:05:00+00:00, map_index=-1, run_start_date=2024-06-28 01:06:03.351323+00:00, run_end_date=2024-06-28 01:06:05.199265+00:00, run_duration=1.847942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=683, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:06:00.962145+00:00, queued_by_job_id=2, pid=9973 2024-06-28T01:06:05.801129505Z [2024-06-28T01:06:05.800+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:06:05.801841875Z [2024-06-28T01:06:05.801+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:05:00+00:00, run_id=scheduled__2024-06-28T01:05:00+00:00, run_start_date=2024-06-28 01:06:00.863997+00:00, run_end_date=2024-06-28 01:06:05.801050+00:00, run_duration=4.937053, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:05:00+00:00, data_interval_end=2024-06-28 01:06:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:06:05.823856183Z [2024-06-28T01:06:05.822+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:06:00+00:00, run_after=2024-06-28T01:07:00+00:00 2024-06-28T01:06:05.882345118Z [2024-06-28T01:06:05.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:05:00+00:00 exited with status success for try_number 1 2024-06-28T01:06:05.891795805Z [2024-06-28T01:06:05.891+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:05:00+00:00, map_index=-1, run_start_date=2024-06-28 01:06:03.399597+00:00, run_end_date=2024-06-28 01:06:05.567914+00:00, run_duration=2.168317, state=success, executor_state=success, try_number=1, max_tries=1, job_id=684, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:06:00.962145+00:00, queued_by_job_id=2, pid=9974 2024-06-28T01:06:46.139970461Z [2024-06-28T01:06:46.139+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T01:07:00.855869781Z [2024-06-28T01:07:00.855+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:07:00+00:00, run_after=2024-06-28T01:08:00+00:00 2024-06-28T01:07:00.866096606Z [2024-06-28T01:07:00.865+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:07:00.879484433Z [2024-06-28T01:07:00.879+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:07:00+00:00, run_after=2024-06-28T01:08:00+00:00 2024-06-28T01:07:00.974149840Z [2024-06-28T01:07:00.973+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:07:00.974163749Z 2024-06-28T01:07:00.974180963Z 2024-06-28T01:07:00.974184260Z 2024-06-28T01:07:00.974559743Z [2024-06-28T01:07:00.974+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:07:00.974908463Z [2024-06-28T01:07:00.974+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:07:00.975152431Z [2024-06-28T01:07:00.974+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:07:00.977553307Z [2024-06-28T01:07:00.976+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:07:00.977568541Z 2024-06-28T01:07:00.977572082Z 2024-06-28T01:07:00.977575226Z 2024-06-28T01:07:00.982562966Z [2024-06-28T01:07:00.982+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:07:00.982836734Z [2024-06-28T01:07:00.982+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:07:00.983280467Z [2024-06-28T01:07:00.983+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:07:00.983724769Z [2024-06-28T01:07:00.983+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:07:00.984011777Z [2024-06-28T01:07:00.983+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:07:00.984088626Z [2024-06-28T01:07:00.983+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:07:01.297618512Z [2024-06-28T01:07:01.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:06:00+00:00 exited with status queued for try_number 1 2024-06-28T01:07:01.297805646Z [2024-06-28T01:07:01.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:06:00+00:00 exited with status queued for try_number 1 2024-06-28T01:07:01.297922409Z [2024-06-28T01:07:01.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:06:00+00:00 exited with status queued for try_number 1 2024-06-28T01:07:01.307779258Z [2024-06-28T01:07:01.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to c08b3c0f-99b6-4794-8aeb-ad15fc53b78f 2024-06-28T01:07:01.307916507Z [2024-06-28T01:07:01.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to e78cbb24-f277-4e20-8dfa-9a73082d5a65 2024-06-28T01:07:01.308037593Z [2024-06-28T01:07:01.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ebee49f-0f3c-4904-8d9c-c1ac625b4ce3 2024-06-28T01:07:02.481126220Z [2024-06-28T01:07:02.480+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:07:02.481522503Z [2024-06-28T01:07:02.481+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:06:00+00:00, run_id=scheduled__2024-06-28T01:06:00+00:00, run_start_date=2024-06-28 01:07:00.894785+00:00, run_end_date=2024-06-28 01:07:02.481177+00:00, run_duration=1.586392, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:06:00+00:00, data_interval_end=2024-06-28 01:07:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:07:02.491826463Z [2024-06-28T01:07:02.491+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:07:00+00:00, run_after=2024-06-28T01:08:00+00:00 2024-06-28T01:07:02.541357121Z [2024-06-28T01:07:02.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:06:00+00:00 exited with status success for try_number 1 2024-06-28T01:07:02.546042111Z [2024-06-28T01:07:02.545+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:06:00+00:00, map_index=-1, run_start_date=2024-06-28 01:07:01.939664+00:00, run_end_date=2024-06-28 01:07:02.349706+00:00, run_duration=0.410042, state=success, executor_state=success, try_number=1, max_tries=1, job_id=685, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:07:00.978736+00:00, queued_by_job_id=2, pid=10006 2024-06-28T01:07:05.722399203Z [2024-06-28T01:07:05.721+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:07:05.724016719Z [2024-06-28T01:07:05.723+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:06:00+00:00, run_id=scheduled__2024-06-28T01:06:00+00:00, run_start_date=2024-06-28 01:07:00.896662+00:00, run_end_date=2024-06-28 01:07:05.722260+00:00, run_duration=4.825598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:06:00+00:00, data_interval_end=2024-06-28 01:07:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:07:05.733557244Z [2024-06-28T01:07:05.733+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:07:00+00:00, run_after=2024-06-28T01:08:00+00:00 2024-06-28T01:07:05.740337297Z [2024-06-28T01:07:05.740+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:07:05.740670140Z [2024-06-28T01:07:05.740+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:06:00+00:00, run_id=scheduled__2024-06-28T01:06:00+00:00, run_start_date=2024-06-28 01:07:00.897828+00:00, run_end_date=2024-06-28 01:07:05.740322+00:00, run_duration=4.842494, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:06:00+00:00, data_interval_end=2024-06-28 01:07:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:07:05.755439229Z [2024-06-28T01:07:05.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:07:00+00:00, run_after=2024-06-28T01:08:00+00:00 2024-06-28T01:07:05.795050387Z [2024-06-28T01:07:05.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:06:00+00:00 exited with status success for try_number 1 2024-06-28T01:07:05.795168607Z [2024-06-28T01:07:05.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:06:00+00:00 exited with status success for try_number 1 2024-06-28T01:07:05.806809269Z [2024-06-28T01:07:05.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:06:00+00:00, map_index=-1, run_start_date=2024-06-28 01:07:02.992088+00:00, run_end_date=2024-06-28 01:07:04.700377+00:00, run_duration=1.708289, state=success, executor_state=success, try_number=1, max_tries=1, job_id=687, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:07:00.978736+00:00, queued_by_job_id=2, pid=10025 2024-06-28T01:07:05.807084902Z [2024-06-28T01:07:05.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:06:00+00:00, map_index=-1, run_start_date=2024-06-28 01:07:02.867276+00:00, run_end_date=2024-06-28 01:07:05.114332+00:00, run_duration=2.247056, state=success, executor_state=success, try_number=1, max_tries=1, job_id=686, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:07:00.978736+00:00, queued_by_job_id=2, pid=10024 2024-06-28T01:08:00.712566974Z [2024-06-28T01:08:00.712+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:08:00.723438663Z [2024-06-28T01:08:00.723+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:08:00.739136300Z [2024-06-28T01:08:00.738+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:08:00+00:00, run_after=2024-06-28T01:09:00+00:00 2024-06-28T01:08:00.757066794Z [2024-06-28T01:08:00.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:08:00+00:00, run_after=2024-06-28T01:09:00+00:00 2024-06-28T01:08:00.862204594Z [2024-06-28T01:08:00.853+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:08:00.862234748Z 2024-06-28T01:08:00.862239043Z 2024-06-28T01:08:00.862242863Z 2024-06-28T01:08:00.862246072Z 2024-06-28T01:08:00.862250037Z [2024-06-28T01:08:00.853+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:08:00.862252988Z [2024-06-28T01:08:00.853+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:08:00.862255796Z [2024-06-28T01:08:00.853+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:08:00.862265125Z [2024-06-28T01:08:00.853+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:08:00.862268153Z [2024-06-28T01:08:00.854+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:08:00.862271527Z 2024-06-28T01:08:00.862274650Z 2024-06-28T01:08:00.862277751Z 2024-06-28T01:08:00.862280877Z 2024-06-28T01:08:00.868603923Z [2024-06-28T01:08:00.868+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:08:00.868951761Z [2024-06-28T01:08:00.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:08:00.869405117Z [2024-06-28T01:08:00.869+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:08:00.869640500Z [2024-06-28T01:08:00.869+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:08:00.870042895Z [2024-06-28T01:08:00.869+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:08:00.870259108Z [2024-06-28T01:08:00.870+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:08:00.870642010Z [2024-06-28T01:08:00.870+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:08:00.870913677Z [2024-06-28T01:08:00.870+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:08:01.392483940Z [2024-06-28T01:08:01.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:06:00+00:00 exited with status queued for try_number 1 2024-06-28T01:08:01.393997475Z [2024-06-28T01:08:01.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:07:00+00:00 exited with status queued for try_number 1 2024-06-28T01:08:01.394123596Z [2024-06-28T01:08:01.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:07:00+00:00 exited with status queued for try_number 1 2024-06-28T01:08:01.394241914Z [2024-06-28T01:08:01.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:07:00+00:00 exited with status queued for try_number 1 2024-06-28T01:08:01.420122048Z [2024-06-28T01:08:01.419+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07d9006d-1fae-46b6-b455-26f1d40dff20 2024-06-28T01:08:01.420329958Z [2024-06-28T01:08:01.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c76b139-ff0f-4e7d-b883-6472b04ea8b1 2024-06-28T01:08:01.420505308Z [2024-06-28T01:08:01.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3172518-f957-4215-93e9-bff00f3b42fb 2024-06-28T01:08:01.420677362Z [2024-06-28T01:08:01.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to d57e764e-63fa-45a6-a28b-770fbd1957be 2024-06-28T01:08:02.720033867Z [2024-06-28T01:08:02.719+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:08:02.720440383Z [2024-06-28T01:08:02.720+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:06:00+00:00, run_id=scheduled__2024-06-28T01:06:00+00:00, run_start_date=2024-06-28 01:08:00.768388+00:00, run_end_date=2024-06-28 01:08:02.720047+00:00, run_duration=1.951659, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:06:00+00:00, data_interval_end=2024-06-28 01:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:08:02.731553336Z [2024-06-28T01:08:02.730+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:08:00+00:00, run_after=2024-06-28T01:10:00+00:00 2024-06-28T01:08:02.740468098Z [2024-06-28T01:08:02.740+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:08:02.741054644Z [2024-06-28T01:08:02.740+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:07:00+00:00, run_id=scheduled__2024-06-28T01:07:00+00:00, run_start_date=2024-06-28 01:08:00.769779+00:00, run_end_date=2024-06-28 01:08:02.740711+00:00, run_duration=1.970932, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:07:00+00:00, data_interval_end=2024-06-28 01:08:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:08:02.761095978Z [2024-06-28T01:08:02.760+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:08:00+00:00, run_after=2024-06-28T01:09:00+00:00 2024-06-28T01:08:02.823511131Z [2024-06-28T01:08:02.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:06:00+00:00 exited with status success for try_number 1 2024-06-28T01:08:02.823909107Z [2024-06-28T01:08:02.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:07:00+00:00 exited with status success for try_number 1 2024-06-28T01:08:02.834444029Z [2024-06-28T01:08:02.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:07:00+00:00, map_index=-1, run_start_date=2024-06-28 01:08:02.115635+00:00, run_end_date=2024-06-28 01:08:02.578716+00:00, run_duration=0.463081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=688, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:08:00.863667+00:00, queued_by_job_id=2, pid=10059 2024-06-28T01:08:02.835068003Z [2024-06-28T01:08:02.834+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:06:00+00:00, map_index=-1, run_start_date=2024-06-28 01:08:02.230184+00:00, run_end_date=2024-06-28 01:08:02.582630+00:00, run_duration=0.352446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=689, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:08:00.863667+00:00, queued_by_job_id=2, pid=10060 2024-06-28T01:08:06.067203818Z [2024-06-28T01:08:06.066+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:08:06.067425245Z [2024-06-28T01:08:06.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:07:00+00:00, run_id=scheduled__2024-06-28T01:07:00+00:00, run_start_date=2024-06-28 01:08:00.770962+00:00, run_end_date=2024-06-28 01:08:06.067108+00:00, run_duration=5.296146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:07:00+00:00, data_interval_end=2024-06-28 01:08:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:08:06.077082728Z [2024-06-28T01:08:06.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:08:00+00:00, run_after=2024-06-28T01:09:00+00:00 2024-06-28T01:08:06.088719883Z [2024-06-28T01:08:06.088+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:08:06.089136190Z [2024-06-28T01:08:06.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:07:00+00:00, run_id=scheduled__2024-06-28T01:07:00+00:00, run_start_date=2024-06-28 01:08:00.771947+00:00, run_end_date=2024-06-28 01:08:06.088720+00:00, run_duration=5.316773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:07:00+00:00, data_interval_end=2024-06-28 01:08:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:08:06.105475168Z [2024-06-28T01:08:06.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:08:00+00:00, run_after=2024-06-28T01:09:00+00:00 2024-06-28T01:08:06.142829086Z [2024-06-28T01:08:06.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:07:00+00:00 exited with status success for try_number 1 2024-06-28T01:08:06.142928504Z [2024-06-28T01:08:06.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:07:00+00:00 exited with status success for try_number 1 2024-06-28T01:08:06.149337801Z [2024-06-28T01:08:06.149+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:07:00+00:00, map_index=-1, run_start_date=2024-06-28 01:08:03.425497+00:00, run_end_date=2024-06-28 01:08:05.376453+00:00, run_duration=1.950956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=691, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:08:00.863667+00:00, queued_by_job_id=2, pid=10084 2024-06-28T01:08:06.149607306Z [2024-06-28T01:08:06.149+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:07:00+00:00, map_index=-1, run_start_date=2024-06-28 01:08:03.396860+00:00, run_end_date=2024-06-28 01:08:05.765239+00:00, run_duration=2.368379, state=success, executor_state=success, try_number=1, max_tries=1, job_id=690, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:08:00.863667+00:00, queued_by_job_id=2, pid=10083 2024-06-28T01:09:00.143480838Z [2024-06-28T01:09:00.143+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:09:00+00:00, run_after=2024-06-28T01:10:00+00:00 2024-06-28T01:09:00.155965934Z [2024-06-28T01:09:00.155+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:09:00.180968536Z [2024-06-28T01:09:00.180+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:09:00+00:00, run_after=2024-06-28T01:10:00+00:00 2024-06-28T01:09:00.270345486Z [2024-06-28T01:09:00.269+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:09:00.270374857Z 2024-06-28T01:09:00.270378766Z 2024-06-28T01:09:00.270381949Z 2024-06-28T01:09:00.270630795Z [2024-06-28T01:09:00.270+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:09:00.270948631Z [2024-06-28T01:09:00.270+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:09:00.271394158Z [2024-06-28T01:09:00.271+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:09:00.272500788Z [2024-06-28T01:09:00.272+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:09:00.272512177Z 2024-06-28T01:09:00.272515933Z 2024-06-28T01:09:00.272519352Z 2024-06-28T01:09:00.277954559Z [2024-06-28T01:09:00.277+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:09:00.278807421Z [2024-06-28T01:09:00.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:09:00.279292875Z [2024-06-28T01:09:00.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:09:00.279683489Z [2024-06-28T01:09:00.279+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:09:00.280133215Z [2024-06-28T01:09:00.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:09:00.280411396Z [2024-06-28T01:09:00.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:09:00.555296101Z [2024-06-28T01:09:00.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:08:00+00:00 exited with status queued for try_number 1 2024-06-28T01:09:00.555450219Z [2024-06-28T01:09:00.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:08:00+00:00 exited with status queued for try_number 1 2024-06-28T01:09:00.555630990Z [2024-06-28T01:09:00.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:08:00+00:00 exited with status queued for try_number 1 2024-06-28T01:09:00.576524647Z [2024-06-28T01:09:00.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e02e4bc-a47a-4ca1-9f3f-16598a4db3a0 2024-06-28T01:09:00.576758513Z [2024-06-28T01:09:00.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5a45707-0b85-49ac-b95e-17890e8fd6da 2024-06-28T01:09:00.577004256Z [2024-06-28T01:09:00.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49626319-096c-4c6c-ae95-37ef1f700ae7 2024-06-28T01:09:03.039801127Z [2024-06-28T01:09:03.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:09:03.040113563Z [2024-06-28T01:09:03.039+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:08:00+00:00, run_id=scheduled__2024-06-28T01:08:00+00:00, run_start_date=2024-06-28 01:09:00.202152+00:00, run_end_date=2024-06-28 01:09:03.039723+00:00, run_duration=2.837571, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:08:00+00:00, data_interval_end=2024-06-28 01:09:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:09:03.062436115Z [2024-06-28T01:09:03.062+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:09:00+00:00, run_after=2024-06-28T01:10:00+00:00 2024-06-28T01:09:03.165481672Z [2024-06-28T01:09:03.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:08:00+00:00 exited with status success for try_number 1 2024-06-28T01:09:03.170857507Z [2024-06-28T01:09:03.170+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:08:00+00:00, map_index=-1, run_start_date=2024-06-28 01:09:01.335988+00:00, run_end_date=2024-06-28 01:09:01.985375+00:00, run_duration=0.649387, state=success, executor_state=success, try_number=1, max_tries=1, job_id=692, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:09:00.273680+00:00, queued_by_job_id=2, pid=10116 2024-06-28T01:09:05.291424357Z [2024-06-28T01:09:05.290+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:09:05.291753794Z [2024-06-28T01:09:05.291+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:08:00+00:00, run_id=scheduled__2024-06-28T01:08:00+00:00, run_start_date=2024-06-28 01:09:00.203604+00:00, run_end_date=2024-06-28 01:09:05.291401+00:00, run_duration=5.087797, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:08:00+00:00, data_interval_end=2024-06-28 01:09:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:09:05.301719071Z [2024-06-28T01:09:05.301+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:09:00+00:00, run_after=2024-06-28T01:10:00+00:00 2024-06-28T01:09:05.307492499Z [2024-06-28T01:09:05.307+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:09:05.307903561Z [2024-06-28T01:09:05.307+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:08:00+00:00, run_id=scheduled__2024-06-28T01:08:00+00:00, run_start_date=2024-06-28 01:09:00.205077+00:00, run_end_date=2024-06-28 01:09:05.307421+00:00, run_duration=5.102344, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:08:00+00:00, data_interval_end=2024-06-28 01:09:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:09:05.316328373Z [2024-06-28T01:09:05.316+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:09:00+00:00, run_after=2024-06-28T01:10:00+00:00 2024-06-28T01:09:05.352151152Z [2024-06-28T01:09:05.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:08:00+00:00 exited with status success for try_number 1 2024-06-28T01:09:05.352316408Z [2024-06-28T01:09:05.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:08:00+00:00 exited with status success for try_number 1 2024-06-28T01:09:05.362735643Z [2024-06-28T01:09:05.362+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:08:00+00:00, map_index=-1, run_start_date=2024-06-28 01:09:02.793112+00:00, run_end_date=2024-06-28 01:09:04.303979+00:00, run_duration=1.510867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=694, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:09:00.273680+00:00, queued_by_job_id=2, pid=10135 2024-06-28T01:09:05.363047529Z [2024-06-28T01:09:05.362+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:08:00+00:00, map_index=-1, run_start_date=2024-06-28 01:09:02.689434+00:00, run_end_date=2024-06-28 01:09:04.527438+00:00, run_duration=1.838004, state=success, executor_state=success, try_number=1, max_tries=1, job_id=693, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:09:00.273680+00:00, queued_by_job_id=2, pid=10134 2024-06-28T01:10:00.595549094Z [2024-06-28T01:10:00.595+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:10:00+00:00, run_after=2024-06-28T01:11:00+00:00 2024-06-28T01:10:00.613626597Z [2024-06-28T01:10:00.613+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:10:00+00:00, run_after=2024-06-28T01:15:00+00:00 2024-06-28T01:10:00.621630058Z [2024-06-28T01:10:00.621+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:10:00.633700090Z [2024-06-28T01:10:00.633+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:10:00+00:00, run_after=2024-06-28T01:11:00+00:00 2024-06-28T01:10:00.641454015Z [2024-06-28T01:10:00.640+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:10:00.738801654Z [2024-06-28T01:10:00.738+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-28T01:10:00.738832793Z 2024-06-28T01:10:00.738839275Z 2024-06-28T01:10:00.738852945Z 2024-06-28T01:10:00.738883573Z 2024-06-28T01:10:00.738888727Z 2024-06-28T01:10:00.738903217Z [2024-06-28T01:10:00.738+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:10:00.738920965Z [2024-06-28T01:10:00.738+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:10:00.739017911Z [2024-06-28T01:10:00.738+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:10:00.739045187Z [2024-06-28T01:10:00.738+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:10:00.739172071Z [2024-06-28T01:10:00.739+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:10:00.743336354Z [2024-06-28T01:10:00.743+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:10:00.743355845Z 2024-06-28T01:10:00.743359969Z 2024-06-28T01:10:00.743363952Z 2024-06-28T01:10:00.743367074Z 2024-06-28T01:10:00.743386514Z 2024-06-28T01:10:00.747232755Z [2024-06-28T01:10:00.746+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T01:10:00.747358636Z [2024-06-28T01:10:00.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:10:00.747494929Z [2024-06-28T01:10:00.747+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:10:00.747619552Z [2024-06-28T01:10:00.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:10:00.747758809Z [2024-06-28T01:10:00.747+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:10:00.747815255Z [2024-06-28T01:10:00.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:10:00.748000051Z [2024-06-28T01:10:00.747+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:10:00.748038377Z [2024-06-28T01:10:00.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:10:00.748221887Z [2024-06-28T01:10:00.748+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:10:00.748274949Z [2024-06-28T01:10:00.748+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:10:01.235982305Z [2024-06-28T01:10:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:05:00+00:00 exited with status queued for try_number 1 2024-06-28T01:10:01.236375224Z [2024-06-28T01:10:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:08:00+00:00 exited with status queued for try_number 1 2024-06-28T01:10:01.236586139Z [2024-06-28T01:10:01.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:09:00+00:00 exited with status queued for try_number 1 2024-06-28T01:10:01.236789400Z [2024-06-28T01:10:01.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:09:00+00:00 exited with status queued for try_number 1 2024-06-28T01:10:01.236986790Z [2024-06-28T01:10:01.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:09:00+00:00 exited with status queued for try_number 1 2024-06-28T01:10:01.272255097Z [2024-06-28T01:10:01.271+0000] {scheduler_job.py:635} INFO - Setting external_id for to b599c3d3-68ab-4ef8-8eaf-d7d8a70b1761 2024-06-28T01:10:01.272658041Z [2024-06-28T01:10:01.272+0000] {scheduler_job.py:635} INFO - Setting external_id for to 363d5887-ab77-4a80-aba1-f423d59c286c 2024-06-28T01:10:01.272847018Z [2024-06-28T01:10:01.272+0000] {scheduler_job.py:635} INFO - Setting external_id for to f69a6715-d14e-4eca-80b8-21ed81b34ebf 2024-06-28T01:10:01.273017938Z [2024-06-28T01:10:01.272+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8f63ae1-221a-4d89-8b52-24666e647503 2024-06-28T01:10:01.273166876Z [2024-06-28T01:10:01.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to ecc8665b-f453-4e46-b2a8-fc6bcb9e351c 2024-06-28T01:10:02.720386738Z [2024-06-28T01:10:02.720+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:10:02.720746637Z [2024-06-28T01:10:02.720+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:08:00+00:00, run_id=scheduled__2024-06-28T01:08:00+00:00, run_start_date=2024-06-28 01:10:00.652583+00:00, run_end_date=2024-06-28 01:10:02.720387+00:00, run_duration=2.067804, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:08:00+00:00, data_interval_end=2024-06-28 01:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:10:02.728621763Z [2024-06-28T01:10:02.728+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:10:00+00:00, run_after=2024-06-28T01:12:00+00:00 2024-06-28T01:10:02.734992725Z [2024-06-28T01:10:02.734+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:10:02.735249773Z [2024-06-28T01:10:02.735+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:09:00+00:00, run_id=scheduled__2024-06-28T01:09:00+00:00, run_start_date=2024-06-28 01:10:00.653595+00:00, run_end_date=2024-06-28 01:10:02.734978+00:00, run_duration=2.081383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:09:00+00:00, data_interval_end=2024-06-28 01:10:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:10:02.744467294Z [2024-06-28T01:10:02.744+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:10:00+00:00, run_after=2024-06-28T01:11:00+00:00 2024-06-28T01:10:02.813390748Z [2024-06-28T01:10:02.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:08:00+00:00 exited with status success for try_number 1 2024-06-28T01:10:02.813454907Z [2024-06-28T01:10:02.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:09:00+00:00 exited with status success for try_number 1 2024-06-28T01:10:02.823705772Z [2024-06-28T01:10:02.821+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:09:00+00:00, map_index=-1, run_start_date=2024-06-28 01:10:01.845038+00:00, run_end_date=2024-06-28 01:10:02.522147+00:00, run_duration=0.677109, state=success, executor_state=success, try_number=1, max_tries=1, job_id=695, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:10:00.744210+00:00, queued_by_job_id=2, pid=10169 2024-06-28T01:10:02.824335301Z [2024-06-28T01:10:02.823+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:08:00+00:00, map_index=-1, run_start_date=2024-06-28 01:10:01.971145+00:00, run_end_date=2024-06-28 01:10:02.534819+00:00, run_duration=0.563674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=696, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:10:00.744210+00:00, queued_by_job_id=2, pid=10170 2024-06-28T01:10:05.069378774Z [2024-06-28T01:10:05.068+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:10:05.071940569Z [2024-06-28T01:10:05.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:09:00+00:00, run_id=scheduled__2024-06-28T01:09:00+00:00, run_start_date=2024-06-28 01:10:00.655263+00:00, run_end_date=2024-06-28 01:10:05.069281+00:00, run_duration=4.414018, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:09:00+00:00, data_interval_end=2024-06-28 01:10:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:10:05.101097848Z [2024-06-28T01:10:05.100+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:10:00+00:00, run_after=2024-06-28T01:11:00+00:00 2024-06-28T01:10:05.148915547Z [2024-06-28T01:10:05.148+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:10:05.148944607Z 2024-06-28T01:10:05.149091651Z [2024-06-28T01:10:05.148+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:10:05.150211067Z [2024-06-28T01:10:05.149+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:10:05.150234620Z 2024-06-28T01:10:05.153316549Z [2024-06-28T01:10:05.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T01:10:05.153330616Z [2024-06-28T01:10:05.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:10:05.250713555Z [2024-06-28T01:10:05.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:05:00+00:00 exited with status queued for try_number 1 2024-06-28T01:10:05.251063425Z [2024-06-28T01:10:05.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:05:00+00:00 exited with status success for try_number 1 2024-06-28T01:10:05.253070528Z [2024-06-28T01:10:05.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:09:00+00:00 exited with status success for try_number 1 2024-06-28T01:10:05.266221891Z [2024-06-28T01:10:05.264+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed785556-ae01-46d2-b960-45d68ab6c82d 2024-06-28T01:10:05.266282422Z [2024-06-28T01:10:05.265+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T01:05:00+00:00, map_index=-1, run_start_date=2024-06-28 01:10:03.613049+00:00, run_end_date=2024-06-28 01:10:04.027524+00:00, run_duration=0.414475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=699, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:10:00.744210+00:00, queued_by_job_id=2, pid=10206 2024-06-28T01:10:05.266286706Z [2024-06-28T01:10:05.265+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:09:00+00:00, map_index=-1, run_start_date=2024-06-28 01:10:03.586216+00:00, run_end_date=2024-06-28 01:10:04.868125+00:00, run_duration=1.281909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=698, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:10:00.744210+00:00, queued_by_job_id=2, pid=10202 2024-06-28T01:10:05.328302948Z [2024-06-28T01:10:05.327+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:10:05.328612490Z [2024-06-28T01:10:05.328+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:09:00+00:00, run_id=scheduled__2024-06-28T01:09:00+00:00, run_start_date=2024-06-28 01:10:00.656460+00:00, run_end_date=2024-06-28 01:10:05.328215+00:00, run_duration=4.671755, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:09:00+00:00, data_interval_end=2024-06-28 01:10:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:10:05.340592962Z [2024-06-28T01:10:05.340+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:10:00+00:00, run_after=2024-06-28T01:11:00+00:00 2024-06-28T01:10:05.389936600Z [2024-06-28T01:10:05.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:09:00+00:00 exited with status success for try_number 1 2024-06-28T01:10:05.395857255Z [2024-06-28T01:10:05.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:09:00+00:00, map_index=-1, run_start_date=2024-06-28 01:10:03.200264+00:00, run_end_date=2024-06-28 01:10:05.094296+00:00, run_duration=1.894032, state=success, executor_state=success, try_number=1, max_tries=1, job_id=697, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:10:00.744210+00:00, queued_by_job_id=2, pid=10189 2024-06-28T01:10:08.577845982Z [2024-06-28T01:10:08.577+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:10:08.577898351Z 2024-06-28T01:10:08.577986745Z [2024-06-28T01:10:08.577+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:10:08.578630230Z [2024-06-28T01:10:08.578+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:10:08.578652178Z 2024-06-28T01:10:08.581089901Z [2024-06-28T01:10:08.580+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T01:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T01:10:08.581334566Z [2024-06-28T01:10:08.581+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T01:10:08.641927925Z [2024-06-28T01:10:08.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:05:00+00:00 exited with status queued for try_number 1 2024-06-28T01:10:08.642090194Z [2024-06-28T01:10:08.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:05:00+00:00 exited with status success for try_number 1 2024-06-28T01:10:08.651492678Z [2024-06-28T01:10:08.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to d71295bc-0ad1-44b1-986f-e86e3de5427c 2024-06-28T01:10:08.651785614Z [2024-06-28T01:10:08.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T01:05:00+00:00, map_index=-1, run_start_date=2024-06-28 01:10:07.121390+00:00, run_end_date=2024-06-28 01:10:07.478926+00:00, run_duration=0.357536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=700, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:10:05.150469+00:00, queued_by_job_id=2, pid=10224 2024-06-28T01:10:10.911888348Z [2024-06-28T01:10:10.911+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:10:10.911905507Z 2024-06-28T01:10:10.912609549Z [2024-06-28T01:10:10.911+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:10:10.913232517Z [2024-06-28T01:10:10.913+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:10:10.913244021Z 2024-06-28T01:10:10.917539743Z [2024-06-28T01:10:10.917+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:10:10.917765814Z [2024-06-28T01:10:10.917+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:10:11.013834361Z [2024-06-28T01:10:11.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:05:00+00:00 exited with status queued for try_number 1 2024-06-28T01:10:11.014090384Z [2024-06-28T01:10:11.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:05:00+00:00 exited with status success for try_number 1 2024-06-28T01:10:11.025505501Z [2024-06-28T01:10:11.025+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef6ec09f-ae09-4403-9081-a65022403c0c 2024-06-28T01:10:11.025802744Z [2024-06-28T01:10:11.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T01:05:00+00:00, map_index=0, run_start_date=2024-06-28 01:10:10.249563+00:00, run_end_date=2024-06-28 01:10:10.591190+00:00, run_duration=0.341627, state=success, executor_state=success, try_number=1, max_tries=1, job_id=701, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:10:08.579067+00:00, queued_by_job_id=2, pid=10232 2024-06-28T01:10:14.085997362Z [2024-06-28T01:10:14.085+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:10:14.086557478Z [2024-06-28T01:10:14.086+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:05:00+00:00, run_id=scheduled__2024-06-28T01:05:00+00:00, run_start_date=2024-06-28 01:10:00.651246+00:00, run_end_date=2024-06-28 01:10:14.085873+00:00, run_duration=13.434627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:05:00+00:00, data_interval_end=2024-06-28 01:10:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T01:10:14.096664964Z [2024-06-28T01:10:14.096+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:10:00+00:00, run_after=2024-06-28T01:15:00+00:00 2024-06-28T01:10:14.131210260Z [2024-06-28T01:10:14.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:05:00+00:00 exited with status success for try_number 1 2024-06-28T01:10:14.137674699Z [2024-06-28T01:10:14.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T01:05:00+00:00, map_index=-1, run_start_date=2024-06-28 01:10:12.717550+00:00, run_end_date=2024-06-28 01:10:13.199898+00:00, run_duration=0.482348, state=success, executor_state=success, try_number=1, max_tries=1, job_id=702, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:10:10.913789+00:00, queued_by_job_id=2, pid=10240 2024-06-28T01:11:01.029428271Z [2024-06-28T01:11:01.029+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:11:01.041427113Z [2024-06-28T01:11:01.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:11:00+00:00, run_after=2024-06-28T01:12:00+00:00 2024-06-28T01:11:01.055734881Z [2024-06-28T01:11:01.055+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:11:00+00:00, run_after=2024-06-28T01:12:00+00:00 2024-06-28T01:11:01.113501781Z [2024-06-28T01:11:01.113+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:11:01.113528325Z 2024-06-28T01:11:01.113532622Z 2024-06-28T01:11:01.113536724Z 2024-06-28T01:11:01.113734848Z [2024-06-28T01:11:01.113+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:11:01.113963109Z [2024-06-28T01:11:01.113+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:11:01.114172898Z [2024-06-28T01:11:01.113+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:11:01.114932890Z [2024-06-28T01:11:01.114+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:11:01.114969567Z 2024-06-28T01:11:01.114978778Z 2024-06-28T01:11:01.114986328Z 2024-06-28T01:11:01.117888752Z [2024-06-28T01:11:01.117+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:11:01.118213895Z [2024-06-28T01:11:01.117+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:11:01.118904048Z [2024-06-28T01:11:01.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:11:01.118952128Z [2024-06-28T01:11:01.118+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:11:01.119335836Z [2024-06-28T01:11:01.119+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:11:01.119599783Z [2024-06-28T01:11:01.119+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:11:01.404368158Z [2024-06-28T01:11:01.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:10:00+00:00 exited with status queued for try_number 1 2024-06-28T01:11:01.404487969Z [2024-06-28T01:11:01.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:10:00+00:00 exited with status queued for try_number 1 2024-06-28T01:11:01.404687628Z [2024-06-28T01:11:01.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:10:00+00:00 exited with status queued for try_number 1 2024-06-28T01:11:01.416437543Z [2024-06-28T01:11:01.416+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80f7c94b-1d65-41b9-b477-3853dd007069 2024-06-28T01:11:01.416573194Z [2024-06-28T01:11:01.416+0000] {scheduler_job.py:635} INFO - Setting external_id for to 593a2285-6d47-42cb-afae-06112efc3ead 2024-06-28T01:11:01.416727629Z [2024-06-28T01:11:01.416+0000] {scheduler_job.py:635} INFO - Setting external_id for to b50679cd-b998-4f72-b68a-54d8d7de0dbc 2024-06-28T01:11:02.591405337Z [2024-06-28T01:11:02.590+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:11:02.592770622Z [2024-06-28T01:11:02.591+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:10:00+00:00, run_id=scheduled__2024-06-28T01:10:00+00:00, run_start_date=2024-06-28 01:11:01.066076+00:00, run_end_date=2024-06-28 01:11:02.591327+00:00, run_duration=1.525251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:10:00+00:00, data_interval_end=2024-06-28 01:11:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:11:02.601147443Z [2024-06-28T01:11:02.600+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:11:00+00:00, run_after=2024-06-28T01:12:00+00:00 2024-06-28T01:11:02.659303180Z [2024-06-28T01:11:02.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:10:00+00:00 exited with status success for try_number 1 2024-06-28T01:11:02.664195748Z [2024-06-28T01:11:02.663+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:10:00+00:00, map_index=-1, run_start_date=2024-06-28 01:11:01.977647+00:00, run_end_date=2024-06-28 01:11:02.472400+00:00, run_duration=0.494753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=703, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:11:01.115552+00:00, queued_by_job_id=2, pid=10261 2024-06-28T01:11:05.947079038Z [2024-06-28T01:11:05.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:11:05.947473326Z [2024-06-28T01:11:05.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:10:00+00:00, run_id=scheduled__2024-06-28T01:10:00+00:00, run_start_date=2024-06-28 01:11:01.067347+00:00, run_end_date=2024-06-28 01:11:05.947008+00:00, run_duration=4.879661, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:10:00+00:00, data_interval_end=2024-06-28 01:11:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:11:05.955215854Z [2024-06-28T01:11:05.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:11:00+00:00, run_after=2024-06-28T01:12:00+00:00 2024-06-28T01:11:05.960862238Z [2024-06-28T01:11:05.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:11:05.961085242Z [2024-06-28T01:11:05.960+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:10:00+00:00, run_id=scheduled__2024-06-28T01:10:00+00:00, run_start_date=2024-06-28 01:11:01.068361+00:00, run_end_date=2024-06-28 01:11:05.960793+00:00, run_duration=4.892432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:10:00+00:00, data_interval_end=2024-06-28 01:11:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:11:05.969505904Z [2024-06-28T01:11:05.969+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:11:00+00:00, run_after=2024-06-28T01:12:00+00:00 2024-06-28T01:11:06.005264886Z [2024-06-28T01:11:06.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:10:00+00:00 exited with status success for try_number 1 2024-06-28T01:11:06.005308515Z [2024-06-28T01:11:06.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:10:00+00:00 exited with status success for try_number 1 2024-06-28T01:11:06.011213560Z [2024-06-28T01:11:06.010+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:10:00+00:00, map_index=-1, run_start_date=2024-06-28 01:11:03.286576+00:00, run_end_date=2024-06-28 01:11:05.239678+00:00, run_duration=1.953102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=704, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:11:01.115552+00:00, queued_by_job_id=2, pid=10279 2024-06-28T01:11:06.012619210Z [2024-06-28T01:11:06.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:10:00+00:00, map_index=-1, run_start_date=2024-06-28 01:11:03.310239+00:00, run_end_date=2024-06-28 01:11:05.651525+00:00, run_duration=2.341286, state=success, executor_state=success, try_number=1, max_tries=1, job_id=705, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:11:01.115552+00:00, queued_by_job_id=2, pid=10280 2024-06-28T01:11:46.210441370Z [2024-06-28T01:11:46.209+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T01:12:00.683806559Z [2024-06-28T01:12:00.683+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:12:00+00:00, run_after=2024-06-28T01:13:00+00:00 2024-06-28T01:12:00.691916645Z [2024-06-28T01:12:00.691+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:12:00.706911713Z [2024-06-28T01:12:00.706+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:12:00+00:00, run_after=2024-06-28T01:13:00+00:00 2024-06-28T01:12:00.715350899Z [2024-06-28T01:12:00.714+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:12:00.790049693Z [2024-06-28T01:12:00.789+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:12:00.790062293Z 2024-06-28T01:12:00.790066047Z 2024-06-28T01:12:00.790069172Z 2024-06-28T01:12:00.790072202Z 2024-06-28T01:12:00.790300655Z [2024-06-28T01:12:00.790+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:12:00.790481278Z [2024-06-28T01:12:00.790+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:12:00.791255503Z [2024-06-28T01:12:00.790+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:12:00.791529891Z [2024-06-28T01:12:00.791+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:12:00.792131987Z [2024-06-28T01:12:00.791+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:12:00.792151655Z 2024-06-28T01:12:00.792157185Z 2024-06-28T01:12:00.792161791Z 2024-06-28T01:12:00.792166259Z 2024-06-28T01:12:00.796478625Z [2024-06-28T01:12:00.796+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:12:00.796659105Z [2024-06-28T01:12:00.796+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:12:00.797005847Z [2024-06-28T01:12:00.796+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:12:00.797153519Z [2024-06-28T01:12:00.796+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:12:00.797427035Z [2024-06-28T01:12:00.797+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:12:00.797581608Z [2024-06-28T01:12:00.797+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:12:00.797882690Z [2024-06-28T01:12:00.797+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:12:00.798045891Z [2024-06-28T01:12:00.797+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:12:01.345245104Z [2024-06-28T01:12:01.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:10:00+00:00 exited with status queued for try_number 1 2024-06-28T01:12:01.345309166Z [2024-06-28T01:12:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:11:00+00:00 exited with status queued for try_number 1 2024-06-28T01:12:01.345945498Z [2024-06-28T01:12:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:11:00+00:00 exited with status queued for try_number 1 2024-06-28T01:12:01.346088662Z [2024-06-28T01:12:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:11:00+00:00 exited with status queued for try_number 1 2024-06-28T01:12:01.359533733Z [2024-06-28T01:12:01.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50681957-6001-48bb-a83f-42d18d3d338c 2024-06-28T01:12:01.359773863Z [2024-06-28T01:12:01.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92581b2c-86fc-491b-b0ad-434702227dec 2024-06-28T01:12:01.360011429Z [2024-06-28T01:12:01.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01fdf85d-ddb3-4dcc-a43d-53bbb9f2eaef 2024-06-28T01:12:01.360271450Z [2024-06-28T01:12:01.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebcd35b6-12ea-417d-a2fd-13ff248b9ded 2024-06-28T01:12:02.631811610Z [2024-06-28T01:12:02.631+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:12:02.632240325Z [2024-06-28T01:12:02.632+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:10:00+00:00, run_id=scheduled__2024-06-28T01:10:00+00:00, run_start_date=2024-06-28 01:12:00.726374+00:00, run_end_date=2024-06-28 01:12:02.631902+00:00, run_duration=1.905528, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:10:00+00:00, data_interval_end=2024-06-28 01:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:12:02.642799961Z [2024-06-28T01:12:02.642+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:12:00+00:00, run_after=2024-06-28T01:14:00+00:00 2024-06-28T01:12:02.739770345Z [2024-06-28T01:12:02.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:10:00+00:00 exited with status success for try_number 1 2024-06-28T01:12:02.739802177Z [2024-06-28T01:12:02.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:11:00+00:00 exited with status success for try_number 1 2024-06-28T01:12:02.758874263Z [2024-06-28T01:12:02.758+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:11:00+00:00, map_index=-1, run_start_date=2024-06-28 01:12:01.989063+00:00, run_end_date=2024-06-28 01:12:02.478168+00:00, run_duration=0.489105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=707, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:12:00.792982+00:00, queued_by_job_id=2, pid=10314 2024-06-28T01:12:02.758917737Z [2024-06-28T01:12:02.758+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:10:00+00:00, map_index=-1, run_start_date=2024-06-28 01:12:01.898140+00:00, run_end_date=2024-06-28 01:12:02.420741+00:00, run_duration=0.522601, state=success, executor_state=success, try_number=1, max_tries=1, job_id=706, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:12:00.792982+00:00, queued_by_job_id=2, pid=10313 2024-06-28T01:12:03.651065416Z [2024-06-28T01:12:03.650+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:12:03.653174104Z [2024-06-28T01:12:03.652+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:11:00+00:00, run_id=scheduled__2024-06-28T01:11:00+00:00, run_start_date=2024-06-28 01:12:00.727799+00:00, run_end_date=2024-06-28 01:12:03.651034+00:00, run_duration=2.923235, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:11:00+00:00, data_interval_end=2024-06-28 01:12:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:12:03.670356062Z [2024-06-28T01:12:03.670+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:12:00+00:00, run_after=2024-06-28T01:13:00+00:00 2024-06-28T01:12:04.820905330Z [2024-06-28T01:12:04.820+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:12:04.821535866Z [2024-06-28T01:12:04.821+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:11:00+00:00, run_id=scheduled__2024-06-28T01:11:00+00:00, run_start_date=2024-06-28 01:12:00.728901+00:00, run_end_date=2024-06-28 01:12:04.821203+00:00, run_duration=4.092302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:11:00+00:00, data_interval_end=2024-06-28 01:12:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:12:04.831103885Z [2024-06-28T01:12:04.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:12:00+00:00, run_after=2024-06-28T01:13:00+00:00 2024-06-28T01:12:05.924812385Z [2024-06-28T01:12:05.924+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:12:05.924985382Z [2024-06-28T01:12:05.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:11:00+00:00, run_id=scheduled__2024-06-28T01:11:00+00:00, run_start_date=2024-06-28 01:12:00.730438+00:00, run_end_date=2024-06-28 01:12:05.924761+00:00, run_duration=5.194323, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:11:00+00:00, data_interval_end=2024-06-28 01:12:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:12:05.933299472Z [2024-06-28T01:12:05.933+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:12:00+00:00, run_after=2024-06-28T01:13:00+00:00 2024-06-28T01:12:05.967270998Z [2024-06-28T01:12:05.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:11:00+00:00 exited with status success for try_number 1 2024-06-28T01:12:05.967440257Z [2024-06-28T01:12:05.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:11:00+00:00 exited with status success for try_number 1 2024-06-28T01:12:05.974502752Z [2024-06-28T01:12:05.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:11:00+00:00, map_index=-1, run_start_date=2024-06-28 01:12:03.185322+00:00, run_end_date=2024-06-28 01:12:04.711114+00:00, run_duration=1.525792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=708, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:12:00.792982+00:00, queued_by_job_id=2, pid=10337 2024-06-28T01:12:05.974874564Z [2024-06-28T01:12:05.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:11:00+00:00, map_index=-1, run_start_date=2024-06-28 01:12:03.214085+00:00, run_end_date=2024-06-28 01:12:05.173897+00:00, run_duration=1.959812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=709, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:12:00.792982+00:00, queued_by_job_id=2, pid=10338 2024-06-28T01:13:00.682449229Z [2024-06-28T01:13:00.682+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:13:00+00:00, run_after=2024-06-28T01:14:00+00:00 2024-06-28T01:13:00.708034617Z [2024-06-28T01:13:00.707+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:13:00+00:00, run_after=2024-06-28T01:14:00+00:00 2024-06-28T01:13:00.717976175Z [2024-06-28T01:13:00.717+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:13:00.815334221Z [2024-06-28T01:13:00.814+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:13:00.815362847Z 2024-06-28T01:13:00.815368046Z 2024-06-28T01:13:00.815372556Z 2024-06-28T01:13:00.815574573Z [2024-06-28T01:13:00.815+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:13:00.815884052Z [2024-06-28T01:13:00.815+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:13:00.816146714Z [2024-06-28T01:13:00.815+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:13:00.816920093Z [2024-06-28T01:13:00.816+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:13:00.816973030Z 2024-06-28T01:13:00.816978233Z 2024-06-28T01:13:00.816981514Z 2024-06-28T01:13:00.821246538Z [2024-06-28T01:13:00.820+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:13:00.821414246Z [2024-06-28T01:13:00.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:13:00.821745874Z [2024-06-28T01:13:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:13:00.821892110Z [2024-06-28T01:13:00.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:13:00.822284747Z [2024-06-28T01:13:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:13:00.822333193Z [2024-06-28T01:13:00.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:13:01.183741844Z [2024-06-28T01:13:01.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:12:00+00:00 exited with status queued for try_number 1 2024-06-28T01:13:01.183918409Z [2024-06-28T01:13:01.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:12:00+00:00 exited with status queued for try_number 1 2024-06-28T01:13:01.184085167Z [2024-06-28T01:13:01.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:12:00+00:00 exited with status queued for try_number 1 2024-06-28T01:13:01.196213465Z [2024-06-28T01:13:01.195+0000] {scheduler_job.py:635} INFO - Setting external_id for to b34e6216-2e29-4b25-abfb-4fbe26b32374 2024-06-28T01:13:01.196258288Z [2024-06-28T01:13:01.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to c80241f6-b9d1-4f6a-a1b1-35eae46db6e9 2024-06-28T01:13:01.196394113Z [2024-06-28T01:13:01.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to c33ba5f1-afc4-4ddb-ad08-5595563f2a70 2024-06-28T01:13:02.404277188Z [2024-06-28T01:13:02.403+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:13:02.404822936Z [2024-06-28T01:13:02.404+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:12:00+00:00, run_id=scheduled__2024-06-28T01:12:00+00:00, run_start_date=2024-06-28 01:13:00.732483+00:00, run_end_date=2024-06-28 01:13:02.404451+00:00, run_duration=1.671968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:12:00+00:00, data_interval_end=2024-06-28 01:13:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:13:02.421163429Z [2024-06-28T01:13:02.420+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:13:00+00:00, run_after=2024-06-28T01:14:00+00:00 2024-06-28T01:13:02.499508177Z [2024-06-28T01:13:02.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:12:00+00:00 exited with status success for try_number 1 2024-06-28T01:13:02.505470706Z [2024-06-28T01:13:02.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:12:00+00:00, map_index=-1, run_start_date=2024-06-28 01:13:01.805104+00:00, run_end_date=2024-06-28 01:13:02.209859+00:00, run_duration=0.404755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=710, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:13:00.817835+00:00, queued_by_job_id=2, pid=10370 2024-06-28T01:13:06.011879317Z [2024-06-28T01:13:06.011+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:13:06.012446196Z [2024-06-28T01:13:06.012+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:12:00+00:00, run_id=scheduled__2024-06-28T01:12:00+00:00, run_start_date=2024-06-28 01:13:00.734858+00:00, run_end_date=2024-06-28 01:13:06.011781+00:00, run_duration=5.276923, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:12:00+00:00, data_interval_end=2024-06-28 01:13:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:13:06.022200671Z [2024-06-28T01:13:06.021+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:13:00+00:00, run_after=2024-06-28T01:14:00+00:00 2024-06-28T01:13:06.029329892Z [2024-06-28T01:13:06.029+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:13:06.029740704Z [2024-06-28T01:13:06.029+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:12:00+00:00, run_id=scheduled__2024-06-28T01:12:00+00:00, run_start_date=2024-06-28 01:13:00.736433+00:00, run_end_date=2024-06-28 01:13:06.029247+00:00, run_duration=5.292814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:12:00+00:00, data_interval_end=2024-06-28 01:13:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:13:06.042111560Z [2024-06-28T01:13:06.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:13:00+00:00, run_after=2024-06-28T01:14:00+00:00 2024-06-28T01:13:06.098295634Z [2024-06-28T01:13:06.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:12:00+00:00 exited with status success for try_number 1 2024-06-28T01:13:06.098455813Z [2024-06-28T01:13:06.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:12:00+00:00 exited with status success for try_number 1 2024-06-28T01:13:06.108016892Z [2024-06-28T01:13:06.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:12:00+00:00, map_index=-1, run_start_date=2024-06-28 01:13:02.919360+00:00, run_end_date=2024-06-28 01:13:04.786544+00:00, run_duration=1.867184, state=success, executor_state=success, try_number=1, max_tries=1, job_id=711, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:13:00.817835+00:00, queued_by_job_id=2, pid=10388 2024-06-28T01:13:06.108148902Z [2024-06-28T01:13:06.108+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:12:00+00:00, map_index=-1, run_start_date=2024-06-28 01:13:03.037074+00:00, run_end_date=2024-06-28 01:13:05.081323+00:00, run_duration=2.044249, state=success, executor_state=success, try_number=1, max_tries=1, job_id=712, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:13:00.817835+00:00, queued_by_job_id=2, pid=10389 2024-06-28T01:14:00.151071924Z [2024-06-28T01:14:00.150+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:14:00.158914237Z [2024-06-28T01:14:00.158+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:14:00.171664137Z [2024-06-28T01:14:00.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:14:00+00:00, run_after=2024-06-28T01:15:00+00:00 2024-06-28T01:14:00.189890252Z [2024-06-28T01:14:00.189+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:14:00+00:00, run_after=2024-06-28T01:15:00+00:00 2024-06-28T01:14:00.286640653Z [2024-06-28T01:14:00.286+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:14:00.286666402Z 2024-06-28T01:14:00.286671018Z 2024-06-28T01:14:00.286674197Z 2024-06-28T01:14:00.286753666Z 2024-06-28T01:14:00.286783625Z [2024-06-28T01:14:00.286+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:14:00.286985646Z [2024-06-28T01:14:00.286+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:14:00.287119210Z [2024-06-28T01:14:00.286+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:14:00.287250643Z [2024-06-28T01:14:00.287+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:14:00.287796419Z [2024-06-28T01:14:00.287+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:14:00.287804941Z 2024-06-28T01:14:00.287808459Z 2024-06-28T01:14:00.287811737Z 2024-06-28T01:14:00.287814873Z 2024-06-28T01:14:00.292277046Z [2024-06-28T01:14:00.292+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:14:00.292389122Z [2024-06-28T01:14:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:14:00.292604154Z [2024-06-28T01:14:00.292+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:14:00.292733962Z [2024-06-28T01:14:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:14:00.293585420Z [2024-06-28T01:14:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:14:00.293755265Z [2024-06-28T01:14:00.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:14:00.293958319Z [2024-06-28T01:14:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:14:00.294058716Z [2024-06-28T01:14:00.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:14:00.610861960Z [2024-06-28T01:14:00.610+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:12:00+00:00 exited with status queued for try_number 1 2024-06-28T01:14:00.611101196Z [2024-06-28T01:14:00.610+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:13:00+00:00 exited with status queued for try_number 1 2024-06-28T01:14:00.611256012Z [2024-06-28T01:14:00.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:13:00+00:00 exited with status queued for try_number 1 2024-06-28T01:14:00.611417961Z [2024-06-28T01:14:00.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:13:00+00:00 exited with status queued for try_number 1 2024-06-28T01:14:00.627522656Z [2024-06-28T01:14:00.627+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc69cb72-b2b7-4435-b102-71006d6f90d0 2024-06-28T01:14:00.627819106Z [2024-06-28T01:14:00.627+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90532797-8e88-4b9e-9278-dacaaa99fc53 2024-06-28T01:14:00.628019300Z [2024-06-28T01:14:00.627+0000] {scheduler_job.py:635} INFO - Setting external_id for to 244c1d24-5a87-4290-b2c4-2b0b60867f34 2024-06-28T01:14:00.628216987Z [2024-06-28T01:14:00.628+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5143d3d7-a0e7-442c-9fe7-db35a3ec1167 2024-06-28T01:14:01.950127309Z [2024-06-28T01:14:01.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:14:01.950529400Z [2024-06-28T01:14:01.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:12:00+00:00, run_id=scheduled__2024-06-28T01:12:00+00:00, run_start_date=2024-06-28 01:14:00.213085+00:00, run_end_date=2024-06-28 01:14:01.950129+00:00, run_duration=1.737044, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:12:00+00:00, data_interval_end=2024-06-28 01:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:14:01.963698185Z [2024-06-28T01:14:01.963+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:14:00+00:00, run_after=2024-06-28T01:16:00+00:00 2024-06-28T01:14:03.174788730Z [2024-06-28T01:14:03.174+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:14:03.175247734Z [2024-06-28T01:14:03.174+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:13:00+00:00, run_id=scheduled__2024-06-28T01:13:00+00:00, run_start_date=2024-06-28 01:14:00.214553+00:00, run_end_date=2024-06-28 01:14:03.174612+00:00, run_duration=2.960059, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:13:00+00:00, data_interval_end=2024-06-28 01:14:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:14:03.184790518Z [2024-06-28T01:14:03.184+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:14:00+00:00, run_after=2024-06-28T01:15:00+00:00 2024-06-28T01:14:03.294976515Z [2024-06-28T01:14:03.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:12:00+00:00 exited with status success for try_number 1 2024-06-28T01:14:03.295155903Z [2024-06-28T01:14:03.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:13:00+00:00 exited with status success for try_number 1 2024-06-28T01:14:03.305013016Z [2024-06-28T01:14:03.304+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:12:00+00:00, map_index=-1, run_start_date=2024-06-28 01:14:01.470787+00:00, run_end_date=2024-06-28 01:14:01.872447+00:00, run_duration=0.40166, state=success, executor_state=success, try_number=1, max_tries=1, job_id=714, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:14:00.288624+00:00, queued_by_job_id=2, pid=10422 2024-06-28T01:14:03.306619282Z [2024-06-28T01:14:03.306+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:13:00+00:00, map_index=-1, run_start_date=2024-06-28 01:14:01.501571+00:00, run_end_date=2024-06-28 01:14:02.100902+00:00, run_duration=0.599331, state=success, executor_state=success, try_number=1, max_tries=1, job_id=713, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:14:00.288624+00:00, queued_by_job_id=2, pid=10423 2024-06-28T01:14:05.909629329Z [2024-06-28T01:14:05.909+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:14:05.909888167Z [2024-06-28T01:14:05.909+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:13:00+00:00, run_id=scheduled__2024-06-28T01:13:00+00:00, run_start_date=2024-06-28 01:14:00.215891+00:00, run_end_date=2024-06-28 01:14:05.909539+00:00, run_duration=5.693648, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:13:00+00:00, data_interval_end=2024-06-28 01:14:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:14:05.921210401Z [2024-06-28T01:14:05.920+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:14:00+00:00, run_after=2024-06-28T01:15:00+00:00 2024-06-28T01:14:05.999212816Z [2024-06-28T01:14:05.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:13:00+00:00 exited with status success for try_number 1 2024-06-28T01:14:06.006782197Z [2024-06-28T01:14:06.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:13:00+00:00, map_index=-1, run_start_date=2024-06-28 01:14:02.779053+00:00, run_end_date=2024-06-28 01:14:05.784795+00:00, run_duration=3.005742, state=success, executor_state=success, try_number=1, max_tries=1, job_id=716, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:14:00.288624+00:00, queued_by_job_id=2, pid=10447 2024-06-28T01:14:06.789916485Z [2024-06-28T01:14:06.789+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:14:06.790367463Z [2024-06-28T01:14:06.790+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:13:00+00:00, run_id=scheduled__2024-06-28T01:13:00+00:00, run_start_date=2024-06-28 01:14:00.216984+00:00, run_end_date=2024-06-28 01:14:06.789980+00:00, run_duration=6.572996, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:13:00+00:00, data_interval_end=2024-06-28 01:14:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:14:06.800823519Z [2024-06-28T01:14:06.800+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:14:00+00:00, run_after=2024-06-28T01:15:00+00:00 2024-06-28T01:14:06.857185719Z [2024-06-28T01:14:06.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:13:00+00:00 exited with status success for try_number 1 2024-06-28T01:14:06.867606173Z [2024-06-28T01:14:06.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:13:00+00:00, map_index=-1, run_start_date=2024-06-28 01:14:02.761500+00:00, run_end_date=2024-06-28 01:14:06.490528+00:00, run_duration=3.729028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=715, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:14:00.288624+00:00, queued_by_job_id=2, pid=10446 2024-06-28T01:15:00.712437771Z [2024-06-28T01:15:00.712+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:15:00+00:00, run_after=2024-06-28T01:20:00+00:00 2024-06-28T01:15:00.725380057Z [2024-06-28T01:15:00.725+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:15:00+00:00, run_after=2024-06-28T01:16:00+00:00 2024-06-28T01:15:00.739833556Z [2024-06-28T01:15:00.739+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:15:00+00:00, run_after=2024-06-28T01:16:00+00:00 2024-06-28T01:15:00.748307499Z [2024-06-28T01:15:00.747+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:15:00.870650478Z [2024-06-28T01:15:00.870+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:15:00.870665119Z 2024-06-28T01:15:00.870671499Z 2024-06-28T01:15:00.870766110Z 2024-06-28T01:15:00.870773314Z 2024-06-28T01:15:00.871021531Z [2024-06-28T01:15:00.870+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:15:00.871241754Z [2024-06-28T01:15:00.871+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:15:00.871495686Z [2024-06-28T01:15:00.871+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:15:00.871758505Z [2024-06-28T01:15:00.871+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:15:00.872779305Z [2024-06-28T01:15:00.872+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:15:00.872789934Z 2024-06-28T01:15:00.872796009Z 2024-06-28T01:15:00.872801525Z 2024-06-28T01:15:00.872807530Z 2024-06-28T01:15:00.877800607Z [2024-06-28T01:15:00.877+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T01:15:00.878094230Z [2024-06-28T01:15:00.877+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:15:00.878442303Z [2024-06-28T01:15:00.878+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:15:00.878645970Z [2024-06-28T01:15:00.878+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:15:00.879043744Z [2024-06-28T01:15:00.878+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:15:00.879259226Z [2024-06-28T01:15:00.878+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:15:00.879513579Z [2024-06-28T01:15:00.879+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:15:00.879651622Z [2024-06-28T01:15:00.879+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:15:01.333370628Z [2024-06-28T01:15:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:10:00+00:00 exited with status queued for try_number 1 2024-06-28T01:15:01.338447154Z [2024-06-28T01:15:01.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:14:00+00:00 exited with status queued for try_number 1 2024-06-28T01:15:01.338514231Z [2024-06-28T01:15:01.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:14:00+00:00 exited with status queued for try_number 1 2024-06-28T01:15:01.338677016Z [2024-06-28T01:15:01.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:14:00+00:00 exited with status queued for try_number 1 2024-06-28T01:15:01.361669291Z [2024-06-28T01:15:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c611a78-37fc-4437-be28-43964df880a8 2024-06-28T01:15:01.363076285Z [2024-06-28T01:15:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0995844-096d-4fad-851e-2b8bddb41382 2024-06-28T01:15:01.364233874Z [2024-06-28T01:15:01.363+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37c26d76-b0e1-4af3-a4fa-729144592994 2024-06-28T01:15:01.365251110Z [2024-06-28T01:15:01.364+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e2e08af-90a2-4c38-8f11-1072264d50db 2024-06-28T01:15:04.357222587Z [2024-06-28T01:15:04.356+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:15:04.357425210Z [2024-06-28T01:15:04.357+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:14:00+00:00, run_id=scheduled__2024-06-28T01:14:00+00:00, run_start_date=2024-06-28 01:15:00.761182+00:00, run_end_date=2024-06-28 01:15:04.357072+00:00, run_duration=3.59589, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:14:00+00:00, data_interval_end=2024-06-28 01:15:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:15:04.366947010Z [2024-06-28T01:15:04.366+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:15:00+00:00, run_after=2024-06-28T01:16:00+00:00 2024-06-28T01:15:04.402846054Z [2024-06-28T01:15:04.402+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:15:04.402860116Z 2024-06-28T01:15:04.402993761Z [2024-06-28T01:15:04.402+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:15:04.403707729Z [2024-06-28T01:15:04.403+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:15:04.403720295Z 2024-06-28T01:15:04.407360129Z [2024-06-28T01:15:04.406+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T01:15:04.407375948Z [2024-06-28T01:15:04.406+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:15:04.587689133Z [2024-06-28T01:15:04.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:10:00+00:00 exited with status queued for try_number 1 2024-06-28T01:15:04.587809149Z [2024-06-28T01:15:04.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:10:00+00:00 exited with status success for try_number 1 2024-06-28T01:15:04.587995308Z [2024-06-28T01:15:04.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:14:00+00:00 exited with status success for try_number 1 2024-06-28T01:15:04.613922487Z [2024-06-28T01:15:04.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:14:00+00:00, map_index=-1, run_start_date=2024-06-28 01:15:02.347009+00:00, run_end_date=2024-06-28 01:15:03.041405+00:00, run_duration=0.694396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=717, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:15:00.874227+00:00, queued_by_job_id=2, pid=10481 2024-06-28T01:15:04.614207703Z [2024-06-28T01:15:04.614+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T01:10:00+00:00, map_index=-1, run_start_date=2024-06-28 01:15:03.699523+00:00, run_end_date=2024-06-28 01:15:04.272610+00:00, run_duration=0.573087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=719, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:15:00.874227+00:00, queued_by_job_id=2, pid=10506 2024-06-28T01:15:04.614434946Z [2024-06-28T01:15:04.614+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b7c8585-416d-4278-bd4b-885af9d39c57 2024-06-28T01:15:05.938781751Z [2024-06-28T01:15:05.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:15:05.939189174Z [2024-06-28T01:15:05.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:14:00+00:00, run_id=scheduled__2024-06-28T01:14:00+00:00, run_start_date=2024-06-28 01:15:00.762362+00:00, run_end_date=2024-06-28 01:15:05.938682+00:00, run_duration=5.17632, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:14:00+00:00, data_interval_end=2024-06-28 01:15:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:15:05.952867725Z [2024-06-28T01:15:05.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:15:00+00:00, run_after=2024-06-28T01:16:00+00:00 2024-06-28T01:15:06.071324600Z [2024-06-28T01:15:06.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:14:00+00:00 exited with status success for try_number 1 2024-06-28T01:15:06.071393198Z [2024-06-28T01:15:06.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:14:00+00:00 exited with status success for try_number 1 2024-06-28T01:15:06.121792881Z [2024-06-28T01:15:06.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:14:00+00:00, map_index=-1, run_start_date=2024-06-28 01:15:03.556230+00:00, run_end_date=2024-06-28 01:15:04.998595+00:00, run_duration=1.442365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=718, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:15:00.874227+00:00, queued_by_job_id=2, pid=10500 2024-06-28T01:15:06.121952662Z [2024-06-28T01:15:06.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:14:00+00:00, map_index=-1, run_start_date=2024-06-28 01:15:03.947661+00:00, run_end_date=2024-06-28 01:15:05.802882+00:00, run_duration=1.855221, state=success, executor_state=success, try_number=1, max_tries=1, job_id=720, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:15:00.874227+00:00, queued_by_job_id=2, pid=10512 2024-06-28T01:15:07.137641727Z [2024-06-28T01:15:07.137+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:15:07.138181363Z [2024-06-28T01:15:07.137+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:14:00+00:00, run_id=scheduled__2024-06-28T01:14:00+00:00, run_start_date=2024-06-28 01:15:00.763564+00:00, run_end_date=2024-06-28 01:15:07.137673+00:00, run_duration=6.374109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:14:00+00:00, data_interval_end=2024-06-28 01:15:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:15:07.151867430Z [2024-06-28T01:15:07.151+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:15:00+00:00, run_after=2024-06-28T01:16:00+00:00 2024-06-28T01:15:07.240675002Z [2024-06-28T01:15:07.240+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:15:07.240699755Z 2024-06-28T01:15:07.241224639Z [2024-06-28T01:15:07.241+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:15:07.253603159Z [2024-06-28T01:15:07.253+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:15:07.253627596Z 2024-06-28T01:15:07.256713093Z [2024-06-28T01:15:07.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T01:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T01:15:07.256993318Z [2024-06-28T01:15:07.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T01:15:07.311361944Z [2024-06-28T01:15:07.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:10:00+00:00 exited with status queued for try_number 1 2024-06-28T01:15:07.326077813Z [2024-06-28T01:15:07.325+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9906582e-2970-484c-b90a-3d923e8f4c62 2024-06-28T01:15:07.508149080Z [2024-06-28T01:15:07.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:10:00+00:00 exited with status success for try_number 1 2024-06-28T01:15:07.514594571Z [2024-06-28T01:15:07.514+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T01:10:00+00:00, map_index=-1, run_start_date=2024-06-28 01:15:06.633858+00:00, run_end_date=2024-06-28 01:15:07.079134+00:00, run_duration=0.445276, state=success, executor_state=success, try_number=1, max_tries=1, job_id=721, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:15:04.404113+00:00, queued_by_job_id=2, pid=10530 2024-06-28T01:15:09.718220202Z [2024-06-28T01:15:09.717+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:15:09.718237256Z 2024-06-28T01:15:09.719148475Z [2024-06-28T01:15:09.718+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:15:09.720209172Z [2024-06-28T01:15:09.719+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:15:09.720217480Z 2024-06-28T01:15:09.723387840Z [2024-06-28T01:15:09.723+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:15:09.723483602Z [2024-06-28T01:15:09.723+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:15:09.789372292Z [2024-06-28T01:15:09.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:10:00+00:00 exited with status queued for try_number 1 2024-06-28T01:15:09.789608922Z [2024-06-28T01:15:09.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:10:00+00:00 exited with status success for try_number 1 2024-06-28T01:15:09.798355008Z [2024-06-28T01:15:09.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cdd1a9a-306c-43e5-8252-208ffdf5f248 2024-06-28T01:15:09.798732521Z [2024-06-28T01:15:09.798+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T01:10:00+00:00, map_index=0, run_start_date=2024-06-28 01:15:09.021147+00:00, run_end_date=2024-06-28 01:15:09.390740+00:00, run_duration=0.369593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=722, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:15:07.254144+00:00, queued_by_job_id=2, pid=10538 2024-06-28T01:15:12.065726115Z [2024-06-28T01:15:12.065+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:15:12.065890363Z [2024-06-28T01:15:12.065+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:10:00+00:00, run_id=scheduled__2024-06-28T01:10:00+00:00, run_start_date=2024-06-28 01:15:00.759548+00:00, run_end_date=2024-06-28 01:15:12.065662+00:00, run_duration=11.306114, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:10:00+00:00, data_interval_end=2024-06-28 01:15:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T01:15:12.071821685Z [2024-06-28T01:15:12.071+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:15:00+00:00, run_after=2024-06-28T01:20:00+00:00 2024-06-28T01:15:12.106324132Z [2024-06-28T01:15:12.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:10:00+00:00 exited with status success for try_number 1 2024-06-28T01:15:12.115135023Z [2024-06-28T01:15:12.114+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T01:10:00+00:00, map_index=-1, run_start_date=2024-06-28 01:15:11.479862+00:00, run_end_date=2024-06-28 01:15:11.898555+00:00, run_duration=0.418693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=723, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:15:09.720687+00:00, queued_by_job_id=2, pid=10546 2024-06-28T01:16:00.128694342Z [2024-06-28T01:16:00.128+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:16:00+00:00, run_after=2024-06-28T01:17:00+00:00 2024-06-28T01:16:00.140259794Z [2024-06-28T01:16:00.139+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:16:00.148101905Z [2024-06-28T01:16:00.147+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:16:00.159858464Z [2024-06-28T01:16:00.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:16:00+00:00, run_after=2024-06-28T01:17:00+00:00 2024-06-28T01:16:00.239006773Z [2024-06-28T01:16:00.238+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:16:00.239020312Z 2024-06-28T01:16:00.239024321Z 2024-06-28T01:16:00.239028072Z 2024-06-28T01:16:00.239031423Z 2024-06-28T01:16:00.239059264Z [2024-06-28T01:16:00.238+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:16:00.239134834Z [2024-06-28T01:16:00.239+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:16:00.239204060Z [2024-06-28T01:16:00.239+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:16:00.239274804Z [2024-06-28T01:16:00.239+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:16:00.239819491Z [2024-06-28T01:16:00.239+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:16:00.239825101Z 2024-06-28T01:16:00.239828410Z 2024-06-28T01:16:00.239834420Z 2024-06-28T01:16:00.239837813Z 2024-06-28T01:16:00.243964900Z [2024-06-28T01:16:00.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:16:00.244039995Z [2024-06-28T01:16:00.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:16:00.244224608Z [2024-06-28T01:16:00.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:16:00.244294915Z [2024-06-28T01:16:00.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:16:00.244477744Z [2024-06-28T01:16:00.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:16:00.244544515Z [2024-06-28T01:16:00.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:16:00.244788657Z [2024-06-28T01:16:00.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:16:00.244846700Z [2024-06-28T01:16:00.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:16:00.635767904Z [2024-06-28T01:16:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:14:00+00:00 exited with status queued for try_number 1 2024-06-28T01:16:00.636149301Z [2024-06-28T01:16:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:15:00+00:00 exited with status queued for try_number 1 2024-06-28T01:16:00.636390665Z [2024-06-28T01:16:00.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:15:00+00:00 exited with status queued for try_number 1 2024-06-28T01:16:00.636619076Z [2024-06-28T01:16:00.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:15:00+00:00 exited with status queued for try_number 1 2024-06-28T01:16:00.656459171Z [2024-06-28T01:16:00.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1f45edc-997e-46b1-8306-5d8b4fca4303 2024-06-28T01:16:00.659179081Z [2024-06-28T01:16:00.658+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa4b3b71-1a74-405f-9862-a57f1bea980a 2024-06-28T01:16:00.659438691Z [2024-06-28T01:16:00.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7af48105-d0a3-47a6-85b0-51953280e3c2 2024-06-28T01:16:00.659660901Z [2024-06-28T01:16:00.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4309670-d709-48a1-9b9f-e9b3edf2d493 2024-06-28T01:16:01.877734727Z [2024-06-28T01:16:01.877+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:16:01.878063649Z [2024-06-28T01:16:01.877+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:14:00+00:00, run_id=scheduled__2024-06-28T01:14:00+00:00, run_start_date=2024-06-28 01:16:00.170785+00:00, run_end_date=2024-06-28 01:16:01.877733+00:00, run_duration=1.706948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:14:00+00:00, data_interval_end=2024-06-28 01:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:16:01.887282306Z [2024-06-28T01:16:01.886+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:16:00+00:00, run_after=2024-06-28T01:18:00+00:00 2024-06-28T01:16:01.896249372Z [2024-06-28T01:16:01.895+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:16:01.897038893Z [2024-06-28T01:16:01.896+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:15:00+00:00, run_id=scheduled__2024-06-28T01:15:00+00:00, run_start_date=2024-06-28 01:16:00.172033+00:00, run_end_date=2024-06-28 01:16:01.896583+00:00, run_duration=1.72455, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:15:00+00:00, data_interval_end=2024-06-28 01:16:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:16:01.911700132Z [2024-06-28T01:16:01.911+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:16:00+00:00, run_after=2024-06-28T01:17:00+00:00 2024-06-28T01:16:01.984735133Z [2024-06-28T01:16:01.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:14:00+00:00 exited with status success for try_number 1 2024-06-28T01:16:01.984931265Z [2024-06-28T01:16:01.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:15:00+00:00 exited with status success for try_number 1 2024-06-28T01:16:01.993940825Z [2024-06-28T01:16:01.993+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:14:00+00:00, map_index=-1, run_start_date=2024-06-28 01:16:01.240501+00:00, run_end_date=2024-06-28 01:16:01.606512+00:00, run_duration=0.366011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=724, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:16:00.241087+00:00, queued_by_job_id=2, pid=10569 2024-06-28T01:16:01.994429224Z [2024-06-28T01:16:01.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:15:00+00:00, map_index=-1, run_start_date=2024-06-28 01:16:01.275010+00:00, run_end_date=2024-06-28 01:16:01.739211+00:00, run_duration=0.464201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=725, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:16:00.241087+00:00, queued_by_job_id=2, pid=10570 2024-06-28T01:16:04.212623041Z [2024-06-28T01:16:04.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:16:04.212978340Z [2024-06-28T01:16:04.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:15:00+00:00, run_id=scheduled__2024-06-28T01:15:00+00:00, run_start_date=2024-06-28 01:16:00.173040+00:00, run_end_date=2024-06-28 01:16:04.212544+00:00, run_duration=4.039504, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:15:00+00:00, data_interval_end=2024-06-28 01:16:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:16:04.225189484Z [2024-06-28T01:16:04.224+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:16:00+00:00, run_after=2024-06-28T01:17:00+00:00 2024-06-28T01:16:04.288699823Z [2024-06-28T01:16:04.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:15:00+00:00 exited with status success for try_number 1 2024-06-28T01:16:04.296258912Z [2024-06-28T01:16:04.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:15:00+00:00, map_index=-1, run_start_date=2024-06-28 01:16:02.440681+00:00, run_end_date=2024-06-28 01:16:03.771985+00:00, run_duration=1.331304, state=success, executor_state=success, try_number=1, max_tries=1, job_id=726, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:16:00.241087+00:00, queued_by_job_id=2, pid=10593 2024-06-28T01:16:05.358737927Z [2024-06-28T01:16:05.358+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:16:05.359139216Z [2024-06-28T01:16:05.358+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:15:00+00:00, run_id=scheduled__2024-06-28T01:15:00+00:00, run_start_date=2024-06-28 01:16:00.173963+00:00, run_end_date=2024-06-28 01:16:05.358793+00:00, run_duration=5.18483, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:15:00+00:00, data_interval_end=2024-06-28 01:16:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:16:05.369017133Z [2024-06-28T01:16:05.368+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:16:00+00:00, run_after=2024-06-28T01:17:00+00:00 2024-06-28T01:16:05.530795989Z [2024-06-28T01:16:05.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:15:00+00:00 exited with status success for try_number 1 2024-06-28T01:16:05.546769097Z [2024-06-28T01:16:05.541+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:15:00+00:00, map_index=-1, run_start_date=2024-06-28 01:16:02.586042+00:00, run_end_date=2024-06-28 01:16:04.494879+00:00, run_duration=1.908837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=727, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:16:00.241087+00:00, queued_by_job_id=2, pid=10594 2024-06-28T01:16:46.295233865Z [2024-06-28T01:16:46.294+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T01:17:00.029158431Z [2024-06-28T01:17:00.028+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:17:00.042139046Z [2024-06-28T01:17:00.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:17:00+00:00, run_after=2024-06-28T01:18:00+00:00 2024-06-28T01:17:00.054028810Z [2024-06-28T01:17:00.053+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:17:00+00:00, run_after=2024-06-28T01:18:00+00:00 2024-06-28T01:17:00.110592479Z [2024-06-28T01:17:00.110+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:17:00.110613083Z 2024-06-28T01:17:00.110618284Z 2024-06-28T01:17:00.110623286Z 2024-06-28T01:17:00.110681964Z [2024-06-28T01:17:00.110+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:17:00.110732167Z [2024-06-28T01:17:00.110+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:17:00.110858030Z [2024-06-28T01:17:00.110+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:17:00.111661751Z [2024-06-28T01:17:00.111+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:17:00.111670651Z 2024-06-28T01:17:00.111674196Z 2024-06-28T01:17:00.111677515Z 2024-06-28T01:17:00.114829232Z [2024-06-28T01:17:00.114+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:17:00.115010010Z [2024-06-28T01:17:00.114+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:17:00.115356710Z [2024-06-28T01:17:00.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:17:00.115536374Z [2024-06-28T01:17:00.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:17:00.115844760Z [2024-06-28T01:17:00.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:17:00.115928112Z [2024-06-28T01:17:00.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:17:00.443957265Z [2024-06-28T01:17:00.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:16:00+00:00 exited with status queued for try_number 1 2024-06-28T01:17:00.444013708Z [2024-06-28T01:17:00.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:16:00+00:00 exited with status queued for try_number 1 2024-06-28T01:17:00.444018705Z [2024-06-28T01:17:00.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:16:00+00:00 exited with status queued for try_number 1 2024-06-28T01:17:00.476100357Z [2024-06-28T01:17:00.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15a3c9c6-54e9-4b8e-95fc-f6ba2739686e 2024-06-28T01:17:00.476712382Z [2024-06-28T01:17:00.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to addb9641-9d66-4220-9735-54f909febf36 2024-06-28T01:17:00.477174740Z [2024-06-28T01:17:00.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to b160dc51-2d11-48bd-ab67-11ae21e9ef8c 2024-06-28T01:17:02.314824677Z [2024-06-28T01:17:02.313+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:17:02.315909294Z [2024-06-28T01:17:02.315+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:16:00+00:00, run_id=scheduled__2024-06-28T01:16:00+00:00, run_start_date=2024-06-28 01:17:00.064089+00:00, run_end_date=2024-06-28 01:17:02.314808+00:00, run_duration=2.250719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:16:00+00:00, data_interval_end=2024-06-28 01:17:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:17:02.328038568Z [2024-06-28T01:17:02.327+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:17:00+00:00, run_after=2024-06-28T01:18:00+00:00 2024-06-28T01:17:02.402503657Z [2024-06-28T01:17:02.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:16:00+00:00 exited with status success for try_number 1 2024-06-28T01:17:02.424728058Z [2024-06-28T01:17:02.424+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:16:00+00:00, map_index=-1, run_start_date=2024-06-28 01:17:00.961999+00:00, run_end_date=2024-06-28 01:17:01.354864+00:00, run_duration=0.392865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=728, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:17:00.112338+00:00, queued_by_job_id=2, pid=10626 2024-06-28T01:17:04.054567481Z [2024-06-28T01:17:04.054+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:17:04.055078226Z [2024-06-28T01:17:04.054+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:16:00+00:00, run_id=scheduled__2024-06-28T01:16:00+00:00, run_start_date=2024-06-28 01:17:00.065331+00:00, run_end_date=2024-06-28 01:17:04.054505+00:00, run_duration=3.989174, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:16:00+00:00, data_interval_end=2024-06-28 01:17:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:17:04.066416302Z [2024-06-28T01:17:04.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:17:00+00:00, run_after=2024-06-28T01:18:00+00:00 2024-06-28T01:17:04.165511927Z [2024-06-28T01:17:04.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:16:00+00:00 exited with status success for try_number 1 2024-06-28T01:17:04.173214050Z [2024-06-28T01:17:04.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:16:00+00:00, map_index=-1, run_start_date=2024-06-28 01:17:02.179838+00:00, run_end_date=2024-06-28 01:17:03.617234+00:00, run_duration=1.437396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=730, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:17:00.112338+00:00, queued_by_job_id=2, pid=10645 2024-06-28T01:17:05.251851459Z [2024-06-28T01:17:05.251+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:17:05.252049361Z [2024-06-28T01:17:05.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:16:00+00:00, run_id=scheduled__2024-06-28T01:16:00+00:00, run_start_date=2024-06-28 01:17:00.066385+00:00, run_end_date=2024-06-28 01:17:05.251799+00:00, run_duration=5.185414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:16:00+00:00, data_interval_end=2024-06-28 01:17:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:17:05.260695151Z [2024-06-28T01:17:05.260+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:17:00+00:00, run_after=2024-06-28T01:18:00+00:00 2024-06-28T01:17:05.307759545Z [2024-06-28T01:17:05.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:16:00+00:00 exited with status success for try_number 1 2024-06-28T01:17:05.318673235Z [2024-06-28T01:17:05.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:16:00+00:00, map_index=-1, run_start_date=2024-06-28 01:17:02.121344+00:00, run_end_date=2024-06-28 01:17:04.043231+00:00, run_duration=1.921887, state=success, executor_state=success, try_number=1, max_tries=1, job_id=729, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:17:00.112338+00:00, queued_by_job_id=2, pid=10644 2024-06-28T01:18:00.144654467Z [2024-06-28T01:18:00.144+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:18:00+00:00, run_after=2024-06-28T01:19:00+00:00 2024-06-28T01:18:00.160889738Z [2024-06-28T01:18:00.160+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:18:00.172927127Z [2024-06-28T01:18:00.172+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:18:00.191396530Z [2024-06-28T01:18:00.191+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:18:00+00:00, run_after=2024-06-28T01:19:00+00:00 2024-06-28T01:18:00.325959656Z [2024-06-28T01:18:00.325+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:18:00.325976681Z 2024-06-28T01:18:00.326012494Z 2024-06-28T01:18:00.326019565Z 2024-06-28T01:18:00.326025288Z 2024-06-28T01:18:00.326218846Z [2024-06-28T01:18:00.325+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:18:00.326671985Z [2024-06-28T01:18:00.326+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:18:00.327080728Z [2024-06-28T01:18:00.326+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:18:00.328004597Z [2024-06-28T01:18:00.327+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:18:00.329324795Z [2024-06-28T01:18:00.328+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:18:00.329334351Z 2024-06-28T01:18:00.329337822Z 2024-06-28T01:18:00.329341028Z 2024-06-28T01:18:00.329344838Z 2024-06-28T01:18:00.337262217Z [2024-06-28T01:18:00.336+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:18:00.337699751Z [2024-06-28T01:18:00.337+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:18:00.338319437Z [2024-06-28T01:18:00.338+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:18:00.338642151Z [2024-06-28T01:18:00.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:18:00.339416882Z [2024-06-28T01:18:00.339+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:18:00.339825264Z [2024-06-28T01:18:00.339+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:18:00.340365897Z [2024-06-28T01:18:00.340+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:18:00.340620892Z [2024-06-28T01:18:00.340+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:18:00.810237625Z [2024-06-28T01:18:00.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:16:00+00:00 exited with status queued for try_number 1 2024-06-28T01:18:00.810279187Z [2024-06-28T01:18:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:17:00+00:00 exited with status queued for try_number 1 2024-06-28T01:18:00.810437307Z [2024-06-28T01:18:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:17:00+00:00 exited with status queued for try_number 1 2024-06-28T01:18:00.810487336Z [2024-06-28T01:18:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:17:00+00:00 exited with status queued for try_number 1 2024-06-28T01:18:00.834276492Z [2024-06-28T01:18:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4c96755-9f4a-4b3d-ac8b-dee2ad3155c0 2024-06-28T01:18:00.835076640Z [2024-06-28T01:18:00.834+0000] {scheduler_job.py:635} INFO - Setting external_id for to a39e5ba0-6e20-4967-87e9-b02f34905d54 2024-06-28T01:18:00.835385109Z [2024-06-28T01:18:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to 664581a0-114d-48c9-8f60-0e3209438a64 2024-06-28T01:18:00.835567254Z [2024-06-28T01:18:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to 877b4c9e-b5a3-4938-952d-592ccb30ef65 2024-06-28T01:18:01.697866381Z [2024-06-28T01:18:01.697+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:18:01.698470054Z [2024-06-28T01:18:01.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:16:00+00:00, run_id=scheduled__2024-06-28T01:16:00+00:00, run_start_date=2024-06-28 01:18:00.209792+00:00, run_end_date=2024-06-28 01:18:01.698094+00:00, run_duration=1.488302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:16:00+00:00, data_interval_end=2024-06-28 01:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:18:01.709236630Z [2024-06-28T01:18:01.708+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:18:00+00:00, run_after=2024-06-28T01:20:00+00:00 2024-06-28T01:18:01.826156836Z [2024-06-28T01:18:01.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:16:00+00:00 exited with status success for try_number 1 2024-06-28T01:18:01.834741008Z [2024-06-28T01:18:01.834+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:16:00+00:00, map_index=-1, run_start_date=2024-06-28 01:18:01.137944+00:00, run_end_date=2024-06-28 01:18:01.580353+00:00, run_duration=0.442409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=731, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:18:00.331570+00:00, queued_by_job_id=2, pid=10673 2024-06-28T01:18:02.906164261Z [2024-06-28T01:18:02.905+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:18:02.906593929Z [2024-06-28T01:18:02.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:17:00+00:00, run_id=scheduled__2024-06-28T01:17:00+00:00, run_start_date=2024-06-28 01:18:00.212391+00:00, run_end_date=2024-06-28 01:18:02.906277+00:00, run_duration=2.693886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:17:00+00:00, data_interval_end=2024-06-28 01:18:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:18:02.938576667Z [2024-06-28T01:18:02.938+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:18:00+00:00, run_after=2024-06-28T01:19:00+00:00 2024-06-28T01:18:03.011040856Z [2024-06-28T01:18:03.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:17:00+00:00 exited with status success for try_number 1 2024-06-28T01:18:03.017012937Z [2024-06-28T01:18:03.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:17:00+00:00, map_index=-1, run_start_date=2024-06-28 01:18:01.429190+00:00, run_end_date=2024-06-28 01:18:01.894288+00:00, run_duration=0.465098, state=success, executor_state=success, try_number=1, max_tries=1, job_id=732, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:18:00.331570+00:00, queued_by_job_id=2, pid=10679 2024-06-28T01:18:05.193491673Z [2024-06-28T01:18:05.193+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:18:05.193901183Z [2024-06-28T01:18:05.193+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:17:00+00:00, run_id=scheduled__2024-06-28T01:17:00+00:00, run_start_date=2024-06-28 01:18:00.215102+00:00, run_end_date=2024-06-28 01:18:05.193565+00:00, run_duration=4.978463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:17:00+00:00, data_interval_end=2024-06-28 01:18:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:18:05.206889058Z [2024-06-28T01:18:05.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:18:00+00:00, run_after=2024-06-28T01:19:00+00:00 2024-06-28T01:18:05.215369427Z [2024-06-28T01:18:05.214+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:18:05.215716243Z [2024-06-28T01:18:05.215+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:17:00+00:00, run_id=scheduled__2024-06-28T01:17:00+00:00, run_start_date=2024-06-28 01:18:00.217967+00:00, run_end_date=2024-06-28 01:18:05.215421+00:00, run_duration=4.997454, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:17:00+00:00, data_interval_end=2024-06-28 01:18:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:18:05.232678773Z [2024-06-28T01:18:05.232+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:18:00+00:00, run_after=2024-06-28T01:19:00+00:00 2024-06-28T01:18:05.287074912Z [2024-06-28T01:18:05.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:17:00+00:00 exited with status success for try_number 1 2024-06-28T01:18:05.289207300Z [2024-06-28T01:18:05.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:17:00+00:00 exited with status success for try_number 1 2024-06-28T01:18:05.297868885Z [2024-06-28T01:18:05.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:17:00+00:00, map_index=-1, run_start_date=2024-06-28 01:18:02.699841+00:00, run_end_date=2024-06-28 01:18:04.287902+00:00, run_duration=1.588061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=733, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:18:00.331570+00:00, queued_by_job_id=2, pid=10702 2024-06-28T01:18:05.298178499Z [2024-06-28T01:18:05.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:17:00+00:00, map_index=-1, run_start_date=2024-06-28 01:18:02.797031+00:00, run_end_date=2024-06-28 01:18:05.019856+00:00, run_duration=2.222825, state=success, executor_state=success, try_number=1, max_tries=1, job_id=734, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:18:00.331570+00:00, queued_by_job_id=2, pid=10703 2024-06-28T01:19:00.998375735Z [2024-06-28T01:19:00.997+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:19:01.019178439Z [2024-06-28T01:19:01.018+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:19:00+00:00, run_after=2024-06-28T01:20:00+00:00 2024-06-28T01:19:01.036476810Z [2024-06-28T01:19:01.036+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:19:00+00:00, run_after=2024-06-28T01:20:00+00:00 2024-06-28T01:19:01.116943817Z [2024-06-28T01:19:01.116+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:19:01.116977881Z 2024-06-28T01:19:01.116984482Z 2024-06-28T01:19:01.117007127Z 2024-06-28T01:19:01.117504449Z [2024-06-28T01:19:01.117+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:19:01.118048944Z [2024-06-28T01:19:01.117+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:19:01.118564574Z [2024-06-28T01:19:01.118+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:19:01.120429923Z [2024-06-28T01:19:01.119+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:19:01.120464074Z 2024-06-28T01:19:01.120474141Z 2024-06-28T01:19:01.120482876Z 2024-06-28T01:19:01.128811046Z [2024-06-28T01:19:01.128+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:19:01.129627060Z [2024-06-28T01:19:01.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:19:01.130276192Z [2024-06-28T01:19:01.129+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:19:01.130756740Z [2024-06-28T01:19:01.130+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:19:01.131444134Z [2024-06-28T01:19:01.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:19:01.132617981Z [2024-06-28T01:19:01.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:19:01.486883705Z [2024-06-28T01:19:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:18:00+00:00 exited with status queued for try_number 1 2024-06-28T01:19:01.487380788Z [2024-06-28T01:19:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:18:00+00:00 exited with status queued for try_number 1 2024-06-28T01:19:01.487757286Z [2024-06-28T01:19:01.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:18:00+00:00 exited with status queued for try_number 1 2024-06-28T01:19:01.498053402Z [2024-06-28T01:19:01.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2817fac5-f72b-4282-8546-54f77e1c8542 2024-06-28T01:19:01.498355200Z [2024-06-28T01:19:01.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ecc0ca1-e92c-4c6e-a040-fd63b173dde8 2024-06-28T01:19:01.498564841Z [2024-06-28T01:19:01.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbaed9da-e35b-4db7-8a86-1a8b03dc684b 2024-06-28T01:19:03.346508163Z [2024-06-28T01:19:03.346+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:19:03.346738073Z [2024-06-28T01:19:03.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:18:00+00:00, run_id=scheduled__2024-06-28T01:18:00+00:00, run_start_date=2024-06-28 01:19:01.049920+00:00, run_end_date=2024-06-28 01:19:03.346414+00:00, run_duration=2.296494, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:18:00+00:00, data_interval_end=2024-06-28 01:19:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:19:03.357869834Z [2024-06-28T01:19:03.357+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:19:00+00:00, run_after=2024-06-28T01:20:00+00:00 2024-06-28T01:19:03.409032793Z [2024-06-28T01:19:03.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:18:00+00:00 exited with status success for try_number 1 2024-06-28T01:19:03.415668749Z [2024-06-28T01:19:03.414+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:18:00+00:00, map_index=-1, run_start_date=2024-06-28 01:19:02.163907+00:00, run_end_date=2024-06-28 01:19:02.649143+00:00, run_duration=0.485236, state=success, executor_state=success, try_number=1, max_tries=1, job_id=735, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:19:01.122343+00:00, queued_by_job_id=2, pid=10736 2024-06-28T01:19:05.617235995Z [2024-06-28T01:19:05.616+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:19:05.617713483Z [2024-06-28T01:19:05.617+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:18:00+00:00, run_id=scheduled__2024-06-28T01:18:00+00:00, run_start_date=2024-06-28 01:19:01.051424+00:00, run_end_date=2024-06-28 01:19:05.617141+00:00, run_duration=4.565717, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:18:00+00:00, data_interval_end=2024-06-28 01:19:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:19:05.630534319Z [2024-06-28T01:19:05.630+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:19:00+00:00, run_after=2024-06-28T01:20:00+00:00 2024-06-28T01:19:05.638287165Z [2024-06-28T01:19:05.637+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:19:05.638741711Z [2024-06-28T01:19:05.638+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:18:00+00:00, run_id=scheduled__2024-06-28T01:18:00+00:00, run_start_date=2024-06-28 01:19:01.052526+00:00, run_end_date=2024-06-28 01:19:05.638228+00:00, run_duration=4.585702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:18:00+00:00, data_interval_end=2024-06-28 01:19:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:19:05.652516649Z [2024-06-28T01:19:05.652+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:19:00+00:00, run_after=2024-06-28T01:20:00+00:00 2024-06-28T01:19:05.683984881Z [2024-06-28T01:19:05.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:18:00+00:00 exited with status success for try_number 1 2024-06-28T01:19:05.684224441Z [2024-06-28T01:19:05.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:18:00+00:00 exited with status success for try_number 1 2024-06-28T01:19:05.690119487Z [2024-06-28T01:19:05.689+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:18:00+00:00, map_index=-1, run_start_date=2024-06-28 01:19:03.189070+00:00, run_end_date=2024-06-28 01:19:04.944006+00:00, run_duration=1.754936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=737, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:19:01.122343+00:00, queued_by_job_id=2, pid=10755 2024-06-28T01:19:05.691073535Z [2024-06-28T01:19:05.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:18:00+00:00, map_index=-1, run_start_date=2024-06-28 01:19:03.113866+00:00, run_end_date=2024-06-28 01:19:04.995039+00:00, run_duration=1.881173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=736, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:19:01.122343+00:00, queued_by_job_id=2, pid=10754 2024-06-28T01:20:00.967430578Z [2024-06-28T01:20:00.966+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:20:00+00:00, run_after=2024-06-28T01:21:00+00:00 2024-06-28T01:20:00.991853799Z [2024-06-28T01:20:00.991+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:20:00+00:00, run_after=2024-06-28T01:25:00+00:00 2024-06-28T01:20:01.022125039Z [2024-06-28T01:20:01.021+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:20:00+00:00, run_after=2024-06-28T01:21:00+00:00 2024-06-28T01:20:01.034192790Z [2024-06-28T01:20:01.033+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:20:01.043409384Z [2024-06-28T01:20:01.042+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:20:01.198903052Z [2024-06-28T01:20:01.198+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-28T01:20:01.198935005Z 2024-06-28T01:20:01.198940826Z 2024-06-28T01:20:01.198946164Z 2024-06-28T01:20:01.198951430Z 2024-06-28T01:20:01.198956231Z 2024-06-28T01:20:01.199189084Z [2024-06-28T01:20:01.198+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:20:01.199623578Z [2024-06-28T01:20:01.199+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:20:01.199931525Z [2024-06-28T01:20:01.199+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:20:01.200210070Z [2024-06-28T01:20:01.200+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:20:01.200482934Z [2024-06-28T01:20:01.200+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:20:01.202220665Z [2024-06-28T01:20:01.201+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:20:01.202251908Z 2024-06-28T01:20:01.202263122Z 2024-06-28T01:20:01.202272443Z 2024-06-28T01:20:01.202280882Z 2024-06-28T01:20:01.202289332Z 2024-06-28T01:20:01.209604413Z [2024-06-28T01:20:01.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T01:20:01.209723111Z [2024-06-28T01:20:01.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:20:01.210114906Z [2024-06-28T01:20:01.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:20:01.210246405Z [2024-06-28T01:20:01.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:20:01.210519806Z [2024-06-28T01:20:01.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:20:01.210671592Z [2024-06-28T01:20:01.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:20:01.210984857Z [2024-06-28T01:20:01.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:20:01.211144791Z [2024-06-28T01:20:01.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:20:01.211462520Z [2024-06-28T01:20:01.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:20:01.211597204Z [2024-06-28T01:20:01.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:20:01.815796041Z [2024-06-28T01:20:01.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:15:00+00:00 exited with status queued for try_number 1 2024-06-28T01:20:01.816133127Z [2024-06-28T01:20:01.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:18:00+00:00 exited with status queued for try_number 1 2024-06-28T01:20:01.816372949Z [2024-06-28T01:20:01.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:19:00+00:00 exited with status queued for try_number 1 2024-06-28T01:20:01.816684383Z [2024-06-28T01:20:01.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:19:00+00:00 exited with status queued for try_number 1 2024-06-28T01:20:01.816887257Z [2024-06-28T01:20:01.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:19:00+00:00 exited with status queued for try_number 1 2024-06-28T01:20:01.838908272Z [2024-06-28T01:20:01.838+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fe39b7d-e746-4758-b95a-5db8676a4dd3 2024-06-28T01:20:01.843220506Z [2024-06-28T01:20:01.842+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4496ecd8-0de1-4941-91f3-55a695d96915 2024-06-28T01:20:01.843522294Z [2024-06-28T01:20:01.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f8b2667-21ad-4986-8a05-e4ea193e220b 2024-06-28T01:20:01.843727344Z [2024-06-28T01:20:01.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5cebaaf2-e1e8-4d7e-b841-674f9b3d41b6 2024-06-28T01:20:01.843917165Z [2024-06-28T01:20:01.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf2fd76f-f9fb-4feb-8737-75f203ea9a11 2024-06-28T01:20:03.971182648Z [2024-06-28T01:20:03.970+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:20:03.971499187Z [2024-06-28T01:20:03.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:18:00+00:00, run_id=scheduled__2024-06-28T01:18:00+00:00, run_start_date=2024-06-28 01:20:01.061161+00:00, run_end_date=2024-06-28 01:20:03.971160+00:00, run_duration=2.909999, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:18:00+00:00, data_interval_end=2024-06-28 01:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:20:03.978484799Z [2024-06-28T01:20:03.978+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:20:00+00:00, run_after=2024-06-28T01:22:00+00:00 2024-06-28T01:20:03.984262184Z [2024-06-28T01:20:03.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:20:03.984489614Z [2024-06-28T01:20:03.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:19:00+00:00, run_id=scheduled__2024-06-28T01:19:00+00:00, run_start_date=2024-06-28 01:20:01.062892+00:00, run_end_date=2024-06-28 01:20:03.984182+00:00, run_duration=2.92129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:19:00+00:00, data_interval_end=2024-06-28 01:20:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:20:03.996119236Z [2024-06-28T01:20:03.995+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:20:00+00:00, run_after=2024-06-28T01:21:00+00:00 2024-06-28T01:20:04.072506539Z [2024-06-28T01:20:04.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:18:00+00:00 exited with status success for try_number 1 2024-06-28T01:20:04.072532903Z [2024-06-28T01:20:04.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:19:00+00:00 exited with status success for try_number 1 2024-06-28T01:20:04.084754269Z [2024-06-28T01:20:04.084+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:19:00+00:00, map_index=-1, run_start_date=2024-06-28 01:20:02.449090+00:00, run_end_date=2024-06-28 01:20:03.028988+00:00, run_duration=0.579898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=738, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:20:01.204699+00:00, queued_by_job_id=2, pid=10789 2024-06-28T01:20:04.085475967Z [2024-06-28T01:20:04.084+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:18:00+00:00, map_index=-1, run_start_date=2024-06-28 01:20:02.554843+00:00, run_end_date=2024-06-28 01:20:03.182454+00:00, run_duration=0.627611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=739, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:20:01.204699+00:00, queued_by_job_id=2, pid=10790 2024-06-28T01:20:05.256399669Z [2024-06-28T01:20:05.256+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:20:05.256416276Z 2024-06-28T01:20:05.256897540Z [2024-06-28T01:20:05.256+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:20:05.257929445Z [2024-06-28T01:20:05.257+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:20:05.257938376Z 2024-06-28T01:20:05.261113843Z [2024-06-28T01:20:05.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T01:20:05.261270472Z [2024-06-28T01:20:05.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:20:05.330948977Z [2024-06-28T01:20:05.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:15:00+00:00 exited with status queued for try_number 1 2024-06-28T01:20:05.331186918Z [2024-06-28T01:20:05.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:15:00+00:00 exited with status success for try_number 1 2024-06-28T01:20:05.340673948Z [2024-06-28T01:20:05.340+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb5d610d-8140-49af-8845-53508dbd1db3 2024-06-28T01:20:05.341455759Z [2024-06-28T01:20:05.341+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T01:15:00+00:00, map_index=-1, run_start_date=2024-06-28 01:20:04.035125+00:00, run_end_date=2024-06-28 01:20:04.644192+00:00, run_duration=0.609067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=741, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:20:01.204699+00:00, queued_by_job_id=2, pid=10825 2024-06-28T01:20:05.410234998Z [2024-06-28T01:20:05.409+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:20:05.410574603Z [2024-06-28T01:20:05.410+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:19:00+00:00, run_id=scheduled__2024-06-28T01:19:00+00:00, run_start_date=2024-06-28 01:20:01.064573+00:00, run_end_date=2024-06-28 01:20:05.410152+00:00, run_duration=4.345579, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:19:00+00:00, data_interval_end=2024-06-28 01:20:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:20:05.420078900Z [2024-06-28T01:20:05.419+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:20:00+00:00, run_after=2024-06-28T01:21:00+00:00 2024-06-28T01:20:06.609249612Z [2024-06-28T01:20:06.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:19:00+00:00 exited with status success for try_number 1 2024-06-28T01:20:06.618301482Z [2024-06-28T01:20:06.617+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:19:00+00:00, map_index=-1, run_start_date=2024-06-28 01:20:03.632374+00:00, run_end_date=2024-06-28 01:20:05.208022+00:00, run_duration=1.575648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=740, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:20:01.204699+00:00, queued_by_job_id=2, pid=10809 2024-06-28T01:20:07.690356554Z [2024-06-28T01:20:07.689+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:20:07.691154613Z [2024-06-28T01:20:07.690+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:19:00+00:00, run_id=scheduled__2024-06-28T01:19:00+00:00, run_start_date=2024-06-28 01:20:01.066188+00:00, run_end_date=2024-06-28 01:20:07.690326+00:00, run_duration=6.624138, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:19:00+00:00, data_interval_end=2024-06-28 01:20:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:20:07.712046257Z [2024-06-28T01:20:07.711+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:20:00+00:00, run_after=2024-06-28T01:21:00+00:00 2024-06-28T01:20:07.769414847Z [2024-06-28T01:20:07.769+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:20:07.769425483Z 2024-06-28T01:20:07.770020883Z [2024-06-28T01:20:07.769+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:20:07.771048205Z [2024-06-28T01:20:07.770+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:20:07.771061027Z 2024-06-28T01:20:07.779396273Z [2024-06-28T01:20:07.779+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T01:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T01:20:07.779623277Z [2024-06-28T01:20:07.779+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T01:20:07.874780070Z [2024-06-28T01:20:07.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:15:00+00:00 exited with status queued for try_number 1 2024-06-28T01:20:07.875030867Z [2024-06-28T01:20:07.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:19:00+00:00 exited with status success for try_number 1 2024-06-28T01:20:07.875203295Z [2024-06-28T01:20:07.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:15:00+00:00 exited with status success for try_number 1 2024-06-28T01:20:07.882410317Z [2024-06-28T01:20:07.882+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T01:15:00+00:00, map_index=-1, run_start_date=2024-06-28 01:20:07.171913+00:00, run_end_date=2024-06-28 01:20:07.620190+00:00, run_duration=0.448277, state=success, executor_state=success, try_number=1, max_tries=1, job_id=743, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:20:05.258375+00:00, queued_by_job_id=2, pid=10844 2024-06-28T01:20:07.883634730Z [2024-06-28T01:20:07.883+0000] {scheduler_job.py:635} INFO - Setting external_id for to 539c46db-b9fe-4174-8490-15eeda1456fc 2024-06-28T01:20:07.884610080Z [2024-06-28T01:20:07.884+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:19:00+00:00, map_index=-1, run_start_date=2024-06-28 01:20:04.508803+00:00, run_end_date=2024-06-28 01:20:06.716514+00:00, run_duration=2.207711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=742, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:20:01.204699+00:00, queued_by_job_id=2, pid=10831 2024-06-28T01:20:10.851416677Z [2024-06-28T01:20:10.851+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:20:10.851439596Z 2024-06-28T01:20:10.851536923Z [2024-06-28T01:20:10.851+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:20:10.852436021Z [2024-06-28T01:20:10.852+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:20:10.852459782Z 2024-06-28T01:20:10.854868906Z [2024-06-28T01:20:10.854+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:20:10.855016121Z [2024-06-28T01:20:10.854+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:20:10.929587452Z [2024-06-28T01:20:10.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:15:00+00:00 exited with status queued for try_number 1 2024-06-28T01:20:10.929851081Z [2024-06-28T01:20:10.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:15:00+00:00 exited with status success for try_number 1 2024-06-28T01:20:10.949884227Z [2024-06-28T01:20:10.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84c7b50c-0725-4601-ba07-d7334a49edac 2024-06-28T01:20:10.950404769Z [2024-06-28T01:20:10.949+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T01:15:00+00:00, map_index=0, run_start_date=2024-06-28 01:20:09.406523+00:00, run_end_date=2024-06-28 01:20:09.725744+00:00, run_duration=0.319221, state=success, executor_state=success, try_number=1, max_tries=1, job_id=744, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:20:07.771311+00:00, queued_by_job_id=2, pid=10852 2024-06-28T01:20:14.109580063Z [2024-06-28T01:20:14.108+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:20:14.110088792Z [2024-06-28T01:20:14.109+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:15:00+00:00, run_id=scheduled__2024-06-28T01:15:00+00:00, run_start_date=2024-06-28 01:20:01.058636+00:00, run_end_date=2024-06-28 01:20:14.109450+00:00, run_duration=13.050814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:15:00+00:00, data_interval_end=2024-06-28 01:20:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T01:20:14.120726701Z [2024-06-28T01:20:14.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:20:00+00:00, run_after=2024-06-28T01:25:00+00:00 2024-06-28T01:20:14.161780850Z [2024-06-28T01:20:14.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:15:00+00:00 exited with status success for try_number 1 2024-06-28T01:20:14.173894453Z [2024-06-28T01:20:14.173+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T01:15:00+00:00, map_index=-1, run_start_date=2024-06-28 01:20:12.586128+00:00, run_end_date=2024-06-28 01:20:13.022942+00:00, run_duration=0.436814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=745, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:20:10.853001+00:00, queued_by_job_id=2, pid=10860 2024-06-28T01:21:00.973831024Z [2024-06-28T01:21:00.973+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:21:01.005795175Z [2024-06-28T01:21:01.005+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:21:00+00:00, run_after=2024-06-28T01:22:00+00:00 2024-06-28T01:21:01.035671473Z [2024-06-28T01:21:01.035+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:21:00+00:00, run_after=2024-06-28T01:22:00+00:00 2024-06-28T01:21:01.120838236Z [2024-06-28T01:21:01.120+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:21:01.120902531Z 2024-06-28T01:21:01.120923419Z 2024-06-28T01:21:01.120926865Z 2024-06-28T01:21:01.121180850Z [2024-06-28T01:21:01.121+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:21:01.121394061Z [2024-06-28T01:21:01.121+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:21:01.121624148Z [2024-06-28T01:21:01.121+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:21:01.122244849Z [2024-06-28T01:21:01.122+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:21:01.122257562Z 2024-06-28T01:21:01.122261063Z 2024-06-28T01:21:01.122264251Z 2024-06-28T01:21:01.125429736Z [2024-06-28T01:21:01.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:21:01.125691949Z [2024-06-28T01:21:01.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:21:01.126040033Z [2024-06-28T01:21:01.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:21:01.126257845Z [2024-06-28T01:21:01.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:21:01.126563989Z [2024-06-28T01:21:01.126+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:21:01.126791557Z [2024-06-28T01:21:01.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:21:01.498517018Z [2024-06-28T01:21:01.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status queued for try_number 1 2024-06-28T01:21:01.498538701Z [2024-06-28T01:21:01.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status queued for try_number 1 2024-06-28T01:21:01.498612453Z [2024-06-28T01:21:01.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status queued for try_number 1 2024-06-28T01:21:01.516095707Z [2024-06-28T01:21:01.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f1807ef-4eed-40f7-a7dd-0c757b8c5057 2024-06-28T01:21:01.518956908Z [2024-06-28T01:21:01.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c7b46b4-e449-4299-bc82-f674c4e48e71 2024-06-28T01:21:01.519170271Z [2024-06-28T01:21:01.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to d25611de-6318-43d3-accf-c7c063d3baf2 2024-06-28T01:21:03.390901610Z [2024-06-28T01:21:03.390+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:21:03.391383410Z [2024-06-28T01:21:03.391+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:20:00+00:00, run_id=scheduled__2024-06-28T01:20:00+00:00, run_start_date=2024-06-28 01:21:01.054013+00:00, run_end_date=2024-06-28 01:21:03.390775+00:00, run_duration=2.336762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:20:00+00:00, data_interval_end=2024-06-28 01:21:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:21:03.402973486Z [2024-06-28T01:21:03.402+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:21:00+00:00, run_after=2024-06-28T01:22:00+00:00 2024-06-28T01:21:03.491079138Z [2024-06-28T01:21:03.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status success for try_number 1 2024-06-28T01:21:03.496323533Z [2024-06-28T01:21:03.496+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:20:00+00:00, map_index=-1, run_start_date=2024-06-28 01:21:02.490792+00:00, run_end_date=2024-06-28 01:21:03.033275+00:00, run_duration=0.542483, state=success, executor_state=success, try_number=1, max_tries=1, job_id=746, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:21:01.123080+00:00, queued_by_job_id=2, pid=10881 2024-06-28T01:21:06.243248695Z [2024-06-28T01:21:06.242+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:21:06.243759638Z [2024-06-28T01:21:06.243+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:20:00+00:00, run_id=scheduled__2024-06-28T01:20:00+00:00, run_start_date=2024-06-28 01:21:01.055673+00:00, run_end_date=2024-06-28 01:21:06.243051+00:00, run_duration=5.187378, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:20:00+00:00, data_interval_end=2024-06-28 01:21:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:21:06.258927345Z [2024-06-28T01:21:06.256+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:21:00+00:00, run_after=2024-06-28T01:22:00+00:00 2024-06-28T01:21:06.273016906Z [2024-06-28T01:21:06.272+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:21:06.273386243Z [2024-06-28T01:21:06.273+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:20:00+00:00, run_id=scheduled__2024-06-28T01:20:00+00:00, run_start_date=2024-06-28 01:21:01.056817+00:00, run_end_date=2024-06-28 01:21:06.273065+00:00, run_duration=5.216248, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:20:00+00:00, data_interval_end=2024-06-28 01:21:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:21:06.286605518Z [2024-06-28T01:21:06.286+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:21:00+00:00, run_after=2024-06-28T01:22:00+00:00 2024-06-28T01:21:06.327535298Z [2024-06-28T01:21:06.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status success for try_number 1 2024-06-28T01:21:06.327916816Z [2024-06-28T01:21:06.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status success for try_number 1 2024-06-28T01:21:06.340209139Z [2024-06-28T01:21:06.339+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:20:00+00:00, map_index=-1, run_start_date=2024-06-28 01:21:03.677006+00:00, run_end_date=2024-06-28 01:21:05.186658+00:00, run_duration=1.509652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=748, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:21:01.123080+00:00, queued_by_job_id=2, pid=10900 2024-06-28T01:21:06.340750875Z [2024-06-28T01:21:06.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:20:00+00:00, map_index=-1, run_start_date=2024-06-28 01:21:03.644283+00:00, run_end_date=2024-06-28 01:21:05.330089+00:00, run_duration=1.685806, state=success, executor_state=success, try_number=1, max_tries=1, job_id=747, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:21:01.123080+00:00, queued_by_job_id=2, pid=10899 2024-06-28T01:21:46.371384400Z [2024-06-28T01:21:46.370+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T01:22:01.042302921Z [2024-06-28T01:22:01.041+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:22:01.064925283Z [2024-06-28T01:22:01.064+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:22:00+00:00, run_after=2024-06-28T01:23:00+00:00 2024-06-28T01:22:01.090939186Z [2024-06-28T01:22:01.090+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:22:00+00:00, run_after=2024-06-28T01:23:00+00:00 2024-06-28T01:22:01.103873202Z [2024-06-28T01:22:01.103+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:22:01.200283417Z [2024-06-28T01:22:01.199+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:22:01.200363354Z 2024-06-28T01:22:01.200370537Z 2024-06-28T01:22:01.200375832Z 2024-06-28T01:22:01.200380442Z 2024-06-28T01:22:01.200388374Z [2024-06-28T01:22:01.200+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:22:01.200426234Z [2024-06-28T01:22:01.200+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:22:01.200431196Z [2024-06-28T01:22:01.200+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:22:01.200493845Z [2024-06-28T01:22:01.200+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:22:01.201129479Z [2024-06-28T01:22:01.200+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:22:01.201145529Z 2024-06-28T01:22:01.201151478Z 2024-06-28T01:22:01.201155876Z 2024-06-28T01:22:01.201160460Z 2024-06-28T01:22:01.204923766Z [2024-06-28T01:22:01.204+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:22:01.205039944Z [2024-06-28T01:22:01.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:22:01.205188738Z [2024-06-28T01:22:01.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:22:01.205237729Z [2024-06-28T01:22:01.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:22:01.205419842Z [2024-06-28T01:22:01.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:22:01.205467331Z [2024-06-28T01:22:01.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:22:01.205652410Z [2024-06-28T01:22:01.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:22:01.205709677Z [2024-06-28T01:22:01.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:22:01.598741385Z [2024-06-28T01:22:01.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status queued for try_number 1 2024-06-28T01:22:01.598929597Z [2024-06-28T01:22:01.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:21:00+00:00 exited with status queued for try_number 1 2024-06-28T01:22:01.599089260Z [2024-06-28T01:22:01.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:21:00+00:00 exited with status queued for try_number 1 2024-06-28T01:22:01.599426402Z [2024-06-28T01:22:01.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:21:00+00:00 exited with status queued for try_number 1 2024-06-28T01:22:01.613638686Z [2024-06-28T01:22:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae805d42-5562-4203-9da4-4d43cdf4efb9 2024-06-28T01:22:01.613856009Z [2024-06-28T01:22:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to abc9238a-87a5-4426-8e57-1e7800e81c17 2024-06-28T01:22:01.614035021Z [2024-06-28T01:22:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d80e408-f008-466f-92ec-0188fdec0d04 2024-06-28T01:22:01.614201680Z [2024-06-28T01:22:01.614+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e6fb6b8-e7c0-46f1-b650-923f5fa20f6c 2024-06-28T01:22:02.828967480Z [2024-06-28T01:22:02.828+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:22:02.829351969Z [2024-06-28T01:22:02.829+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:20:00+00:00, run_id=scheduled__2024-06-28T01:20:00+00:00, run_start_date=2024-06-28 01:22:01.120975+00:00, run_end_date=2024-06-28 01:22:02.828961+00:00, run_duration=1.707986, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:20:00+00:00, data_interval_end=2024-06-28 01:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:22:02.851742641Z [2024-06-28T01:22:02.851+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:22:00+00:00, run_after=2024-06-28T01:24:00+00:00 2024-06-28T01:22:02.975238669Z [2024-06-28T01:22:02.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status success for try_number 1 2024-06-28T01:22:02.987359373Z [2024-06-28T01:22:02.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:20:00+00:00, map_index=-1, run_start_date=2024-06-28 01:22:02.139127+00:00, run_end_date=2024-06-28 01:22:02.663599+00:00, run_duration=0.524472, state=success, executor_state=success, try_number=1, max_tries=1, job_id=749, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:22:01.201924+00:00, queued_by_job_id=2, pid=10932 2024-06-28T01:22:03.946302761Z [2024-06-28T01:22:03.945+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:22:03.947068538Z [2024-06-28T01:22:03.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:21:00+00:00, run_id=scheduled__2024-06-28T01:21:00+00:00, run_start_date=2024-06-28 01:22:01.123802+00:00, run_end_date=2024-06-28 01:22:03.946368+00:00, run_duration=2.822566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:21:00+00:00, data_interval_end=2024-06-28 01:22:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:22:03.965166366Z [2024-06-28T01:22:03.964+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:22:00+00:00, run_after=2024-06-28T01:23:00+00:00 2024-06-28T01:22:04.021159227Z [2024-06-28T01:22:04.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:21:00+00:00 exited with status success for try_number 1 2024-06-28T01:22:04.028915104Z [2024-06-28T01:22:04.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:21:00+00:00, map_index=-1, run_start_date=2024-06-28 01:22:02.257880+00:00, run_end_date=2024-06-28 01:22:02.847949+00:00, run_duration=0.590069, state=success, executor_state=success, try_number=1, max_tries=1, job_id=750, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:22:01.201924+00:00, queued_by_job_id=2, pid=10933 2024-06-28T01:22:06.203185282Z [2024-06-28T01:22:06.202+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:22:06.203636834Z [2024-06-28T01:22:06.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:21:00+00:00, run_id=scheduled__2024-06-28T01:21:00+00:00, run_start_date=2024-06-28 01:22:01.127044+00:00, run_end_date=2024-06-28 01:22:06.203225+00:00, run_duration=5.076181, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:21:00+00:00, data_interval_end=2024-06-28 01:22:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:22:06.216292948Z [2024-06-28T01:22:06.216+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:22:00+00:00, run_after=2024-06-28T01:23:00+00:00 2024-06-28T01:22:06.284741827Z [2024-06-28T01:22:06.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:21:00+00:00 exited with status success for try_number 1 2024-06-28T01:22:06.291532832Z [2024-06-28T01:22:06.291+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:21:00+00:00, map_index=-1, run_start_date=2024-06-28 01:22:03.920758+00:00, run_end_date=2024-06-28 01:22:05.996711+00:00, run_duration=2.075953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=751, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:22:01.201924+00:00, queued_by_job_id=2, pid=10956 2024-06-28T01:22:08.456221078Z [2024-06-28T01:22:08.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:22:08.456651364Z [2024-06-28T01:22:08.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:21:00+00:00, run_id=scheduled__2024-06-28T01:21:00+00:00, run_start_date=2024-06-28 01:22:01.125629+00:00, run_end_date=2024-06-28 01:22:08.456079+00:00, run_duration=7.33045, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:21:00+00:00, data_interval_end=2024-06-28 01:22:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:22:08.478435747Z [2024-06-28T01:22:08.478+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:22:00+00:00, run_after=2024-06-28T01:23:00+00:00 2024-06-28T01:22:08.514630626Z [2024-06-28T01:22:08.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:21:00+00:00 exited with status success for try_number 1 2024-06-28T01:22:08.520643042Z [2024-06-28T01:22:08.520+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:21:00+00:00, map_index=-1, run_start_date=2024-06-28 01:22:04.374620+00:00, run_end_date=2024-06-28 01:22:07.557515+00:00, run_duration=3.182895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=752, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:22:01.201924+00:00, queued_by_job_id=2, pid=10957 2024-06-28T01:23:00.148131520Z [2024-06-28T01:23:00.146+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:23:00.175109041Z [2024-06-28T01:23:00.174+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:23:00+00:00, run_after=2024-06-28T01:24:00+00:00 2024-06-28T01:23:00.205560286Z [2024-06-28T01:23:00.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:23:00+00:00, run_after=2024-06-28T01:24:00+00:00 2024-06-28T01:23:00.313136104Z [2024-06-28T01:23:00.312+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:23:00.313151721Z 2024-06-28T01:23:00.313169978Z 2024-06-28T01:23:00.313173607Z 2024-06-28T01:23:00.313392468Z [2024-06-28T01:23:00.313+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:23:00.313535587Z [2024-06-28T01:23:00.313+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:23:00.313714891Z [2024-06-28T01:23:00.313+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:23:00.314751003Z [2024-06-28T01:23:00.314+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:23:00.314764391Z 2024-06-28T01:23:00.314767945Z 2024-06-28T01:23:00.314771081Z 2024-06-28T01:23:00.319316215Z [2024-06-28T01:23:00.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:23:00.319535680Z [2024-06-28T01:23:00.319+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:23:00.319866902Z [2024-06-28T01:23:00.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:23:00.320076902Z [2024-06-28T01:23:00.319+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:23:00.320541025Z [2024-06-28T01:23:00.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:23:00.320706243Z [2024-06-28T01:23:00.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:23:00.590177126Z [2024-06-28T01:23:00.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:22:00+00:00 exited with status queued for try_number 1 2024-06-28T01:23:00.590786943Z [2024-06-28T01:23:00.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:22:00+00:00 exited with status queued for try_number 1 2024-06-28T01:23:00.590914666Z [2024-06-28T01:23:00.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:22:00+00:00 exited with status queued for try_number 1 2024-06-28T01:23:00.603286075Z [2024-06-28T01:23:00.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51041306-5692-4f74-a520-e7f2dd6b939f 2024-06-28T01:23:00.603663969Z [2024-06-28T01:23:00.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fe0c800-3826-4356-bc3b-3cd02551a47b 2024-06-28T01:23:00.603849179Z [2024-06-28T01:23:00.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4ceb17d-7b35-4d34-b419-f91a1b73a49e 2024-06-28T01:23:02.243723959Z [2024-06-28T01:23:02.243+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:23:02.244351036Z [2024-06-28T01:23:02.244+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:22:00+00:00, run_id=scheduled__2024-06-28T01:22:00+00:00, run_start_date=2024-06-28 01:23:00.227881+00:00, run_end_date=2024-06-28 01:23:02.243826+00:00, run_duration=2.015945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:22:00+00:00, data_interval_end=2024-06-28 01:23:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:23:02.257465420Z [2024-06-28T01:23:02.257+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:23:00+00:00, run_after=2024-06-28T01:24:00+00:00 2024-06-28T01:23:03.424869475Z [2024-06-28T01:23:03.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:22:00+00:00 exited with status success for try_number 1 2024-06-28T01:23:03.430037995Z [2024-06-28T01:23:03.429+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:22:00+00:00, map_index=-1, run_start_date=2024-06-28 01:23:01.618561+00:00, run_end_date=2024-06-28 01:23:02.146297+00:00, run_duration=0.527736, state=success, executor_state=success, try_number=1, max_tries=1, job_id=753, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:23:00.316367+00:00, queued_by_job_id=2, pid=10990 2024-06-28T01:23:04.463711717Z [2024-06-28T01:23:04.463+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:23:04.464324918Z [2024-06-28T01:23:04.463+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:22:00+00:00, run_id=scheduled__2024-06-28T01:22:00+00:00, run_start_date=2024-06-28 01:23:00.229361+00:00, run_end_date=2024-06-28 01:23:04.463770+00:00, run_duration=4.234409, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:22:00+00:00, data_interval_end=2024-06-28 01:23:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:23:04.484617661Z [2024-06-28T01:23:04.484+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:23:00+00:00, run_after=2024-06-28T01:24:00+00:00 2024-06-28T01:23:04.554766904Z [2024-06-28T01:23:04.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:22:00+00:00 exited with status success for try_number 1 2024-06-28T01:23:04.571563735Z [2024-06-28T01:23:04.571+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:22:00+00:00, map_index=-1, run_start_date=2024-06-28 01:23:02.626552+00:00, run_end_date=2024-06-28 01:23:04.024499+00:00, run_duration=1.397947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=754, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:23:00.316367+00:00, queued_by_job_id=2, pid=11008 2024-06-28T01:23:05.645552954Z [2024-06-28T01:23:05.645+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:23:05.645704976Z [2024-06-28T01:23:05.645+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:22:00+00:00, run_id=scheduled__2024-06-28T01:22:00+00:00, run_start_date=2024-06-28 01:23:00.231092+00:00, run_end_date=2024-06-28 01:23:05.645489+00:00, run_duration=5.414397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:22:00+00:00, data_interval_end=2024-06-28 01:23:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:23:05.656558003Z [2024-06-28T01:23:05.655+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:23:00+00:00, run_after=2024-06-28T01:24:00+00:00 2024-06-28T01:23:05.715530028Z [2024-06-28T01:23:05.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:22:00+00:00 exited with status success for try_number 1 2024-06-28T01:23:05.722193806Z [2024-06-28T01:23:05.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:22:00+00:00, map_index=-1, run_start_date=2024-06-28 01:23:02.678888+00:00, run_end_date=2024-06-28 01:23:04.483115+00:00, run_duration=1.804227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=755, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:23:00.316367+00:00, queued_by_job_id=2, pid=11009 2024-06-28T01:24:00.176970968Z [2024-06-28T01:24:00.176+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:24:00+00:00, run_after=2024-06-28T01:25:00+00:00 2024-06-28T01:24:00.191886609Z [2024-06-28T01:24:00.191+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:24:00+00:00, run_after=2024-06-28T01:25:00+00:00 2024-06-28T01:24:00.214215687Z [2024-06-28T01:24:00.213+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:24:00.222251618Z [2024-06-28T01:24:00.221+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:24:00.325034942Z [2024-06-28T01:24:00.324+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:24:00.325054809Z 2024-06-28T01:24:00.325061014Z 2024-06-28T01:24:00.325066262Z 2024-06-28T01:24:00.325071352Z 2024-06-28T01:24:00.325355552Z [2024-06-28T01:24:00.325+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:24:00.325710876Z [2024-06-28T01:24:00.325+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:24:00.325896695Z [2024-06-28T01:24:00.325+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:24:00.326016367Z [2024-06-28T01:24:00.325+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:24:00.326922760Z [2024-06-28T01:24:00.326+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:24:00.326940341Z 2024-06-28T01:24:00.326946383Z 2024-06-28T01:24:00.326951949Z 2024-06-28T01:24:00.326957053Z 2024-06-28T01:24:00.333004016Z [2024-06-28T01:24:00.332+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:24:00.333136633Z [2024-06-28T01:24:00.332+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:24:00.333477255Z [2024-06-28T01:24:00.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:24:00.334910595Z [2024-06-28T01:24:00.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:24:00.335203629Z [2024-06-28T01:24:00.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:24:00.335399907Z [2024-06-28T01:24:00.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:24:00.335711453Z [2024-06-28T01:24:00.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:24:00.335952613Z [2024-06-28T01:24:00.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:24:00.710481838Z [2024-06-28T01:24:00.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:22:00+00:00 exited with status queued for try_number 1 2024-06-28T01:24:00.715074945Z [2024-06-28T01:24:00.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:23:00+00:00 exited with status queued for try_number 1 2024-06-28T01:24:00.715273911Z [2024-06-28T01:24:00.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:23:00+00:00 exited with status queued for try_number 1 2024-06-28T01:24:00.715518875Z [2024-06-28T01:24:00.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:23:00+00:00 exited with status queued for try_number 1 2024-06-28T01:24:00.731626958Z [2024-06-28T01:24:00.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed4cffe5-26a7-4949-8764-c5fceba789cb 2024-06-28T01:24:00.732422080Z [2024-06-28T01:24:00.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65406fa8-8bf5-476c-b5cb-e83e390f2c6e 2024-06-28T01:24:00.732629124Z [2024-06-28T01:24:00.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to cddf37c3-29af-48ff-b927-e10f99afb3cc 2024-06-28T01:24:00.732843283Z [2024-06-28T01:24:00.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3407ec37-99b4-482a-8ce0-8d7b70aaaf50 2024-06-28T01:24:02.078920045Z [2024-06-28T01:24:02.078+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:24:02.079373718Z [2024-06-28T01:24:02.079+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:23:00+00:00, run_id=scheduled__2024-06-28T01:23:00+00:00, run_start_date=2024-06-28 01:24:00.236022+00:00, run_end_date=2024-06-28 01:24:02.078862+00:00, run_duration=1.84284, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:23:00+00:00, data_interval_end=2024-06-28 01:24:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:24:02.092702505Z [2024-06-28T01:24:02.092+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:24:00+00:00, run_after=2024-06-28T01:25:00+00:00 2024-06-28T01:24:02.189710424Z [2024-06-28T01:24:02.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:23:00+00:00 exited with status success for try_number 1 2024-06-28T01:24:02.203913284Z [2024-06-28T01:24:02.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:23:00+00:00, map_index=-1, run_start_date=2024-06-28 01:24:01.488731+00:00, run_end_date=2024-06-28 01:24:01.961463+00:00, run_duration=0.472732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=756, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:24:00.328323+00:00, queued_by_job_id=2, pid=11042 2024-06-28T01:24:03.291882665Z [2024-06-28T01:24:03.291+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:24:03.292671207Z [2024-06-28T01:24:03.292+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:22:00+00:00, run_id=scheduled__2024-06-28T01:22:00+00:00, run_start_date=2024-06-28 01:24:00.234441+00:00, run_end_date=2024-06-28 01:24:03.292359+00:00, run_duration=3.057918, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:22:00+00:00, data_interval_end=2024-06-28 01:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:24:03.304413841Z [2024-06-28T01:24:03.304+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:24:00+00:00, run_after=2024-06-28T01:26:00+00:00 2024-06-28T01:24:03.364935009Z [2024-06-28T01:24:03.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:22:00+00:00 exited with status success for try_number 1 2024-06-28T01:24:03.372058354Z [2024-06-28T01:24:03.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:22:00+00:00, map_index=-1, run_start_date=2024-06-28 01:24:01.599892+00:00, run_end_date=2024-06-28 01:24:02.078674+00:00, run_duration=0.478782, state=success, executor_state=success, try_number=1, max_tries=1, job_id=757, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:24:00.328323+00:00, queued_by_job_id=2, pid=11043 2024-06-28T01:24:04.446515813Z [2024-06-28T01:24:04.446+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:24:04.447175994Z [2024-06-28T01:24:04.446+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:23:00+00:00, run_id=scheduled__2024-06-28T01:23:00+00:00, run_start_date=2024-06-28 01:24:00.237458+00:00, run_end_date=2024-06-28 01:24:04.446451+00:00, run_duration=4.208993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:23:00+00:00, data_interval_end=2024-06-28 01:24:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:24:04.462461689Z [2024-06-28T01:24:04.461+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:24:00+00:00, run_after=2024-06-28T01:25:00+00:00 2024-06-28T01:24:04.507592049Z [2024-06-28T01:24:04.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:23:00+00:00 exited with status success for try_number 1 2024-06-28T01:24:04.512258905Z [2024-06-28T01:24:04.511+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:23:00+00:00, map_index=-1, run_start_date=2024-06-28 01:24:02.816646+00:00, run_end_date=2024-06-28 01:24:04.162905+00:00, run_duration=1.346259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=758, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:24:00.328323+00:00, queued_by_job_id=2, pid=11066 2024-06-28T01:24:04.982164965Z [2024-06-28T01:24:04.981+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:24:04.982435007Z [2024-06-28T01:24:04.982+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:23:00+00:00, run_id=scheduled__2024-06-28T01:23:00+00:00, run_start_date=2024-06-28 01:24:00.238762+00:00, run_end_date=2024-06-28 01:24:04.982064+00:00, run_duration=4.743302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:23:00+00:00, data_interval_end=2024-06-28 01:24:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:24:04.990728553Z [2024-06-28T01:24:04.990+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:24:00+00:00, run_after=2024-06-28T01:25:00+00:00 2024-06-28T01:24:06.119351792Z [2024-06-28T01:24:06.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:23:00+00:00 exited with status success for try_number 1 2024-06-28T01:24:06.126525695Z [2024-06-28T01:24:06.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:23:00+00:00, map_index=-1, run_start_date=2024-06-28 01:24:03.027840+00:00, run_end_date=2024-06-28 01:24:04.878046+00:00, run_duration=1.850206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=759, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:24:00.328323+00:00, queued_by_job_id=2, pid=11067 2024-06-28T01:25:00.249156542Z [2024-06-28T01:25:00.248+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:25:00+00:00, run_after=2024-06-28T01:26:00+00:00 2024-06-28T01:25:00.257220187Z [2024-06-28T01:25:00.256+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:25:00.272634809Z [2024-06-28T01:25:00.272+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:25:00+00:00, run_after=2024-06-28T01:30:00+00:00 2024-06-28T01:25:00.296805266Z [2024-06-28T01:25:00.296+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:25:00+00:00, run_after=2024-06-28T01:26:00+00:00 2024-06-28T01:25:00.428410398Z [2024-06-28T01:25:00.427+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:25:00.428449949Z 2024-06-28T01:25:00.428459275Z 2024-06-28T01:25:00.428503424Z 2024-06-28T01:25:00.428511320Z 2024-06-28T01:25:00.428536166Z [2024-06-28T01:25:00.428+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:25:00.428552073Z [2024-06-28T01:25:00.428+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:25:00.428917520Z [2024-06-28T01:25:00.428+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:25:00.429106038Z [2024-06-28T01:25:00.428+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:25:00.430138557Z [2024-06-28T01:25:00.429+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:25:00.430159268Z 2024-06-28T01:25:00.430164183Z 2024-06-28T01:25:00.430168815Z 2024-06-28T01:25:00.430172783Z 2024-06-28T01:25:00.435411645Z [2024-06-28T01:25:00.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T01:25:00.435591732Z [2024-06-28T01:25:00.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:25:00.435949684Z [2024-06-28T01:25:00.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:25:00.436163681Z [2024-06-28T01:25:00.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:25:00.436549903Z [2024-06-28T01:25:00.436+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:25:00.436722199Z [2024-06-28T01:25:00.436+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:25:00.437122585Z [2024-06-28T01:25:00.436+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:25:00.437337452Z [2024-06-28T01:25:00.437+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:25:00.887976752Z [2024-06-28T01:25:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status queued for try_number 1 2024-06-28T01:25:00.888183499Z [2024-06-28T01:25:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:24:00+00:00 exited with status queued for try_number 1 2024-06-28T01:25:00.888417605Z [2024-06-28T01:25:00.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:24:00+00:00 exited with status queued for try_number 1 2024-06-28T01:25:00.888561022Z [2024-06-28T01:25:00.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:24:00+00:00 exited with status queued for try_number 1 2024-06-28T01:25:00.940410784Z [2024-06-28T01:25:00.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c3082e2-2a0b-448b-b9cf-1ea71c4dcae7 2024-06-28T01:25:00.940724753Z [2024-06-28T01:25:00.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7ec6ecd-16d6-44c8-8e25-85ae0f4231de 2024-06-28T01:25:00.940872750Z [2024-06-28T01:25:00.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43db31e2-59b9-442d-ae68-65f5d130a746 2024-06-28T01:25:00.940959274Z [2024-06-28T01:25:00.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to a70fda4a-219a-44bb-8103-f0ea2971e400 2024-06-28T01:25:02.156708864Z [2024-06-28T01:25:02.156+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:25:02.157177659Z [2024-06-28T01:25:02.156+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:24:00+00:00, run_id=scheduled__2024-06-28T01:24:00+00:00, run_start_date=2024-06-28 01:25:00.315371+00:00, run_end_date=2024-06-28 01:25:02.156622+00:00, run_duration=1.841251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:24:00+00:00, data_interval_end=2024-06-28 01:25:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:25:02.176467250Z [2024-06-28T01:25:02.176+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:25:00+00:00, run_after=2024-06-28T01:26:00+00:00 2024-06-28T01:25:02.271675175Z [2024-06-28T01:25:02.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:24:00+00:00 exited with status success for try_number 1 2024-06-28T01:25:02.283619382Z [2024-06-28T01:25:02.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:24:00+00:00, map_index=-1, run_start_date=2024-06-28 01:25:01.320324+00:00, run_end_date=2024-06-28 01:25:01.880932+00:00, run_duration=0.560608, state=success, executor_state=success, try_number=1, max_tries=1, job_id=760, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:25:00.431905+00:00, queued_by_job_id=2, pid=11100 2024-06-28T01:25:04.449187015Z [2024-06-28T01:25:04.447+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:25:04.450899578Z [2024-06-28T01:25:04.449+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:24:00+00:00, run_id=scheduled__2024-06-28T01:24:00+00:00, run_start_date=2024-06-28 01:25:00.319737+00:00, run_end_date=2024-06-28 01:25:04.449119+00:00, run_duration=4.129382, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:24:00+00:00, data_interval_end=2024-06-28 01:25:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:25:04.528797538Z [2024-06-28T01:25:04.528+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:25:00+00:00, run_after=2024-06-28T01:26:00+00:00 2024-06-28T01:25:04.659304482Z [2024-06-28T01:25:04.658+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:25:04.659323359Z 2024-06-28T01:25:04.659328429Z [2024-06-28T01:25:04.659+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:25:04.659811636Z [2024-06-28T01:25:04.659+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:25:04.659905251Z 2024-06-28T01:25:04.662773096Z [2024-06-28T01:25:04.662+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T01:25:04.671423038Z [2024-06-28T01:25:04.662+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:25:04.799208329Z [2024-06-28T01:25:04.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status queued for try_number 1 2024-06-28T01:25:04.799238862Z [2024-06-28T01:25:04.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status success for try_number 1 2024-06-28T01:25:04.807578259Z [2024-06-28T01:25:04.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:24:00+00:00 exited with status success for try_number 1 2024-06-28T01:25:04.834947550Z [2024-06-28T01:25:04.828+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T01:20:00+00:00, map_index=-1, run_start_date=2024-06-28 01:25:02.959884+00:00, run_end_date=2024-06-28 01:25:03.382057+00:00, run_duration=0.422173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=763, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:25:00.431905+00:00, queued_by_job_id=2, pid=11126 2024-06-28T01:25:04.835284931Z [2024-06-28T01:25:04.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to d41b9654-41e5-430a-bf2d-e4e079557f24 2024-06-28T01:25:04.835426387Z [2024-06-28T01:25:04.835+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:24:00+00:00, map_index=-1, run_start_date=2024-06-28 01:25:02.786119+00:00, run_end_date=2024-06-28 01:25:04.290357+00:00, run_duration=1.504238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=762, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:25:00.431905+00:00, queued_by_job_id=2, pid=11124 2024-06-28T01:25:04.920665781Z [2024-06-28T01:25:04.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:25:04.923682146Z [2024-06-28T01:25:04.920+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:24:00+00:00, run_id=scheduled__2024-06-28T01:24:00+00:00, run_start_date=2024-06-28 01:25:00.322017+00:00, run_end_date=2024-06-28 01:25:04.920566+00:00, run_duration=4.598549, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:24:00+00:00, data_interval_end=2024-06-28 01:25:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:25:04.948827420Z [2024-06-28T01:25:04.948+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:25:00+00:00, run_after=2024-06-28T01:26:00+00:00 2024-06-28T01:25:05.021248318Z [2024-06-28T01:25:05.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:24:00+00:00 exited with status success for try_number 1 2024-06-28T01:25:05.026358856Z [2024-06-28T01:25:05.026+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:24:00+00:00, map_index=-1, run_start_date=2024-06-28 01:25:02.769307+00:00, run_end_date=2024-06-28 01:25:04.635276+00:00, run_duration=1.865969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=761, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:25:00.431905+00:00, queued_by_job_id=2, pid=11125 2024-06-28T01:25:07.770396030Z [2024-06-28T01:25:07.770+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:25:07.770409682Z 2024-06-28T01:25:07.770558884Z [2024-06-28T01:25:07.770+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:25:07.771360046Z [2024-06-28T01:25:07.771+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:25:07.771365777Z 2024-06-28T01:25:07.774588146Z [2024-06-28T01:25:07.774+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T01:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T01:25:07.775298784Z [2024-06-28T01:25:07.775+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T01:25:07.902170183Z [2024-06-28T01:25:07.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status queued for try_number 1 2024-06-28T01:25:07.902197792Z [2024-06-28T01:25:07.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status success for try_number 1 2024-06-28T01:25:07.915138423Z [2024-06-28T01:25:07.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to db3e164a-0af1-4789-bf22-48a6cd3deba4 2024-06-28T01:25:07.915165194Z [2024-06-28T01:25:07.907+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T01:20:00+00:00, map_index=-1, run_start_date=2024-06-28 01:25:06.866316+00:00, run_end_date=2024-06-28 01:25:07.245538+00:00, run_duration=0.379222, state=success, executor_state=success, try_number=1, max_tries=1, job_id=764, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:25:04.660065+00:00, queued_by_job_id=2, pid=11149 2024-06-28T01:25:10.131370906Z [2024-06-28T01:25:10.130+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:25:10.131386023Z 2024-06-28T01:25:10.131824530Z [2024-06-28T01:25:10.131+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:25:10.133343510Z [2024-06-28T01:25:10.132+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:25:10.133354261Z 2024-06-28T01:25:10.138403242Z [2024-06-28T01:25:10.137+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:25:10.139704568Z [2024-06-28T01:25:10.138+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:25:10.211467323Z [2024-06-28T01:25:10.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status queued for try_number 1 2024-06-28T01:25:10.213163154Z [2024-06-28T01:25:10.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status success for try_number 1 2024-06-28T01:25:10.224307918Z [2024-06-28T01:25:10.223+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cb5aebd-a5e1-463d-8061-c12abcfb20ee 2024-06-28T01:25:10.224522082Z [2024-06-28T01:25:10.224+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T01:20:00+00:00, map_index=0, run_start_date=2024-06-28 01:25:09.520487+00:00, run_end_date=2024-06-28 01:25:09.882519+00:00, run_duration=0.362032, state=success, executor_state=success, try_number=1, max_tries=1, job_id=765, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:25:07.771864+00:00, queued_by_job_id=2, pid=11157 2024-06-28T01:25:12.481195968Z [2024-06-28T01:25:12.480+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:25:12.481620234Z [2024-06-28T01:25:12.481+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:20:00+00:00, run_id=scheduled__2024-06-28T01:20:00+00:00, run_start_date=2024-06-28 01:25:00.312572+00:00, run_end_date=2024-06-28 01:25:12.481287+00:00, run_duration=12.168715, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:20:00+00:00, data_interval_end=2024-06-28 01:25:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T01:25:12.494179879Z [2024-06-28T01:25:12.493+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:25:00+00:00, run_after=2024-06-28T01:30:00+00:00 2024-06-28T01:25:12.563637060Z [2024-06-28T01:25:12.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status success for try_number 1 2024-06-28T01:25:12.579599573Z [2024-06-28T01:25:12.579+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T01:20:00+00:00, map_index=-1, run_start_date=2024-06-28 01:25:11.966052+00:00, run_end_date=2024-06-28 01:25:12.305202+00:00, run_duration=0.33915, state=success, executor_state=success, try_number=1, max_tries=1, job_id=766, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:25:10.134237+00:00, queued_by_job_id=2, pid=11165 2024-06-28T01:26:00.229924236Z [2024-06-28T01:26:00.229+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:26:00+00:00, run_after=2024-06-28T01:27:00+00:00 2024-06-28T01:26:00.240544314Z [2024-06-28T01:26:00.240+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:26:00.249704682Z [2024-06-28T01:26:00.249+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:26:00.263332656Z [2024-06-28T01:26:00.262+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:26:00+00:00, run_after=2024-06-28T01:27:00+00:00 2024-06-28T01:26:00.371385338Z [2024-06-28T01:26:00.370+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:26:00.371419166Z 2024-06-28T01:26:00.371424702Z 2024-06-28T01:26:00.371429111Z 2024-06-28T01:26:00.371433284Z 2024-06-28T01:26:00.371596493Z [2024-06-28T01:26:00.371+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:26:00.371830854Z [2024-06-28T01:26:00.371+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:26:00.372040174Z [2024-06-28T01:26:00.371+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:26:00.372281079Z [2024-06-28T01:26:00.372+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:26:00.373175805Z [2024-06-28T01:26:00.372+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:26:00.373214327Z 2024-06-28T01:26:00.373220967Z 2024-06-28T01:26:00.373244126Z 2024-06-28T01:26:00.373248480Z 2024-06-28T01:26:00.378160180Z [2024-06-28T01:26:00.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:26:00.378460085Z [2024-06-28T01:26:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:26:00.378917281Z [2024-06-28T01:26:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:26:00.379317485Z [2024-06-28T01:26:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:26:00.379730866Z [2024-06-28T01:26:00.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:26:00.379954008Z [2024-06-28T01:26:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:26:00.380357425Z [2024-06-28T01:26:00.380+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:26:00.380727512Z [2024-06-28T01:26:00.380+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:26:00.809768957Z [2024-06-28T01:26:00.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:24:00+00:00 exited with status queued for try_number 1 2024-06-28T01:26:00.809859945Z [2024-06-28T01:26:00.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:25:00+00:00 exited with status queued for try_number 1 2024-06-28T01:26:00.809981260Z [2024-06-28T01:26:00.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:25:00+00:00 exited with status queued for try_number 1 2024-06-28T01:26:00.810076982Z [2024-06-28T01:26:00.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:25:00+00:00 exited with status queued for try_number 1 2024-06-28T01:26:00.848992279Z [2024-06-28T01:26:00.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1547067-4da5-4b82-b520-86e54770f45f 2024-06-28T01:26:00.849122047Z [2024-06-28T01:26:00.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to 283bc013-f86d-4e0c-b34c-16b0773ddf1f 2024-06-28T01:26:00.849279728Z [2024-06-28T01:26:00.849+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7abf6507-c893-48e3-8b89-9dc4c2e0b1ce 2024-06-28T01:26:00.849437635Z [2024-06-28T01:26:00.849+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8309ab5-632b-4ed8-8a70-367813a6d747 2024-06-28T01:26:02.025381526Z [2024-06-28T01:26:02.024+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:26:02.028252785Z [2024-06-28T01:26:02.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:24:00+00:00, run_id=scheduled__2024-06-28T01:24:00+00:00, run_start_date=2024-06-28 01:26:00.276905+00:00, run_end_date=2024-06-28 01:26:02.025333+00:00, run_duration=1.748428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:24:00+00:00, data_interval_end=2024-06-28 01:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:26:02.041447051Z [2024-06-28T01:26:02.041+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:26:00+00:00, run_after=2024-06-28T01:28:00+00:00 2024-06-28T01:26:02.051369611Z [2024-06-28T01:26:02.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:26:02.051783113Z [2024-06-28T01:26:02.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:25:00+00:00, run_id=scheduled__2024-06-28T01:25:00+00:00, run_start_date=2024-06-28 01:26:00.278792+00:00, run_end_date=2024-06-28 01:26:02.051317+00:00, run_duration=1.772525, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:25:00+00:00, data_interval_end=2024-06-28 01:26:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:26:02.066273749Z [2024-06-28T01:26:02.065+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:26:00+00:00, run_after=2024-06-28T01:27:00+00:00 2024-06-28T01:26:02.198865969Z [2024-06-28T01:26:02.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:24:00+00:00 exited with status success for try_number 1 2024-06-28T01:26:02.207473158Z [2024-06-28T01:26:02.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:24:00+00:00, map_index=-1, run_start_date=2024-06-28 01:26:01.296257+00:00, run_end_date=2024-06-28 01:26:01.731378+00:00, run_duration=0.435121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=767, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:26:00.374430+00:00, queued_by_job_id=2, pid=11187 2024-06-28T01:26:03.294206916Z [2024-06-28T01:26:03.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:25:00+00:00 exited with status success for try_number 1 2024-06-28T01:26:03.304902229Z [2024-06-28T01:26:03.304+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:25:00+00:00, map_index=-1, run_start_date=2024-06-28 01:26:01.467217+00:00, run_end_date=2024-06-28 01:26:01.952452+00:00, run_duration=0.485235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=768, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:26:00.374430+00:00, queued_by_job_id=2, pid=11188 2024-06-28T01:26:05.405259331Z [2024-06-28T01:26:05.404+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:26:05.405690945Z [2024-06-28T01:26:05.405+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:25:00+00:00, run_id=scheduled__2024-06-28T01:25:00+00:00, run_start_date=2024-06-28 01:26:00.280124+00:00, run_end_date=2024-06-28 01:26:05.405344+00:00, run_duration=5.12522, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:25:00+00:00, data_interval_end=2024-06-28 01:26:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:26:05.415342993Z [2024-06-28T01:26:05.415+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:26:00+00:00, run_after=2024-06-28T01:27:00+00:00 2024-06-28T01:26:05.481973128Z [2024-06-28T01:26:05.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:25:00+00:00 exited with status success for try_number 1 2024-06-28T01:26:05.488241708Z [2024-06-28T01:26:05.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:25:00+00:00, map_index=-1, run_start_date=2024-06-28 01:26:02.793984+00:00, run_end_date=2024-06-28 01:26:04.901235+00:00, run_duration=2.107251, state=success, executor_state=success, try_number=1, max_tries=1, job_id=770, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:26:00.374430+00:00, queued_by_job_id=2, pid=11212 2024-06-28T01:26:06.087856829Z [2024-06-28T01:26:06.087+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:26:06.088216367Z [2024-06-28T01:26:06.087+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:25:00+00:00, run_id=scheduled__2024-06-28T01:25:00+00:00, run_start_date=2024-06-28 01:26:00.281288+00:00, run_end_date=2024-06-28 01:26:06.087895+00:00, run_duration=5.806607, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:25:00+00:00, data_interval_end=2024-06-28 01:26:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:26:06.109168714Z [2024-06-28T01:26:06.108+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:26:00+00:00, run_after=2024-06-28T01:27:00+00:00 2024-06-28T01:26:06.168838387Z [2024-06-28T01:26:06.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:25:00+00:00 exited with status success for try_number 1 2024-06-28T01:26:06.180857393Z [2024-06-28T01:26:06.180+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:25:00+00:00, map_index=-1, run_start_date=2024-06-28 01:26:02.700033+00:00, run_end_date=2024-06-28 01:26:05.457419+00:00, run_duration=2.757386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=769, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:26:00.374430+00:00, queued_by_job_id=2, pid=11211 2024-06-28T01:26:38.517805980Z [2024-06-28T01:26:38.517+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:26:38.517837485Z 2024-06-28T01:26:38.518055766Z [2024-06-28T01:26:38.517+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-06-28T01:26:38.518798993Z [2024-06-28T01:26:38.518+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:26:38.518814215Z 2024-06-28T01:26:38.521235587Z [2024-06-28T01:26:38.520+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240628012637_205336', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:26:38.521457483Z [2024-06-28T01:26:38.521+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240628012637_205336', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-06-28T01:26:38.579602685Z [2024-06-28T01:26:38.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240628012637_205336 exited with status queued for try_number 1 2024-06-28T01:26:38.585222407Z [2024-06-28T01:26:38.584+0000] {scheduler_job.py:635} INFO - Setting external_id for to 879f766c-234c-4468-b2ae-50ea7044441f 2024-06-28T01:26:39.838072055Z [2024-06-28T01:26:39.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:26:39.838584728Z [2024-06-28T01:26:39.838+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-06-28 01:26:38.068245+00:00, run_id=vdu_down_20240628012637_205336, run_start_date=2024-06-28 01:26:38.480970+00:00, run_end_date=2024-06-28 01:26:39.837949+00:00, run_duration=1.356979, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-06-28 01:26:38.068245+00:00, data_interval_end=2024-06-28 01:26:38.068245+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-06-28T01:26:39.842095476Z [2024-06-28T01:26:39.841+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-06-28T01:26:40.631183676Z [2024-06-28T01:26:40.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240628012637_205336 exited with status success for try_number 1 2024-06-28T01:26:40.637501525Z [2024-06-28T01:26:40.637+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240628012637_205336, map_index=-1, run_start_date=2024-06-28 01:26:39.312931+00:00, run_end_date=2024-06-28 01:26:39.778274+00:00, run_duration=0.465343, state=success, executor_state=success, try_number=1, max_tries=1, job_id=771, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:26:38.519236+00:00, queued_by_job_id=2, pid=11237 2024-06-28T01:26:46.465856377Z [2024-06-28T01:26:46.465+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T01:27:00.106129252Z [2024-06-28T01:27:00.105+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:27:00+00:00, run_after=2024-06-28T01:28:00+00:00 2024-06-28T01:27:00.113141723Z [2024-06-28T01:27:00.112+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:27:00.126507282Z [2024-06-28T01:27:00.126+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:27:00+00:00, run_after=2024-06-28T01:28:00+00:00 2024-06-28T01:27:00.229696772Z [2024-06-28T01:27:00.229+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:27:00.229728137Z 2024-06-28T01:27:00.229733544Z 2024-06-28T01:27:00.229738406Z 2024-06-28T01:27:00.229999712Z [2024-06-28T01:27:00.229+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:27:00.230313480Z [2024-06-28T01:27:00.230+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:27:00.230650585Z [2024-06-28T01:27:00.230+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:27:00.232164347Z [2024-06-28T01:27:00.231+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:27:00.232204702Z 2024-06-28T01:27:00.232211310Z 2024-06-28T01:27:00.232216105Z 2024-06-28T01:27:00.235940569Z [2024-06-28T01:27:00.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:27:00.236161877Z [2024-06-28T01:27:00.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:27:00.236567658Z [2024-06-28T01:27:00.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:27:00.236859105Z [2024-06-28T01:27:00.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:27:00.237209459Z [2024-06-28T01:27:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:27:00.237419966Z [2024-06-28T01:27:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:27:00.547869458Z [2024-06-28T01:27:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:26:00+00:00 exited with status queued for try_number 1 2024-06-28T01:27:00.548096079Z [2024-06-28T01:27:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:26:00+00:00 exited with status queued for try_number 1 2024-06-28T01:27:00.548222271Z [2024-06-28T01:27:00.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:26:00+00:00 exited with status queued for try_number 1 2024-06-28T01:27:00.559125190Z [2024-06-28T01:27:00.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to d864fb47-1f24-4d68-9a31-057af1100feb 2024-06-28T01:27:00.559497635Z [2024-06-28T01:27:00.559+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce1c9100-62c0-4822-9dbe-35ce2c928864 2024-06-28T01:27:00.559759344Z [2024-06-28T01:27:00.559+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0881848e-fc2a-4f12-98d0-398c8e3d1928 2024-06-28T01:27:01.797804505Z [2024-06-28T01:27:01.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:27:01.798052549Z [2024-06-28T01:27:01.797+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:26:00+00:00, run_id=scheduled__2024-06-28T01:26:00+00:00, run_start_date=2024-06-28 01:27:00.141137+00:00, run_end_date=2024-06-28 01:27:01.797739+00:00, run_duration=1.656602, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:26:00+00:00, data_interval_end=2024-06-28 01:27:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:27:01.811337459Z [2024-06-28T01:27:01.811+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:27:00+00:00, run_after=2024-06-28T01:28:00+00:00 2024-06-28T01:27:01.898318039Z [2024-06-28T01:27:01.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:26:00+00:00 exited with status success for try_number 1 2024-06-28T01:27:01.911467388Z [2024-06-28T01:27:01.911+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:26:00+00:00, map_index=-1, run_start_date=2024-06-28 01:27:01.292900+00:00, run_end_date=2024-06-28 01:27:01.686682+00:00, run_duration=0.393782, state=success, executor_state=success, try_number=1, max_tries=1, job_id=772, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:27:00.233115+00:00, queued_by_job_id=2, pid=11252 2024-06-28T01:27:04.114929091Z [2024-06-28T01:27:04.113+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:27:04.114956856Z [2024-06-28T01:27:04.113+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:26:00+00:00, run_id=scheduled__2024-06-28T01:26:00+00:00, run_start_date=2024-06-28 01:27:00.142674+00:00, run_end_date=2024-06-28 01:27:04.113556+00:00, run_duration=3.970882, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:26:00+00:00, data_interval_end=2024-06-28 01:27:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:27:04.148353076Z [2024-06-28T01:27:04.147+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:27:00+00:00, run_after=2024-06-28T01:28:00+00:00 2024-06-28T01:27:04.164789361Z [2024-06-28T01:27:04.164+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:27:04.164931946Z [2024-06-28T01:27:04.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:26:00+00:00, run_id=scheduled__2024-06-28T01:26:00+00:00, run_start_date=2024-06-28 01:27:00.144074+00:00, run_end_date=2024-06-28 01:27:04.164706+00:00, run_duration=4.020632, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:26:00+00:00, data_interval_end=2024-06-28 01:27:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:27:04.184368764Z [2024-06-28T01:27:04.184+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:27:00+00:00, run_after=2024-06-28T01:28:00+00:00 2024-06-28T01:27:04.217036348Z [2024-06-28T01:27:04.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:26:00+00:00 exited with status success for try_number 1 2024-06-28T01:27:04.217060409Z [2024-06-28T01:27:04.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:26:00+00:00 exited with status success for try_number 1 2024-06-28T01:27:04.223800072Z [2024-06-28T01:27:04.223+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:26:00+00:00, map_index=-1, run_start_date=2024-06-28 01:27:02.232242+00:00, run_end_date=2024-06-28 01:27:03.867428+00:00, run_duration=1.635186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=773, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:27:00.233115+00:00, queued_by_job_id=2, pid=11270 2024-06-28T01:27:04.223940440Z [2024-06-28T01:27:04.223+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:26:00+00:00, map_index=-1, run_start_date=2024-06-28 01:27:02.272423+00:00, run_end_date=2024-06-28 01:27:03.618555+00:00, run_duration=1.346132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=774, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:27:00.233115+00:00, queued_by_job_id=2, pid=11271 2024-06-28T01:28:00.166148202Z [2024-06-28T01:28:00.165+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:28:00.179861266Z [2024-06-28T01:28:00.179+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:28:00+00:00, run_after=2024-06-28T01:29:00+00:00 2024-06-28T01:28:00.186420868Z [2024-06-28T01:28:00.186+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:28:00.199985730Z [2024-06-28T01:28:00.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:28:00+00:00, run_after=2024-06-28T01:29:00+00:00 2024-06-28T01:28:00.287107033Z [2024-06-28T01:28:00.286+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:28:00.287127604Z 2024-06-28T01:28:00.287131825Z 2024-06-28T01:28:00.287135365Z 2024-06-28T01:28:00.287138643Z 2024-06-28T01:28:00.287313652Z [2024-06-28T01:28:00.287+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:28:00.287475854Z [2024-06-28T01:28:00.287+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:28:00.287641654Z [2024-06-28T01:28:00.287+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:28:00.287819960Z [2024-06-28T01:28:00.287+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:28:00.288477149Z [2024-06-28T01:28:00.288+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:28:00.288488085Z 2024-06-28T01:28:00.288506040Z 2024-06-28T01:28:00.288509369Z 2024-06-28T01:28:00.288512912Z 2024-06-28T01:28:00.291914447Z [2024-06-28T01:28:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:28:00.292259814Z [2024-06-28T01:28:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:28:00.292575240Z [2024-06-28T01:28:00.292+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:28:00.292726244Z [2024-06-28T01:28:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:28:00.293004632Z [2024-06-28T01:28:00.292+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:28:00.293518031Z [2024-06-28T01:28:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:28:00.293837521Z [2024-06-28T01:28:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:28:00.293993699Z [2024-06-28T01:28:00.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:28:01.198399546Z [2024-06-28T01:28:01.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:26:00+00:00 exited with status queued for try_number 1 2024-06-28T01:28:01.198632583Z [2024-06-28T01:28:01.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:27:00+00:00 exited with status queued for try_number 1 2024-06-28T01:28:01.198862929Z [2024-06-28T01:28:01.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:27:00+00:00 exited with status queued for try_number 1 2024-06-28T01:28:01.199121145Z [2024-06-28T01:28:01.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:27:00+00:00 exited with status queued for try_number 1 2024-06-28T01:28:01.231218223Z [2024-06-28T01:28:01.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2fdf7a2d-b797-41e9-950f-b023b6af9bdc 2024-06-28T01:28:01.231524053Z [2024-06-28T01:28:01.231+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7506c742-06d8-47d5-8da8-aa71d4ec3444 2024-06-28T01:28:01.231778372Z [2024-06-28T01:28:01.231+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3317f721-78a2-453a-97cf-42928b8a895c 2024-06-28T01:28:01.232015689Z [2024-06-28T01:28:01.231+0000] {scheduler_job.py:635} INFO - Setting external_id for to d42023f8-42ee-41b8-9f9b-163b3be2cc97 2024-06-28T01:28:03.897743995Z [2024-06-28T01:28:03.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:28:03.898142838Z [2024-06-28T01:28:03.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:27:00+00:00, run_id=scheduled__2024-06-28T01:27:00+00:00, run_start_date=2024-06-28 01:28:00.214194+00:00, run_end_date=2024-06-28 01:28:03.897602+00:00, run_duration=3.683408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:27:00+00:00, data_interval_end=2024-06-28 01:28:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:28:03.909046597Z [2024-06-28T01:28:03.908+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:28:00+00:00, run_after=2024-06-28T01:29:00+00:00 2024-06-28T01:28:03.916513063Z [2024-06-28T01:28:03.916+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:28:03.916871358Z [2024-06-28T01:28:03.916+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:26:00+00:00, run_id=scheduled__2024-06-28T01:26:00+00:00, run_start_date=2024-06-28 01:28:00.212822+00:00, run_end_date=2024-06-28 01:28:03.916437+00:00, run_duration=3.703615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:26:00+00:00, data_interval_end=2024-06-28 01:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:28:03.925478544Z [2024-06-28T01:28:03.925+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:28:00+00:00, run_after=2024-06-28T01:30:00+00:00 2024-06-28T01:28:04.033971036Z [2024-06-28T01:28:04.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:26:00+00:00 exited with status success for try_number 1 2024-06-28T01:28:04.034230351Z [2024-06-28T01:28:04.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:27:00+00:00 exited with status success for try_number 1 2024-06-28T01:28:04.043115106Z [2024-06-28T01:28:04.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:26:00+00:00, map_index=-1, run_start_date=2024-06-28 01:28:02.637556+00:00, run_end_date=2024-06-28 01:28:03.356679+00:00, run_duration=0.719123, state=success, executor_state=success, try_number=1, max_tries=1, job_id=775, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:28:00.289326+00:00, queued_by_job_id=2, pid=11303 2024-06-28T01:28:04.043361033Z [2024-06-28T01:28:04.043+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:27:00+00:00, map_index=-1, run_start_date=2024-06-28 01:28:02.911943+00:00, run_end_date=2024-06-28 01:28:03.426572+00:00, run_duration=0.514629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=776, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:28:00.289326+00:00, queued_by_job_id=2, pid=11304 2024-06-28T01:28:06.194594823Z [2024-06-28T01:28:06.194+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:28:06.196078721Z [2024-06-28T01:28:06.194+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:27:00+00:00, run_id=scheduled__2024-06-28T01:27:00+00:00, run_start_date=2024-06-28 01:28:00.216565+00:00, run_end_date=2024-06-28 01:28:06.194725+00:00, run_duration=5.97816, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:27:00+00:00, data_interval_end=2024-06-28 01:28:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:28:06.208901387Z [2024-06-28T01:28:06.208+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:28:00+00:00, run_after=2024-06-28T01:29:00+00:00 2024-06-28T01:28:06.259687751Z [2024-06-28T01:28:06.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:27:00+00:00 exited with status success for try_number 1 2024-06-28T01:28:06.269186292Z [2024-06-28T01:28:06.268+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:27:00+00:00, map_index=-1, run_start_date=2024-06-28 01:28:04.405138+00:00, run_end_date=2024-06-28 01:28:05.920778+00:00, run_duration=1.51564, state=success, executor_state=success, try_number=1, max_tries=1, job_id=777, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:28:00.289326+00:00, queued_by_job_id=2, pid=11328 2024-06-28T01:28:07.140492355Z [2024-06-28T01:28:07.140+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:28:07.140975804Z [2024-06-28T01:28:07.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:27:00+00:00, run_id=scheduled__2024-06-28T01:27:00+00:00, run_start_date=2024-06-28 01:28:00.218775+00:00, run_end_date=2024-06-28 01:28:07.140423+00:00, run_duration=6.921648, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:27:00+00:00, data_interval_end=2024-06-28 01:28:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:28:07.149822576Z [2024-06-28T01:28:07.149+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:28:00+00:00, run_after=2024-06-28T01:29:00+00:00 2024-06-28T01:28:07.188043816Z [2024-06-28T01:28:07.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:27:00+00:00 exited with status success for try_number 1 2024-06-28T01:28:07.196888195Z [2024-06-28T01:28:07.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:27:00+00:00, map_index=-1, run_start_date=2024-06-28 01:28:04.381040+00:00, run_end_date=2024-06-28 01:28:06.639473+00:00, run_duration=2.258433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=778, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:28:00.289326+00:00, queued_by_job_id=2, pid=11327 2024-06-28T01:28:21.490463119Z [2024-06-28T01:28:21.490+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c to 2024-06-28T01:25:00+00:00, run_after=2024-06-28T01:30:00+00:00 2024-06-28T01:28:21.535662128Z [2024-06-28T01:28:21.535+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:28:21.535685699Z 2024-06-28T01:28:21.535929233Z [2024-06-28T01:28:21.535+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c has 0/16 running and queued tasks 2024-06-28T01:28:21.536629171Z [2024-06-28T01:28:21.536+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:28:21.536634219Z 2024-06-28T01:28:21.539496803Z [2024-06-28T01:28:21.539+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T01:28:21.539725780Z [2024-06-28T01:28:21.539+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:28:21.612484512Z [2024-06-28T01:28:21.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status queued for try_number 1 2024-06-28T01:28:21.624436208Z [2024-06-28T01:28:21.624+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc06d093-1774-4640-869c-4592b675cc61 2024-06-28T01:28:24.397164728Z [2024-06-28T01:28:24.396+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:28:24.397188638Z 2024-06-28T01:28:24.397316437Z [2024-06-28T01:28:24.397+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c has 0/16 running and queued tasks 2024-06-28T01:28:24.397899082Z [2024-06-28T01:28:24.397+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:28:24.397921989Z 2024-06-28T01:28:24.399834496Z [2024-06-28T01:28:24.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c', task_id='split_metrics', run_id='scheduled__2024-06-28T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T01:28:24.399997304Z [2024-06-28T01:28:24.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c', 'split_metrics', 'scheduled__2024-06-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:28:24.463645240Z [2024-06-28T01:28:24.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c.split_metrics run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status queued for try_number 1 2024-06-28T01:28:24.463729592Z [2024-06-28T01:28:24.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status success for try_number 1 2024-06-28T01:28:24.475444307Z [2024-06-28T01:28:24.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fdbabea-f1d2-4daa-8c0f-cf918b255096 2024-06-28T01:28:24.475868900Z [2024-06-28T01:28:24.475+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T01:20:00+00:00, map_index=-1, run_start_date=2024-06-28 01:28:23.348048+00:00, run_end_date=2024-06-28 01:28:23.727067+00:00, run_duration=0.379019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=779, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:28:21.537143+00:00, queued_by_job_id=2, pid=11359 2024-06-28T01:28:27.216280827Z [2024-06-28T01:28:27.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c to 2024-06-28T01:28:00+00:00, run_after=2024-06-28T01:29:00+00:00 2024-06-28T01:28:27.288050283Z [2024-06-28T01:28:27.287+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-06-28T01:28:27.288080015Z 2024-06-28T01:28:27.288085522Z 2024-06-28T01:28:27.288282024Z [2024-06-28T01:28:27.287+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c has 0/16 running and queued tasks 2024-06-28T01:28:27.288453335Z [2024-06-28T01:28:27.288+0000] {scheduler_job.py:425} INFO - DAG vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c has 0/16 running and queued tasks 2024-06-28T01:28:27.289684007Z [2024-06-28T01:28:27.289+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:28:27.289697613Z 2024-06-28T01:28:27.289757942Z 2024-06-28T01:28:27.295117998Z [2024-06-28T01:28:27.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c', task_id='collect_metrics', run_id='scheduled__2024-06-28T01:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T01:28:27.295358704Z [2024-06-28T01:28:27.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c', 'collect_metrics', 'scheduled__2024-06-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T01:28:27.295869132Z [2024-06-28T01:28:27.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:28:27.296187969Z [2024-06-28T01:28:27.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:28:27.546603300Z [2024-06-28T01:28:27.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c.collect_metrics run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status queued for try_number 1 2024-06-28T01:28:27.546641948Z [2024-06-28T01:28:27.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:27:00+00:00 exited with status queued for try_number 1 2024-06-28T01:28:27.546652715Z [2024-06-28T01:28:27.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c.split_metrics run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status success for try_number 1 2024-06-28T01:28:27.555720476Z [2024-06-28T01:28:27.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23966709-917e-4c6c-b04e-6462e38bd4d5 2024-06-28T01:28:27.555746835Z [2024-06-28T01:28:27.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3b0e764-0822-4fe7-852e-471fc61c04b5 2024-06-28T01:28:27.555892408Z [2024-06-28T01:28:27.555+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c, task_id=split_metrics, run_id=scheduled__2024-06-28T01:20:00+00:00, map_index=-1, run_start_date=2024-06-28 01:28:26.068423+00:00, run_end_date=2024-06-28 01:28:26.553474+00:00, run_duration=0.485051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=780, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:28:24.398219+00:00, queued_by_job_id=2, pid=11372 2024-06-28T01:28:28.724050721Z [2024-06-28T01:28:28.723+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:28:28.785456867Z [2024-06-28T01:28:28.785+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:28:28.785501024Z 2024-06-28T01:28:28.785652745Z [2024-06-28T01:28:28.785+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c has 0/16 running and queued tasks 2024-06-28T01:28:28.786206297Z [2024-06-28T01:28:28.786+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:28:28.786216664Z 2024-06-28T01:28:28.788369400Z [2024-06-28T01:28:28.788+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:28:28.788581274Z [2024-06-28T01:28:28.788+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:28:28.839413283Z [2024-06-28T01:28:28.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:27:00+00:00 exited with status queued for try_number 1 2024-06-28T01:28:28.859735807Z [2024-06-28T01:28:28.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31667b40-032d-4513-8604-5ac354c22b0f 2024-06-28T01:28:30.060941147Z [2024-06-28T01:28:30.060+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:28:30.060963252Z 2024-06-28T01:28:30.061297679Z [2024-06-28T01:28:30.061+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c has 0/16 running and queued tasks 2024-06-28T01:28:30.062189536Z [2024-06-28T01:28:30.061+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:28:30.062201250Z 2024-06-28T01:28:30.065395456Z [2024-06-28T01:28:30.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c', task_id='send_prometheus', run_id='scheduled__2024-06-28T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:28:30.066239213Z [2024-06-28T01:28:30.066+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c', 'send_prometheus', 'scheduled__2024-06-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:28:30.188077604Z [2024-06-28T01:28:30.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c.send_prometheus run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status queued for try_number 1 2024-06-28T01:28:30.188458215Z [2024-06-28T01:28:30.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c.collect_metrics run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status success for try_number 1 2024-06-28T01:28:30.213603928Z [2024-06-28T01:28:30.213+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9e400d3-5ba2-4f1c-9b47-c5e6a90c065a 2024-06-28T01:28:30.214010853Z [2024-06-28T01:28:30.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c, task_id=collect_metrics, run_id=scheduled__2024-06-28T01:20:00+00:00, map_index=0, run_start_date=2024-06-28 01:28:29.276938+00:00, run_end_date=2024-06-28 01:28:29.631796+00:00, run_duration=0.354858, state=success, executor_state=success, try_number=1, max_tries=1, job_id=781, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:28:27.290991+00:00, queued_by_job_id=2, pid=11388 2024-06-28T01:28:31.341972888Z [2024-06-28T01:28:31.341+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:28:31.342330355Z [2024-06-28T01:28:31.342+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c, execution_date=2024-06-28 01:27:00+00:00, run_id=scheduled__2024-06-28T01:27:00+00:00, run_start_date=2024-06-28 01:28:27.229280+00:00, run_end_date=2024-06-28 01:28:31.342025+00:00, run_duration=4.112745, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:27:00+00:00, data_interval_end=2024-06-28 01:28:00+00:00, dag_hash=2db1b841660f735946d2ec8f9693e7bb 2024-06-28T01:28:31.353717229Z [2024-06-28T01:28:31.353+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c to 2024-06-28T01:28:00+00:00, run_after=2024-06-28T01:29:00+00:00 2024-06-28T01:28:31.416728435Z [2024-06-28T01:28:31.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:27:00+00:00 exited with status success for try_number 1 2024-06-28T01:28:31.423229037Z [2024-06-28T01:28:31.422+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:27:00+00:00, map_index=-1, run_start_date=2024-06-28 01:28:29.308765+00:00, run_end_date=2024-06-28 01:28:30.563638+00:00, run_duration=1.254873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=782, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:28:27.290991+00:00, queued_by_job_id=2, pid=11389 2024-06-28T01:28:33.753293850Z [2024-06-28T01:28:33.752+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:28:33.753465722Z [2024-06-28T01:28:33.753+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c, execution_date=2024-06-28 01:27:00+00:00, run_id=scheduled__2024-06-28T01:27:00+00:00, run_start_date=2024-06-28 01:28:28.737118+00:00, run_end_date=2024-06-28 01:28:33.753093+00:00, run_duration=5.015975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:27:00+00:00, data_interval_end=2024-06-28 01:28:00+00:00, dag_hash=074748817b4080ca6c3a9c41f6122a03 2024-06-28T01:28:33.767996790Z [2024-06-28T01:28:33.767+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c to 2024-06-28T01:28:00+00:00, run_after=2024-06-28T01:29:00+00:00 2024-06-28T01:28:33.776255351Z [2024-06-28T01:28:33.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:28:33.776632996Z [2024-06-28T01:28:33.776+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c, execution_date=2024-06-28 01:20:00+00:00, run_id=scheduled__2024-06-28T01:20:00+00:00, run_start_date=2024-06-28 01:28:21.499273+00:00, run_end_date=2024-06-28 01:28:33.776209+00:00, run_duration=12.276936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:20:00+00:00, data_interval_end=2024-06-28 01:25:00+00:00, dag_hash=0926c5e5b6c0c56ad4fdd92990c73f3a 2024-06-28T01:28:33.785077875Z [2024-06-28T01:28:33.784+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c to 2024-06-28T01:25:00+00:00, run_after=2024-06-28T01:30:00+00:00 2024-06-28T01:28:33.847176693Z [2024-06-28T01:28:33.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:27:00+00:00 exited with status success for try_number 1 2024-06-28T01:28:33.847476597Z [2024-06-28T01:28:33.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c.send_prometheus run_id=scheduled__2024-06-28T01:20:00+00:00 exited with status success for try_number 1 2024-06-28T01:28:33.862969510Z [2024-06-28T01:28:33.862+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c, task_id=send_prometheus, run_id=scheduled__2024-06-28T01:20:00+00:00, map_index=-1, run_start_date=2024-06-28 01:28:32.297257+00:00, run_end_date=2024-06-28 01:28:32.678147+00:00, run_duration=0.38089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=784, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:28:30.062938+00:00, queued_by_job_id=2, pid=11414 2024-06-28T01:28:33.863159186Z [2024-06-28T01:28:33.862+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:27:00+00:00, map_index=-1, run_start_date=2024-06-28 01:28:30.907540+00:00, run_end_date=2024-06-28 01:28:32.724562+00:00, run_duration=1.817022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=783, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:28:28.786551+00:00, queued_by_job_id=2, pid=11402 2024-06-28T01:29:00.314831291Z [2024-06-28T01:29:00.314+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c to 2024-06-28T01:29:00+00:00, run_after=2024-06-28T01:30:00+00:00 2024-06-28T01:29:00.328927607Z [2024-06-28T01:29:00.328+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:29:00+00:00, run_after=2024-06-28T01:30:00+00:00 2024-06-28T01:29:00.336672242Z [2024-06-28T01:29:00.336+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:29:00.349118263Z [2024-06-28T01:29:00.348+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:29:00+00:00, run_after=2024-06-28T01:30:00+00:00 2024-06-28T01:29:00.356298589Z [2024-06-28T01:29:00.356+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:29:00.449281176Z [2024-06-28T01:29:00.448+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-28T01:29:00.449361167Z 2024-06-28T01:29:00.449368599Z 2024-06-28T01:29:00.449374085Z 2024-06-28T01:29:00.449379527Z 2024-06-28T01:29:00.449384898Z 2024-06-28T01:29:00.449401808Z [2024-06-28T01:29:00.449+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:29:00.449633724Z [2024-06-28T01:29:00.449+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c has 0/16 running and queued tasks 2024-06-28T01:29:00.449809553Z [2024-06-28T01:29:00.449+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:29:00.449993868Z [2024-06-28T01:29:00.449+0000] {scheduler_job.py:425} INFO - DAG vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c has 0/16 running and queued tasks 2024-06-28T01:29:00.450148015Z [2024-06-28T01:29:00.449+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:29:00.450975604Z [2024-06-28T01:29:00.450+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:29:00.450989288Z 2024-06-28T01:29:00.450994886Z 2024-06-28T01:29:00.451000288Z 2024-06-28T01:29:00.451005929Z 2024-06-28T01:29:00.451053762Z 2024-06-28T01:29:00.455980618Z [2024-06-28T01:29:00.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:29:00.456075426Z [2024-06-28T01:29:00.455+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:29:00.456410617Z [2024-06-28T01:29:00.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:29:00.456561647Z [2024-06-28T01:29:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:29:00.456877903Z [2024-06-28T01:29:00.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:29:00.457009858Z [2024-06-28T01:29:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:29:00.457268228Z [2024-06-28T01:29:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:29:00.457387795Z [2024-06-28T01:29:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:29:00.457643980Z [2024-06-28T01:29:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:29:00.457766138Z [2024-06-28T01:29:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:29:00.772359214Z [2024-06-28T01:29:00.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:28:00+00:00 exited with status queued for try_number 1 2024-06-28T01:29:00.772389204Z [2024-06-28T01:29:00.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:28:00+00:00 exited with status queued for try_number 1 2024-06-28T01:29:00.774438790Z [2024-06-28T01:29:00.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:28:00+00:00 exited with status queued for try_number 1 2024-06-28T01:29:00.774578541Z [2024-06-28T01:29:00.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:28:00+00:00 exited with status queued for try_number 1 2024-06-28T01:29:00.774729404Z [2024-06-28T01:29:00.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:28:00+00:00 exited with status queued for try_number 1 2024-06-28T01:29:00.783211402Z [2024-06-28T01:29:00.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4eaf8ce4-6634-40cf-a07a-de4eae30ef2d 2024-06-28T01:29:00.783426567Z [2024-06-28T01:29:00.783+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cbf812e-cce1-4a49-9d51-5d43e485e007 2024-06-28T01:29:00.783614210Z [2024-06-28T01:29:00.783+0000] {scheduler_job.py:635} INFO - Setting external_id for to e71766ad-d262-44cd-b705-e43b25a03b77 2024-06-28T01:29:00.783769861Z [2024-06-28T01:29:00.783+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a0cb06e-7a15-47d8-a6bc-7a3059742cfd 2024-06-28T01:29:00.783911001Z [2024-06-28T01:29:00.783+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0493da5d-7ba9-421c-ae91-76759853d524 2024-06-28T01:29:01.970318680Z [2024-06-28T01:29:01.969+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:29:01.970656494Z [2024-06-28T01:29:01.970+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:28:00+00:00, run_id=scheduled__2024-06-28T01:28:00+00:00, run_start_date=2024-06-28 01:29:00.367181+00:00, run_end_date=2024-06-28 01:29:01.970259+00:00, run_duration=1.603078, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:28:00+00:00, data_interval_end=2024-06-28 01:29:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:29:01.984272284Z [2024-06-28T01:29:01.983+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:29:00+00:00, run_after=2024-06-28T01:30:00+00:00 2024-06-28T01:29:02.133790249Z [2024-06-28T01:29:02.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:28:00+00:00 exited with status success for try_number 1 2024-06-28T01:29:02.140938291Z [2024-06-28T01:29:02.140+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:28:00+00:00, map_index=-1, run_start_date=2024-06-28 01:29:01.266899+00:00, run_end_date=2024-06-28 01:29:01.708541+00:00, run_duration=0.441642, state=success, executor_state=success, try_number=1, max_tries=1, job_id=785, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:29:00.452324+00:00, queued_by_job_id=2, pid=11425 2024-06-28T01:29:03.264781751Z [2024-06-28T01:29:03.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:28:00+00:00 exited with status failed for try_number 1 2024-06-28T01:29:03.264825764Z [2024-06-28T01:29:03.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:28:00+00:00 exited with status failed for try_number 1 2024-06-28T01:29:03.275222996Z [2024-06-28T01:29:03.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:28:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:29:00.452324+00:00, queued_by_job_id=2, pid=None 2024-06-28T01:29:03.275833354Z [2024-06-28T01:29:03.275+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T01:29:03.280201292Z [2024-06-28T01:29:03.279+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T01:29:03.296446587Z [2024-06-28T01:29:03.296+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240628T012800, start_date=, end_date=20240628T012903 2024-06-28T01:29:03.314211016Z [2024-06-28T01:29:03.313+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:28:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:29:00.452324+00:00, queued_by_job_id=2, pid=None 2024-06-28T01:29:03.314560824Z [2024-06-28T01:29:03.314+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T01:29:03.317212888Z [2024-06-28T01:29:03.316+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T01:29:03.331111179Z [2024-06-28T01:29:03.330+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240628T012800, start_date=, end_date=20240628T012903 2024-06-28T01:29:04.437435776Z [2024-06-28T01:29:04.436+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:29:04.437901818Z [2024-06-28T01:29:04.437+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:28:00+00:00, run_id=scheduled__2024-06-28T01:28:00+00:00, run_start_date=2024-06-28 01:29:00.369306+00:00, run_end_date=2024-06-28 01:29:04.437301+00:00, run_duration=4.067995, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:28:00+00:00, data_interval_end=2024-06-28 01:29:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:29:04.448451477Z [2024-06-28T01:29:04.448+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:29:00+00:00, run_after=2024-06-28T01:30:00+00:00 2024-06-28T01:29:04.520027111Z [2024-06-28T01:29:04.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:28:00+00:00 exited with status success for try_number 1 2024-06-28T01:29:04.528744740Z [2024-06-28T01:29:04.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:28:00+00:00, map_index=-1, run_start_date=2024-06-28 01:29:02.293588+00:00, run_end_date=2024-06-28 01:29:03.637812+00:00, run_duration=1.344224, state=success, executor_state=success, try_number=1, max_tries=1, job_id=786, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:29:00.452324+00:00, queued_by_job_id=2, pid=11440 2024-06-28T01:29:06.712372034Z [2024-06-28T01:29:06.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:29:06.712805023Z [2024-06-28T01:29:06.712+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:28:00+00:00, run_id=scheduled__2024-06-28T01:28:00+00:00, run_start_date=2024-06-28 01:29:00.371260+00:00, run_end_date=2024-06-28 01:29:06.712422+00:00, run_duration=6.341162, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:28:00+00:00, data_interval_end=2024-06-28 01:29:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:29:06.728874634Z [2024-06-28T01:29:06.728+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:29:00+00:00, run_after=2024-06-28T01:30:00+00:00 2024-06-28T01:29:06.793450559Z [2024-06-28T01:29:06.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:28:00+00:00 exited with status success for try_number 1 2024-06-28T01:29:06.804544122Z [2024-06-28T01:29:06.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:28:00+00:00, map_index=-1, run_start_date=2024-06-28 01:29:02.900151+00:00, run_end_date=2024-06-28 01:29:06.382928+00:00, run_duration=3.482777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=787, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:29:00.452324+00:00, queued_by_job_id=2, pid=11466 2024-06-28T01:29:13.610768870Z [2024-06-28T01:29:13.610+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-06-28T01:29:13.610811993Z 2024-06-28T01:29:13.610820275Z 2024-06-28T01:29:13.610923654Z [2024-06-28T01:29:13.610+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c has 0/16 running and queued tasks 2024-06-28T01:29:13.611351022Z [2024-06-28T01:29:13.611+0000] {scheduler_job.py:425} INFO - DAG vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c has 0/16 running and queued tasks 2024-06-28T01:29:13.612162533Z [2024-06-28T01:29:13.611+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:29:13.612177415Z 2024-06-28T01:29:13.612184384Z 2024-06-28T01:29:13.616272187Z [2024-06-28T01:29:13.615+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:28:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:29:13.616664095Z [2024-06-28T01:29:13.616+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:29:13.617297125Z [2024-06-28T01:29:13.616+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:28:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:29:13.617663190Z [2024-06-28T01:29:13.617+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:29:13.775917646Z [2024-06-28T01:29:13.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:28:00+00:00 exited with status queued for try_number 2 2024-06-28T01:29:13.775941398Z [2024-06-28T01:29:13.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:28:00+00:00 exited with status queued for try_number 2 2024-06-28T01:29:13.782371269Z [2024-06-28T01:29:13.781+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86a80285-e302-4233-a88c-3ffe83d04c56 2024-06-28T01:29:13.782409214Z [2024-06-28T01:29:13.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cbce13d-316d-4937-b168-bee1204df64b 2024-06-28T01:29:16.132244566Z [2024-06-28T01:29:16.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:28:00+00:00 exited with status failed for try_number 2 2024-06-28T01:29:16.132553563Z [2024-06-28T01:29:16.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:28:00+00:00 exited with status failed for try_number 2 2024-06-28T01:29:16.144578260Z [2024-06-28T01:29:16.144+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:28:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-06-28 01:29:03.282543+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:29:13.612902+00:00, queued_by_job_id=2, pid=None 2024-06-28T01:29:16.145586760Z [2024-06-28T01:29:16.145+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T01:29:16.148751410Z [2024-06-28T01:29:16.148+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T01:29:16.171988645Z [2024-06-28T01:29:16.171+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240628T012800, start_date=, end_date=20240628T012916 2024-06-28T01:29:16.187672382Z [2024-06-28T01:29:16.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:28:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-06-28 01:29:03.320828+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:29:13.612902+00:00, queued_by_job_id=2, pid=None 2024-06-28T01:29:16.188042730Z [2024-06-28T01:29:16.187+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T01:29:16.191838290Z [2024-06-28T01:29:16.191+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T01:29:16.211583836Z [2024-06-28T01:29:16.211+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240628T012800, start_date=, end_date=20240628T012916 2024-06-28T01:29:17.268157991Z [2024-06-28T01:29:17.267+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-28T01:29:17.268775087Z [2024-06-28T01:29:17.268+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c, execution_date=2024-06-28 01:28:00+00:00, run_id=scheduled__2024-06-28T01:28:00+00:00, run_start_date=2024-06-28 01:29:00.368371+00:00, run_end_date=2024-06-28 01:29:17.268084+00:00, run_duration=16.899713, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:28:00+00:00, data_interval_end=2024-06-28 01:29:00+00:00, dag_hash=2db1b841660f735946d2ec8f9693e7bb 2024-06-28T01:29:17.280925210Z [2024-06-28T01:29:17.280+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_076fc4b7-324b-45f5-920e-d02f7ab35f4c to 2024-06-28T01:29:00+00:00, run_after=2024-06-28T01:30:00+00:00 2024-06-28T01:29:17.289144858Z [2024-06-28T01:29:17.288+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-28T01:29:17.289531426Z [2024-06-28T01:29:17.289+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c, execution_date=2024-06-28 01:28:00+00:00, run_id=scheduled__2024-06-28T01:28:00+00:00, run_start_date=2024-06-28 01:29:00.370212+00:00, run_end_date=2024-06-28 01:29:17.289051+00:00, run_duration=16.918839, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:28:00+00:00, data_interval_end=2024-06-28 01:29:00+00:00, dag_hash=074748817b4080ca6c3a9c41f6122a03 2024-06-28T01:29:17.304203441Z [2024-06-28T01:29:17.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c to 2024-06-28T01:29:00+00:00, run_after=2024-06-28T01:30:00+00:00 2024-06-28T01:30:00.569487385Z [2024-06-28T01:30:00.569+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c to 2024-06-28T01:30:00+00:00, run_after=2024-06-28T01:35:00+00:00 2024-06-28T01:30:00.580955786Z [2024-06-28T01:30:00.580+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:30:00.594962130Z [2024-06-28T01:30:00.594+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:30:00+00:00, run_after=2024-06-28T01:35:00+00:00 2024-06-28T01:30:00.611127497Z [2024-06-28T01:30:00.610+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:30:00+00:00, run_after=2024-06-28T01:31:00+00:00 2024-06-28T01:30:00.618973750Z [2024-06-28T01:30:00.618+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:30:00.631426774Z [2024-06-28T01:30:00.631+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:30:00+00:00, run_after=2024-06-28T01:31:00+00:00 2024-06-28T01:30:00.799468556Z [2024-06-28T01:30:00.799+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-06-28T01:30:00.799501455Z 2024-06-28T01:30:00.799506450Z 2024-06-28T01:30:00.799510138Z 2024-06-28T01:30:00.799514324Z 2024-06-28T01:30:00.799517822Z 2024-06-28T01:30:00.799541686Z 2024-06-28T01:30:00.799753845Z [2024-06-28T01:30:00.799+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:30:00.799927393Z [2024-06-28T01:30:00.799+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c has 0/16 running and queued tasks 2024-06-28T01:30:00.800113428Z [2024-06-28T01:30:00.799+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:30:00.800290896Z [2024-06-28T01:30:00.800+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:30:00.800467841Z [2024-06-28T01:30:00.800+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:30:00.800633734Z [2024-06-28T01:30:00.800+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:30:00.801386827Z [2024-06-28T01:30:00.801+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:30:00.801398282Z 2024-06-28T01:30:00.801402205Z 2024-06-28T01:30:00.801406812Z 2024-06-28T01:30:00.801410763Z 2024-06-28T01:30:00.801414587Z 2024-06-28T01:30:00.801419061Z 2024-06-28T01:30:00.805511980Z [2024-06-28T01:30:00.805+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T01:30:00.805706349Z [2024-06-28T01:30:00.805+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:30:00.805977631Z [2024-06-28T01:30:00.805+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T01:30:00.806146070Z [2024-06-28T01:30:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:30:00.806436072Z [2024-06-28T01:30:00.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:30:00.806625548Z [2024-06-28T01:30:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:30:00.806880977Z [2024-06-28T01:30:00.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:30:00.807045279Z [2024-06-28T01:30:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:30:00.807311469Z [2024-06-28T01:30:00.807+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:30:00.807472877Z [2024-06-28T01:30:00.807+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:30:00.807717813Z [2024-06-28T01:30:00.807+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:30:00.807874129Z [2024-06-28T01:30:00.807+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:30:01.461226652Z [2024-06-28T01:30:01.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:25:00+00:00 exited with status queued for try_number 1 2024-06-28T01:30:01.461697029Z [2024-06-28T01:30:01.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:25:00+00:00 exited with status queued for try_number 1 2024-06-28T01:30:01.461709027Z [2024-06-28T01:30:01.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:28:00+00:00 exited with status queued for try_number 1 2024-06-28T01:30:01.461715643Z [2024-06-28T01:30:01.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:29:00+00:00 exited with status queued for try_number 1 2024-06-28T01:30:01.461719170Z [2024-06-28T01:30:01.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:29:00+00:00 exited with status queued for try_number 1 2024-06-28T01:30:01.461878693Z [2024-06-28T01:30:01.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:29:00+00:00 exited with status queued for try_number 1 2024-06-28T01:30:01.476590751Z [2024-06-28T01:30:01.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbf55491-cf70-4228-9a22-025fdc009f2f 2024-06-28T01:30:01.477052423Z [2024-06-28T01:30:01.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d673443-d336-4dc7-8519-f7961b88ba26 2024-06-28T01:30:01.477289867Z [2024-06-28T01:30:01.477+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb0daf90-5115-45ee-af23-c5bcf6c6ab5e 2024-06-28T01:30:01.477563212Z [2024-06-28T01:30:01.477+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75aacfdc-eb12-413e-a5bb-349f8ff2f5f7 2024-06-28T01:30:01.477759543Z [2024-06-28T01:30:01.477+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe3b8ecc-dcb8-4f0e-8585-abad6d4e9fb1 2024-06-28T01:30:01.477941230Z [2024-06-28T01:30:01.477+0000] {scheduler_job.py:635} INFO - Setting external_id for to bce04dd7-03e9-4f2d-ab74-90fb3aefb864 2024-06-28T01:30:02.800812562Z [2024-06-28T01:30:02.800+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:30:02.801887234Z [2024-06-28T01:30:02.801+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:28:00+00:00, run_id=scheduled__2024-06-28T01:28:00+00:00, run_start_date=2024-06-28 01:30:00.650768+00:00, run_end_date=2024-06-28 01:30:02.801480+00:00, run_duration=2.150712, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:28:00+00:00, data_interval_end=2024-06-28 01:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:30:02.811462420Z [2024-06-28T01:30:02.811+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:30:00+00:00, run_after=2024-06-28T01:32:00+00:00 2024-06-28T01:30:02.943434429Z [2024-06-28T01:30:02.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:28:00+00:00 exited with status success for try_number 1 2024-06-28T01:30:02.951606964Z [2024-06-28T01:30:02.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:28:00+00:00, map_index=-1, run_start_date=2024-06-28 01:30:01.845397+00:00, run_end_date=2024-06-28 01:30:02.519584+00:00, run_duration=0.674187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=788, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:30:00.802606+00:00, queued_by_job_id=2, pid=11520 2024-06-28T01:30:04.056286514Z [2024-06-28T01:30:04.055+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:30:04.056480572Z [2024-06-28T01:30:04.056+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:29:00+00:00, run_id=scheduled__2024-06-28T01:29:00+00:00, run_start_date=2024-06-28 01:30:00.652160+00:00, run_end_date=2024-06-28 01:30:04.056186+00:00, run_duration=3.404026, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:29:00+00:00, data_interval_end=2024-06-28 01:30:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:30:04.083343466Z [2024-06-28T01:30:04.079+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:30:00+00:00, run_after=2024-06-28T01:31:00+00:00 2024-06-28T01:30:04.247982879Z [2024-06-28T01:30:04.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:25:00+00:00 exited with status failed for try_number 1 2024-06-28T01:30:04.248396779Z [2024-06-28T01:30:04.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:29:00+00:00 exited with status success for try_number 1 2024-06-28T01:30:04.260286869Z [2024-06-28T01:30:04.259+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T01:25:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:30:00.802606+00:00, queued_by_job_id=2, pid=None 2024-06-28T01:30:04.261563399Z [2024-06-28T01:30:04.261+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T01:30:04.269425072Z [2024-06-28T01:30:04.269+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T01:30:04.288236758Z [2024-06-28T01:30:04.287+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c, task_id=extract_metrics_from_vnfrs, execution_date=20240628T012500, start_date=, end_date=20240628T013004 2024-06-28T01:30:04.322415614Z [2024-06-28T01:30:04.322+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:29:00+00:00, map_index=-1, run_start_date=2024-06-28 01:30:02.477094+00:00, run_end_date=2024-06-28 01:30:03.066430+00:00, run_duration=0.589336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=789, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:30:00.802606+00:00, queued_by_job_id=2, pid=11531 2024-06-28T01:30:05.775730574Z [2024-06-28T01:30:05.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:30:05.775898044Z [2024-06-28T01:30:05.775+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:29:00+00:00, run_id=scheduled__2024-06-28T01:29:00+00:00, run_start_date=2024-06-28 01:30:00.653304+00:00, run_end_date=2024-06-28 01:30:05.775652+00:00, run_duration=5.122348, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:29:00+00:00, data_interval_end=2024-06-28 01:30:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:30:05.795004226Z [2024-06-28T01:30:05.794+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:30:00+00:00, run_after=2024-06-28T01:31:00+00:00 2024-06-28T01:30:05.835715535Z [2024-06-28T01:30:05.835+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:30:05.835741726Z 2024-06-28T01:30:05.835874578Z [2024-06-28T01:30:05.835+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:30:05.836449343Z [2024-06-28T01:30:05.836+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:30:05.836462151Z 2024-06-28T01:30:05.838847045Z [2024-06-28T01:30:05.838+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T01:30:05.838860662Z [2024-06-28T01:30:05.838+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:30:05.922589197Z [2024-06-28T01:30:05.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:25:00+00:00 exited with status queued for try_number 1 2024-06-28T01:30:05.922628495Z [2024-06-28T01:30:05.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:25:00+00:00 exited with status success for try_number 1 2024-06-28T01:30:05.922638294Z [2024-06-28T01:30:05.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:29:00+00:00 exited with status success for try_number 1 2024-06-28T01:30:05.928793340Z [2024-06-28T01:30:05.928+0000] {scheduler_job.py:635} INFO - Setting external_id for to b60cd54f-fc31-457b-9e47-6dd831e6c62a 2024-06-28T01:30:05.928950839Z [2024-06-28T01:30:05.928+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T01:25:00+00:00, map_index=-1, run_start_date=2024-06-28 01:30:04.271579+00:00, run_end_date=2024-06-28 01:30:04.765621+00:00, run_duration=0.494042, state=success, executor_state=success, try_number=1, max_tries=1, job_id=792, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:30:00.802606+00:00, queued_by_job_id=2, pid=11568 2024-06-28T01:30:05.929041135Z [2024-06-28T01:30:05.928+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:29:00+00:00, map_index=-1, run_start_date=2024-06-28 01:30:03.991739+00:00, run_end_date=2024-06-28 01:30:05.475447+00:00, run_duration=1.483708, state=success, executor_state=success, try_number=1, max_tries=1, job_id=791, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:30:00.802606+00:00, queued_by_job_id=2, pid=11567 2024-06-28T01:30:07.076899468Z [2024-06-28T01:30:07.076+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:30:07.077167877Z [2024-06-28T01:30:07.076+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:29:00+00:00, run_id=scheduled__2024-06-28T01:29:00+00:00, run_start_date=2024-06-28 01:30:00.654449+00:00, run_end_date=2024-06-28 01:30:07.076634+00:00, run_duration=6.422185, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:29:00+00:00, data_interval_end=2024-06-28 01:30:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:30:07.090651176Z [2024-06-28T01:30:07.088+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:30:00+00:00, run_after=2024-06-28T01:31:00+00:00 2024-06-28T01:30:07.171910111Z [2024-06-28T01:30:07.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:29:00+00:00 exited with status success for try_number 1 2024-06-28T01:30:07.183808726Z [2024-06-28T01:30:07.183+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:29:00+00:00, map_index=-1, run_start_date=2024-06-28 01:30:03.996697+00:00, run_end_date=2024-06-28 01:30:06.394524+00:00, run_duration=2.397827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=790, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:30:00.802606+00:00, queued_by_job_id=2, pid=11566 2024-06-28T01:30:08.299413825Z [2024-06-28T01:30:08.298+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:30:08.299453504Z 2024-06-28T01:30:08.299670615Z [2024-06-28T01:30:08.299+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:30:08.300513470Z [2024-06-28T01:30:08.300+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:30:08.300520505Z 2024-06-28T01:30:08.304502005Z [2024-06-28T01:30:08.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T01:30:08.304877841Z [2024-06-28T01:30:08.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T01:30:08.354765731Z [2024-06-28T01:30:08.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:25:00+00:00 exited with status queued for try_number 1 2024-06-28T01:30:08.355029349Z [2024-06-28T01:30:08.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:25:00+00:00 exited with status success for try_number 1 2024-06-28T01:30:08.366794508Z [2024-06-28T01:30:08.366+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee3a702c-74a9-4de9-b9c3-c307c4c449ef 2024-06-28T01:30:08.367250970Z [2024-06-28T01:30:08.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T01:25:00+00:00, map_index=-1, run_start_date=2024-06-28 01:30:07.492174+00:00, run_end_date=2024-06-28 01:30:07.929728+00:00, run_duration=0.437554, state=success, executor_state=success, try_number=1, max_tries=1, job_id=793, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:30:05.836794+00:00, queued_by_job_id=2, pid=11591 2024-06-28T01:30:10.934262143Z [2024-06-28T01:30:10.933+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:30:10.934287951Z 2024-06-28T01:30:10.934307371Z [2024-06-28T01:30:10.934+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:30:10.934760065Z [2024-06-28T01:30:10.934+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:30:10.934774680Z 2024-06-28T01:30:10.938340688Z [2024-06-28T01:30:10.938+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:30:10.938600135Z [2024-06-28T01:30:10.938+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:30:10.992518038Z [2024-06-28T01:30:10.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:25:00+00:00 exited with status queued for try_number 1 2024-06-28T01:30:10.992861147Z [2024-06-28T01:30:10.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:25:00+00:00 exited with status success for try_number 1 2024-06-28T01:30:10.999825521Z [2024-06-28T01:30:10.999+0000] {scheduler_job.py:635} INFO - Setting external_id for to d373d5a4-f964-4684-933b-7bf523305dda 2024-06-28T01:30:11.000091927Z [2024-06-28T01:30:10.999+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T01:25:00+00:00, map_index=0, run_start_date=2024-06-28 01:30:09.960362+00:00, run_end_date=2024-06-28 01:30:10.299672+00:00, run_duration=0.33931, state=success, executor_state=success, try_number=1, max_tries=1, job_id=794, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:30:08.301095+00:00, queued_by_job_id=2, pid=11599 2024-06-28T01:30:13.912228130Z [2024-06-28T01:30:13.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:30:13.913105629Z [2024-06-28T01:30:13.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:25:00+00:00, run_id=scheduled__2024-06-28T01:25:00+00:00, run_start_date=2024-06-28 01:30:00.649402+00:00, run_end_date=2024-06-28 01:30:13.912491+00:00, run_duration=13.263089, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:25:00+00:00, data_interval_end=2024-06-28 01:30:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T01:30:13.925265631Z [2024-06-28T01:30:13.923+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:30:00+00:00, run_after=2024-06-28T01:35:00+00:00 2024-06-28T01:30:13.992264679Z [2024-06-28T01:30:13.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:25:00+00:00 exited with status success for try_number 1 2024-06-28T01:30:14.001426927Z [2024-06-28T01:30:14.000+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T01:25:00+00:00, map_index=-1, run_start_date=2024-06-28 01:30:12.498466+00:00, run_end_date=2024-06-28 01:30:12.879726+00:00, run_duration=0.38126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=795, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:30:10.935131+00:00, queued_by_job_id=2, pid=11607 2024-06-28T01:30:14.931197709Z [2024-06-28T01:30:14.930+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:30:14.931230969Z 2024-06-28T01:30:14.931478862Z [2024-06-28T01:30:14.931+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c has 0/16 running and queued tasks 2024-06-28T01:30:14.932174238Z [2024-06-28T01:30:14.931+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:30:14.932190288Z 2024-06-28T01:30:14.936458180Z [2024-06-28T01:30:14.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T01:25:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-06-28T01:30:14.936525084Z [2024-06-28T01:30:14.936+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:30:15.003487318Z [2024-06-28T01:30:15.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:25:00+00:00 exited with status queued for try_number 2 2024-06-28T01:30:15.011148746Z [2024-06-28T01:30:15.010+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c2bbb15-9bf1-4d71-963c-ab7546dbd05a 2024-06-28T01:30:17.403314643Z [2024-06-28T01:30:17.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:25:00+00:00 exited with status failed for try_number 2 2024-06-28T01:30:17.411428551Z [2024-06-28T01:30:17.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T01:25:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-06-28 01:30:04.273998+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:30:14.932613+00:00, queued_by_job_id=2, pid=None 2024-06-28T01:30:17.411948805Z [2024-06-28T01:30:17.411+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T01:30:17.414111761Z [2024-06-28T01:30:17.413+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-06-28T01:30:17.424186393Z [2024-06-28T01:30:17.423+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c, task_id=extract_metrics_from_vnfrs, execution_date=20240628T012500, start_date=, end_date=20240628T013017 2024-06-28T01:30:21.191993799Z [2024-06-28T01:30:21.191+0000] {dagrun.py:586} ERROR - Marking run failed 2024-06-28T01:30:21.194151888Z [2024-06-28T01:30:21.193+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c, execution_date=2024-06-28 01:25:00+00:00, run_id=scheduled__2024-06-28T01:25:00+00:00, run_start_date=2024-06-28 01:30:00.648010+00:00, run_end_date=2024-06-28 01:30:21.193412+00:00, run_duration=20.545402, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:25:00+00:00, data_interval_end=2024-06-28 01:30:00+00:00, dag_hash=0926c5e5b6c0c56ad4fdd92990c73f3a 2024-06-28T01:30:21.204615813Z [2024-06-28T01:30:21.204+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_076fc4b7-324b-45f5-920e-d02f7ab35f4c to 2024-06-28T01:30:00+00:00, run_after=2024-06-28T01:35:00+00:00 2024-06-28T01:30:38.567634999Z [2024-06-28T01:30:38.566+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:30:38.567739990Z 2024-06-28T01:30:38.567802912Z [2024-06-28T01:30:38.567+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-06-28T01:30:38.568583222Z [2024-06-28T01:30:38.568+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:30:38.568655438Z 2024-06-28T01:30:38.572694990Z [2024-06-28T01:30:38.572+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240628013037_951780', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:30:38.573421550Z [2024-06-28T01:30:38.572+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240628013037_951780', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-06-28T01:30:38.627591610Z [2024-06-28T01:30:38.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240628013037_951780 exited with status queued for try_number 1 2024-06-28T01:30:38.637081698Z [2024-06-28T01:30:38.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26abc117-6f56-480b-b9d0-00d41aa05e4b 2024-06-28T01:30:40.413259221Z [2024-06-28T01:30:40.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:30:40.413618011Z [2024-06-28T01:30:40.413+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-06-28 01:30:38.003695+00:00, run_id=vdu_down_20240628013037_951780, run_start_date=2024-06-28 01:30:38.512490+00:00, run_end_date=2024-06-28 01:30:40.413319+00:00, run_duration=1.900829, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-06-28 01:30:38.003695+00:00, data_interval_end=2024-06-28 01:30:38.003695+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-06-28T01:30:40.417296186Z [2024-06-28T01:30:40.417+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-06-28T01:30:40.468087105Z [2024-06-28T01:30:40.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240628013037_951780 exited with status success for try_number 1 2024-06-28T01:30:40.477276584Z [2024-06-28T01:30:40.476+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240628013037_951780, map_index=-1, run_start_date=2024-06-28 01:30:39.429103+00:00, run_end_date=2024-06-28 01:30:39.822320+00:00, run_duration=0.393217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=796, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:30:38.569033+00:00, queued_by_job_id=2, pid=11634 2024-06-28T01:31:00.760335842Z [2024-06-28T01:31:00.759+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:31:00+00:00, run_after=2024-06-28T01:32:00+00:00 2024-06-28T01:31:00.768024925Z [2024-06-28T01:31:00.767+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:31:00.780196257Z [2024-06-28T01:31:00.779+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:31:00+00:00, run_after=2024-06-28T01:32:00+00:00 2024-06-28T01:31:00.884873096Z [2024-06-28T01:31:00.884+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:31:00.884922361Z 2024-06-28T01:31:00.884931901Z 2024-06-28T01:31:00.884970355Z 2024-06-28T01:31:00.885394811Z [2024-06-28T01:31:00.884+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:31:00.886055606Z [2024-06-28T01:31:00.885+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:31:00.886560971Z [2024-06-28T01:31:00.886+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:31:00.888218462Z [2024-06-28T01:31:00.887+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:31:00.888238454Z 2024-06-28T01:31:00.888245996Z 2024-06-28T01:31:00.888252983Z 2024-06-28T01:31:00.895175590Z [2024-06-28T01:31:00.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:31:00.895642352Z [2024-06-28T01:31:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:31:00.896085017Z [2024-06-28T01:31:00.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:31:00.896481691Z [2024-06-28T01:31:00.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:31:00.897308977Z [2024-06-28T01:31:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:31:00.897546021Z [2024-06-28T01:31:00.897+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:31:01.182718157Z [2024-06-28T01:31:01.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:30:00+00:00 exited with status queued for try_number 1 2024-06-28T01:31:01.182845686Z [2024-06-28T01:31:01.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:30:00+00:00 exited with status queued for try_number 1 2024-06-28T01:31:01.182982760Z [2024-06-28T01:31:01.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:30:00+00:00 exited with status queued for try_number 1 2024-06-28T01:31:01.191880638Z [2024-06-28T01:31:01.191+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84b9bcc7-28f2-48f7-aec0-3a0509e04205 2024-06-28T01:31:01.191981639Z [2024-06-28T01:31:01.191+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1edb7ead-8781-4470-98b0-ce25778c2bdf 2024-06-28T01:31:01.192141852Z [2024-06-28T01:31:01.191+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc094f83-f789-4428-a25f-5f9ab544d36c 2024-06-28T01:31:02.342937591Z [2024-06-28T01:31:02.342+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:31:02.343560250Z [2024-06-28T01:31:02.343+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:30:00+00:00, run_id=scheduled__2024-06-28T01:30:00+00:00, run_start_date=2024-06-28 01:31:00.792780+00:00, run_end_date=2024-06-28 01:31:02.343115+00:00, run_duration=1.550335, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:30:00+00:00, data_interval_end=2024-06-28 01:31:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:31:02.353717207Z [2024-06-28T01:31:02.353+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:31:00+00:00, run_after=2024-06-28T01:32:00+00:00 2024-06-28T01:31:02.403511665Z [2024-06-28T01:31:02.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:30:00+00:00 exited with status success for try_number 1 2024-06-28T01:31:02.408976484Z [2024-06-28T01:31:02.408+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:30:00+00:00, map_index=-1, run_start_date=2024-06-28 01:31:01.649686+00:00, run_end_date=2024-06-28 01:31:02.025519+00:00, run_duration=0.375833, state=success, executor_state=success, try_number=1, max_tries=1, job_id=797, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:31:00.890045+00:00, queued_by_job_id=2, pid=11648 2024-06-28T01:31:04.569653363Z [2024-06-28T01:31:04.569+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:31:04.570265935Z [2024-06-28T01:31:04.569+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:30:00+00:00, run_id=scheduled__2024-06-28T01:30:00+00:00, run_start_date=2024-06-28 01:31:00.794004+00:00, run_end_date=2024-06-28 01:31:04.569856+00:00, run_duration=3.775852, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:30:00+00:00, data_interval_end=2024-06-28 01:31:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:31:04.582291441Z [2024-06-28T01:31:04.581+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:31:00+00:00, run_after=2024-06-28T01:32:00+00:00 2024-06-28T01:31:04.627976562Z [2024-06-28T01:31:04.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:30:00+00:00 exited with status success for try_number 1 2024-06-28T01:31:04.635977246Z [2024-06-28T01:31:04.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:30:00+00:00, map_index=-1, run_start_date=2024-06-28 01:31:02.715952+00:00, run_end_date=2024-06-28 01:31:04.292624+00:00, run_duration=1.576672, state=success, executor_state=success, try_number=1, max_tries=1, job_id=799, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:31:00.890045+00:00, queued_by_job_id=2, pid=11667 2024-06-28T01:31:05.690387618Z [2024-06-28T01:31:05.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:31:05.690901750Z [2024-06-28T01:31:05.690+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:30:00+00:00, run_id=scheduled__2024-06-28T01:30:00+00:00, run_start_date=2024-06-28 01:31:00.795155+00:00, run_end_date=2024-06-28 01:31:05.690491+00:00, run_duration=4.895336, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:30:00+00:00, data_interval_end=2024-06-28 01:31:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:31:05.700531833Z [2024-06-28T01:31:05.700+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:31:00+00:00, run_after=2024-06-28T01:32:00+00:00 2024-06-28T01:31:05.774718295Z [2024-06-28T01:31:05.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:30:00+00:00 exited with status success for try_number 1 2024-06-28T01:31:05.781226946Z [2024-06-28T01:31:05.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:30:00+00:00, map_index=-1, run_start_date=2024-06-28 01:31:02.695925+00:00, run_end_date=2024-06-28 01:31:05.471669+00:00, run_duration=2.775744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=798, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:31:00.890045+00:00, queued_by_job_id=2, pid=11666 2024-06-28T01:31:46.540381597Z [2024-06-28T01:31:46.539+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T01:32:00.300182687Z [2024-06-28T01:32:00.299+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:32:00.317472398Z [2024-06-28T01:32:00.317+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:32:00+00:00, run_after=2024-06-28T01:33:00+00:00 2024-06-28T01:32:00.334250638Z [2024-06-28T01:32:00.333+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:32:00+00:00, run_after=2024-06-28T01:33:00+00:00 2024-06-28T01:32:00.341848137Z [2024-06-28T01:32:00.341+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:32:00.421698761Z [2024-06-28T01:32:00.421+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:32:00.421725093Z 2024-06-28T01:32:00.421729383Z 2024-06-28T01:32:00.421732657Z 2024-06-28T01:32:00.421736077Z 2024-06-28T01:32:00.421739706Z [2024-06-28T01:32:00.421+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:32:00.421749862Z [2024-06-28T01:32:00.421+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:32:00.421850634Z [2024-06-28T01:32:00.421+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:32:00.421884942Z [2024-06-28T01:32:00.421+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:32:00.422494953Z [2024-06-28T01:32:00.422+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:32:00.422506861Z 2024-06-28T01:32:00.422510590Z 2024-06-28T01:32:00.422513910Z 2024-06-28T01:32:00.422517069Z 2024-06-28T01:32:00.427065030Z [2024-06-28T01:32:00.426+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:32:00.427249003Z [2024-06-28T01:32:00.426+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:32:00.427613268Z [2024-06-28T01:32:00.427+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:32:00.427756826Z [2024-06-28T01:32:00.427+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:32:00.428052590Z [2024-06-28T01:32:00.427+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:32:00.428173523Z [2024-06-28T01:32:00.428+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:32:00.428466154Z [2024-06-28T01:32:00.428+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:32:00.428562709Z [2024-06-28T01:32:00.428+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:32:00.723753672Z [2024-06-28T01:32:00.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:30:00+00:00 exited with status queued for try_number 1 2024-06-28T01:32:00.724086132Z [2024-06-28T01:32:00.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:31:00+00:00 exited with status queued for try_number 1 2024-06-28T01:32:00.724191407Z [2024-06-28T01:32:00.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:31:00+00:00 exited with status queued for try_number 1 2024-06-28T01:32:00.724312689Z [2024-06-28T01:32:00.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:31:00+00:00 exited with status queued for try_number 1 2024-06-28T01:32:00.733560550Z [2024-06-28T01:32:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2651bff-5cd7-44c0-a167-613dd1d235f2 2024-06-28T01:32:00.733725930Z [2024-06-28T01:32:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 344de734-e24a-4607-9900-064577c4c4ae 2024-06-28T01:32:00.733871371Z [2024-06-28T01:32:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 881c4475-1635-4b28-b3b4-e956538a1aaf 2024-06-28T01:32:00.734017614Z [2024-06-28T01:32:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 513e7c98-327b-4127-abdd-18ed57818db5 2024-06-28T01:32:01.939422610Z [2024-06-28T01:32:01.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:32:01.939919038Z [2024-06-28T01:32:01.939+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:30:00+00:00, run_id=scheduled__2024-06-28T01:30:00+00:00, run_start_date=2024-06-28 01:32:00.358337+00:00, run_end_date=2024-06-28 01:32:01.939319+00:00, run_duration=1.580982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:30:00+00:00, data_interval_end=2024-06-28 01:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:32:01.952610248Z [2024-06-28T01:32:01.952+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:32:00+00:00, run_after=2024-06-28T01:34:00+00:00 2024-06-28T01:32:01.960405285Z [2024-06-28T01:32:01.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:32:01.960818498Z [2024-06-28T01:32:01.960+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:31:00+00:00, run_id=scheduled__2024-06-28T01:31:00+00:00, run_start_date=2024-06-28 01:32:00.361052+00:00, run_end_date=2024-06-28 01:32:01.960305+00:00, run_duration=1.599253, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:31:00+00:00, data_interval_end=2024-06-28 01:32:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:32:01.974401653Z [2024-06-28T01:32:01.974+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:32:00+00:00, run_after=2024-06-28T01:33:00+00:00 2024-06-28T01:32:02.029716586Z [2024-06-28T01:32:02.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:30:00+00:00 exited with status success for try_number 1 2024-06-28T01:32:02.035971640Z [2024-06-28T01:32:02.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:30:00+00:00, map_index=-1, run_start_date=2024-06-28 01:32:01.154984+00:00, run_end_date=2024-06-28 01:32:01.501402+00:00, run_duration=0.346418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=800, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:32:00.423316+00:00, queued_by_job_id=2, pid=11701 2024-06-28T01:32:03.133018067Z [2024-06-28T01:32:03.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:31:00+00:00 exited with status success for try_number 1 2024-06-28T01:32:03.138251616Z [2024-06-28T01:32:03.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:31:00+00:00, map_index=-1, run_start_date=2024-06-28 01:32:01.382634+00:00, run_end_date=2024-06-28 01:32:01.888515+00:00, run_duration=0.505881, state=success, executor_state=success, try_number=1, max_tries=1, job_id=801, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:32:00.423316+00:00, queued_by_job_id=2, pid=11702 2024-06-28T01:32:04.185547938Z [2024-06-28T01:32:04.184+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:32:04.185855347Z [2024-06-28T01:32:04.185+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:31:00+00:00, run_id=scheduled__2024-06-28T01:31:00+00:00, run_start_date=2024-06-28 01:32:00.362194+00:00, run_end_date=2024-06-28 01:32:04.185420+00:00, run_duration=3.823226, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:31:00+00:00, data_interval_end=2024-06-28 01:32:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:32:04.195349861Z [2024-06-28T01:32:04.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:32:00+00:00, run_after=2024-06-28T01:33:00+00:00 2024-06-28T01:32:04.240948056Z [2024-06-28T01:32:04.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:31:00+00:00 exited with status success for try_number 1 2024-06-28T01:32:04.259970892Z [2024-06-28T01:32:04.259+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:31:00+00:00, map_index=-1, run_start_date=2024-06-28 01:32:02.351868+00:00, run_end_date=2024-06-28 01:32:03.816950+00:00, run_duration=1.465082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=802, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:32:00.423316+00:00, queued_by_job_id=2, pid=11725 2024-06-28T01:32:05.317226572Z [2024-06-28T01:32:05.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:32:05.317272240Z [2024-06-28T01:32:05.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:31:00+00:00, run_id=scheduled__2024-06-28T01:31:00+00:00, run_start_date=2024-06-28 01:32:00.363222+00:00, run_end_date=2024-06-28 01:32:05.316957+00:00, run_duration=4.953735, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:31:00+00:00, data_interval_end=2024-06-28 01:32:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:32:05.327119956Z [2024-06-28T01:32:05.326+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:32:00+00:00, run_after=2024-06-28T01:33:00+00:00 2024-06-28T01:32:05.356672710Z [2024-06-28T01:32:05.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:31:00+00:00 exited with status success for try_number 1 2024-06-28T01:32:05.361270134Z [2024-06-28T01:32:05.360+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:31:00+00:00, map_index=-1, run_start_date=2024-06-28 01:32:02.450179+00:00, run_end_date=2024-06-28 01:32:04.245682+00:00, run_duration=1.795503, state=success, executor_state=success, try_number=1, max_tries=1, job_id=803, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:32:00.423316+00:00, queued_by_job_id=2, pid=11726 2024-06-28T01:33:00.750532379Z [2024-06-28T01:33:00.749+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:33:00+00:00, run_after=2024-06-28T01:34:00+00:00 2024-06-28T01:33:00.759086925Z [2024-06-28T01:33:00.758+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:33:00.772631329Z [2024-06-28T01:33:00.772+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:33:00+00:00, run_after=2024-06-28T01:34:00+00:00 2024-06-28T01:33:00.849090153Z [2024-06-28T01:33:00.848+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:33:00.849124898Z 2024-06-28T01:33:00.849129106Z 2024-06-28T01:33:00.849132691Z 2024-06-28T01:33:00.849558371Z [2024-06-28T01:33:00.848+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:33:00.849982215Z [2024-06-28T01:33:00.849+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:33:00.850320340Z [2024-06-28T01:33:00.850+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:33:00.852333150Z [2024-06-28T01:33:00.851+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:33:00.852394465Z 2024-06-28T01:33:00.852404503Z 2024-06-28T01:33:00.852411589Z 2024-06-28T01:33:00.856809586Z [2024-06-28T01:33:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:33:00.857077283Z [2024-06-28T01:33:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:33:00.857510055Z [2024-06-28T01:33:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:33:00.857820009Z [2024-06-28T01:33:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:33:00.858041231Z [2024-06-28T01:33:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:33:00.858084952Z [2024-06-28T01:33:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:33:01.143821901Z [2024-06-28T01:33:01.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:32:00+00:00 exited with status queued for try_number 1 2024-06-28T01:33:01.146992935Z [2024-06-28T01:33:01.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:32:00+00:00 exited with status queued for try_number 1 2024-06-28T01:33:01.147203827Z [2024-06-28T01:33:01.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:32:00+00:00 exited with status queued for try_number 1 2024-06-28T01:33:01.155682641Z [2024-06-28T01:33:01.155+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e6c83b7-18f7-4775-88a7-56090f341274 2024-06-28T01:33:01.156069965Z [2024-06-28T01:33:01.155+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e344473-d317-4871-be55-1e3994c173d2 2024-06-28T01:33:01.156371059Z [2024-06-28T01:33:01.156+0000] {scheduler_job.py:635} INFO - Setting external_id for to db140728-8a7c-45b8-829c-927720af2dc9 2024-06-28T01:33:02.309940343Z [2024-06-28T01:33:02.309+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:33:02.310597605Z [2024-06-28T01:33:02.310+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:32:00+00:00, run_id=scheduled__2024-06-28T01:32:00+00:00, run_start_date=2024-06-28 01:33:00.785314+00:00, run_end_date=2024-06-28 01:33:02.310122+00:00, run_duration=1.524808, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:32:00+00:00, data_interval_end=2024-06-28 01:33:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:33:02.334911056Z [2024-06-28T01:33:02.334+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:33:00+00:00, run_after=2024-06-28T01:34:00+00:00 2024-06-28T01:33:02.379307275Z [2024-06-28T01:33:02.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:32:00+00:00 exited with status success for try_number 1 2024-06-28T01:33:02.384468320Z [2024-06-28T01:33:02.384+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:32:00+00:00, map_index=-1, run_start_date=2024-06-28 01:33:01.625327+00:00, run_end_date=2024-06-28 01:33:01.970192+00:00, run_duration=0.344865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=804, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:33:00.853362+00:00, queued_by_job_id=2, pid=11758 2024-06-28T01:33:05.222842922Z [2024-06-28T01:33:05.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:33:05.223187445Z [2024-06-28T01:33:05.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:32:00+00:00, run_id=scheduled__2024-06-28T01:32:00+00:00, run_start_date=2024-06-28 01:33:00.786795+00:00, run_end_date=2024-06-28 01:33:05.222726+00:00, run_duration=4.435931, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:32:00+00:00, data_interval_end=2024-06-28 01:33:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:33:05.235065890Z [2024-06-28T01:33:05.234+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:33:00+00:00, run_after=2024-06-28T01:34:00+00:00 2024-06-28T01:33:05.243895569Z [2024-06-28T01:33:05.243+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:33:05.245885770Z [2024-06-28T01:33:05.245+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:32:00+00:00, run_id=scheduled__2024-06-28T01:32:00+00:00, run_start_date=2024-06-28 01:33:00.788358+00:00, run_end_date=2024-06-28 01:33:05.243838+00:00, run_duration=4.45548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:32:00+00:00, data_interval_end=2024-06-28 01:33:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:33:05.260303976Z [2024-06-28T01:33:05.260+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:33:00+00:00, run_after=2024-06-28T01:34:00+00:00 2024-06-28T01:33:05.300864557Z [2024-06-28T01:33:05.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:32:00+00:00 exited with status success for try_number 1 2024-06-28T01:33:05.300917468Z [2024-06-28T01:33:05.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:32:00+00:00 exited with status success for try_number 1 2024-06-28T01:33:05.306192778Z [2024-06-28T01:33:05.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:32:00+00:00, map_index=-1, run_start_date=2024-06-28 01:33:02.651934+00:00, run_end_date=2024-06-28 01:33:04.139405+00:00, run_duration=1.487471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=806, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:33:00.853362+00:00, queued_by_job_id=2, pid=11777 2024-06-28T01:33:05.306379039Z [2024-06-28T01:33:05.306+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:32:00+00:00, map_index=-1, run_start_date=2024-06-28 01:33:02.589404+00:00, run_end_date=2024-06-28 01:33:04.564862+00:00, run_duration=1.975458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=805, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:33:00.853362+00:00, queued_by_job_id=2, pid=11776 2024-06-28T01:34:00.141578796Z [2024-06-28T01:34:00.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:34:00+00:00, run_after=2024-06-28T01:35:00+00:00 2024-06-28T01:34:00.158487437Z [2024-06-28T01:34:00.158+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:34:00.180090464Z [2024-06-28T01:34:00.179+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:34:00+00:00, run_after=2024-06-28T01:35:00+00:00 2024-06-28T01:34:00.189797713Z [2024-06-28T01:34:00.189+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:34:00.278788354Z [2024-06-28T01:34:00.278+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:34:00.278816426Z 2024-06-28T01:34:00.278822176Z 2024-06-28T01:34:00.278826535Z 2024-06-28T01:34:00.278830707Z 2024-06-28T01:34:00.279937271Z [2024-06-28T01:34:00.279+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:34:00.280282666Z [2024-06-28T01:34:00.280+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:34:00.280592847Z [2024-06-28T01:34:00.280+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:34:00.280939868Z [2024-06-28T01:34:00.280+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:34:00.281873095Z [2024-06-28T01:34:00.281+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:34:00.281887840Z 2024-06-28T01:34:00.281892707Z 2024-06-28T01:34:00.281897318Z 2024-06-28T01:34:00.281901692Z 2024-06-28T01:34:00.286655291Z [2024-06-28T01:34:00.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:34:00.287147694Z [2024-06-28T01:34:00.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:34:00.287637114Z [2024-06-28T01:34:00.287+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:34:00.287936647Z [2024-06-28T01:34:00.287+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:34:00.288335463Z [2024-06-28T01:34:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:34:00.288600630Z [2024-06-28T01:34:00.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:34:00.288949813Z [2024-06-28T01:34:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:34:00.289202461Z [2024-06-28T01:34:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:34:00.987735617Z [2024-06-28T01:34:00.987+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:32:00+00:00 exited with status queued for try_number 1 2024-06-28T01:34:00.990321311Z [2024-06-28T01:34:00.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:33:00+00:00 exited with status queued for try_number 1 2024-06-28T01:34:00.990576080Z [2024-06-28T01:34:00.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:33:00+00:00 exited with status queued for try_number 1 2024-06-28T01:34:00.990815765Z [2024-06-28T01:34:00.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:33:00+00:00 exited with status queued for try_number 1 2024-06-28T01:34:01.011237627Z [2024-06-28T01:34:01.009+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d2bf3e3-12aa-429c-a5c5-c81c00d9a42f 2024-06-28T01:34:01.011600941Z [2024-06-28T01:34:01.011+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0cf4cf04-9098-4815-a979-d45e6ca1f6c1 2024-06-28T01:34:01.011849964Z [2024-06-28T01:34:01.011+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80d11264-bc6f-41e4-93c1-cd2aa522c306 2024-06-28T01:34:01.012142964Z [2024-06-28T01:34:01.011+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5eb5eb55-9d02-4309-aea4-4f95730cba63 2024-06-28T01:34:02.224725441Z [2024-06-28T01:34:02.224+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:34:02.225264741Z [2024-06-28T01:34:02.225+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:32:00+00:00, run_id=scheduled__2024-06-28T01:32:00+00:00, run_start_date=2024-06-28 01:34:00.202399+00:00, run_end_date=2024-06-28 01:34:02.224905+00:00, run_duration=2.022506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:32:00+00:00, data_interval_end=2024-06-28 01:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:34:02.237796617Z [2024-06-28T01:34:02.237+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:34:00+00:00, run_after=2024-06-28T01:36:00+00:00 2024-06-28T01:34:02.252709807Z [2024-06-28T01:34:02.252+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:34:02.255433189Z [2024-06-28T01:34:02.255+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:33:00+00:00, run_id=scheduled__2024-06-28T01:33:00+00:00, run_start_date=2024-06-28 01:34:00.203641+00:00, run_end_date=2024-06-28 01:34:02.254998+00:00, run_duration=2.051357, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:33:00+00:00, data_interval_end=2024-06-28 01:34:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:34:02.274957681Z [2024-06-28T01:34:02.274+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:34:00+00:00, run_after=2024-06-28T01:35:00+00:00 2024-06-28T01:34:02.367779802Z [2024-06-28T01:34:02.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:32:00+00:00 exited with status success for try_number 1 2024-06-28T01:34:02.367878588Z [2024-06-28T01:34:02.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:33:00+00:00 exited with status success for try_number 1 2024-06-28T01:34:02.375765687Z [2024-06-28T01:34:02.375+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:32:00+00:00, map_index=-1, run_start_date=2024-06-28 01:34:01.080520+00:00, run_end_date=2024-06-28 01:34:01.556999+00:00, run_duration=0.476479, state=success, executor_state=success, try_number=1, max_tries=1, job_id=807, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:34:00.283322+00:00, queued_by_job_id=2, pid=11810 2024-06-28T01:34:02.375914916Z [2024-06-28T01:34:02.375+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:33:00+00:00, map_index=-1, run_start_date=2024-06-28 01:34:01.325641+00:00, run_end_date=2024-06-28 01:34:01.819554+00:00, run_duration=0.493913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=808, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:34:00.283322+00:00, queued_by_job_id=2, pid=11811 2024-06-28T01:34:05.136081863Z [2024-06-28T01:34:05.135+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:34:05.136607301Z [2024-06-28T01:34:05.136+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:33:00+00:00, run_id=scheduled__2024-06-28T01:33:00+00:00, run_start_date=2024-06-28 01:34:00.204681+00:00, run_end_date=2024-06-28 01:34:05.136234+00:00, run_duration=4.931553, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:33:00+00:00, data_interval_end=2024-06-28 01:34:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:34:05.145345348Z [2024-06-28T01:34:05.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:34:00+00:00, run_after=2024-06-28T01:35:00+00:00 2024-06-28T01:34:05.194533083Z [2024-06-28T01:34:05.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:33:00+00:00 exited with status success for try_number 1 2024-06-28T01:34:05.199868700Z [2024-06-28T01:34:05.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:33:00+00:00, map_index=-1, run_start_date=2024-06-28 01:34:02.660462+00:00, run_end_date=2024-06-28 01:34:04.547184+00:00, run_duration=1.886722, state=success, executor_state=success, try_number=1, max_tries=1, job_id=809, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:34:00.283322+00:00, queued_by_job_id=2, pid=11829 2024-06-28T01:34:06.249630176Z [2024-06-28T01:34:06.248+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:34:06.250063352Z [2024-06-28T01:34:06.249+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:33:00+00:00, run_id=scheduled__2024-06-28T01:33:00+00:00, run_start_date=2024-06-28 01:34:00.205772+00:00, run_end_date=2024-06-28 01:34:06.249632+00:00, run_duration=6.04386, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:33:00+00:00, data_interval_end=2024-06-28 01:34:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:34:06.263025872Z [2024-06-28T01:34:06.262+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:34:00+00:00, run_after=2024-06-28T01:35:00+00:00 2024-06-28T01:34:06.301392380Z [2024-06-28T01:34:06.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:33:00+00:00 exited with status success for try_number 1 2024-06-28T01:34:06.307344674Z [2024-06-28T01:34:06.306+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:33:00+00:00, map_index=-1, run_start_date=2024-06-28 01:34:02.909593+00:00, run_end_date=2024-06-28 01:34:06.051979+00:00, run_duration=3.142386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=810, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:34:00.283322+00:00, queued_by_job_id=2, pid=11840 2024-06-28T01:35:00.956678557Z [2024-06-28T01:35:00.955+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:35:00+00:00, run_after=2024-06-28T01:40:00+00:00 2024-06-28T01:35:00.973379464Z [2024-06-28T01:35:00.972+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:35:00+00:00, run_after=2024-06-28T01:36:00+00:00 2024-06-28T01:35:00.984272459Z [2024-06-28T01:35:00.983+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:35:01.003770905Z [2024-06-28T01:35:01.003+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:35:00+00:00, run_after=2024-06-28T01:36:00+00:00 2024-06-28T01:35:01.144422248Z [2024-06-28T01:35:01.143+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:35:01.144453934Z 2024-06-28T01:35:01.144460247Z 2024-06-28T01:35:01.144464864Z 2024-06-28T01:35:01.144469614Z 2024-06-28T01:35:01.144716826Z [2024-06-28T01:35:01.144+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:35:01.144994988Z [2024-06-28T01:35:01.144+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:35:01.145279023Z [2024-06-28T01:35:01.145+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:35:01.145537892Z [2024-06-28T01:35:01.145+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:35:01.147485582Z [2024-06-28T01:35:01.146+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:35:01.147504085Z 2024-06-28T01:35:01.147522959Z 2024-06-28T01:35:01.147528348Z 2024-06-28T01:35:01.147533400Z 2024-06-28T01:35:01.153696555Z [2024-06-28T01:35:01.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T01:35:01.153946126Z [2024-06-28T01:35:01.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:35:01.154314986Z [2024-06-28T01:35:01.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:35:01.154564146Z [2024-06-28T01:35:01.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:35:01.154929455Z [2024-06-28T01:35:01.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:35:01.155187968Z [2024-06-28T01:35:01.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:35:01.155541239Z [2024-06-28T01:35:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:35:01.155756614Z [2024-06-28T01:35:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:35:01.512144031Z [2024-06-28T01:35:01.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:30:00+00:00 exited with status queued for try_number 1 2024-06-28T01:35:01.512211069Z [2024-06-28T01:35:01.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:34:00+00:00 exited with status queued for try_number 1 2024-06-28T01:35:01.512438807Z [2024-06-28T01:35:01.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:34:00+00:00 exited with status queued for try_number 1 2024-06-28T01:35:01.512557716Z [2024-06-28T01:35:01.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:34:00+00:00 exited with status queued for try_number 1 2024-06-28T01:35:01.529641622Z [2024-06-28T01:35:01.529+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6388dc1-6f83-43ee-b9a5-72567d228dd6 2024-06-28T01:35:01.529864678Z [2024-06-28T01:35:01.529+0000] {scheduler_job.py:635} INFO - Setting external_id for to 347dff18-ebd3-4a92-b11e-7d96cbfba9fe 2024-06-28T01:35:01.530071926Z [2024-06-28T01:35:01.529+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2af45d8-dfaa-4dc6-a40b-dec2b10adaba 2024-06-28T01:35:01.530292995Z [2024-06-28T01:35:01.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06c44010-915b-4294-a83d-629f4248338c 2024-06-28T01:35:02.712638490Z [2024-06-28T01:35:02.712+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:35:02.713117490Z [2024-06-28T01:35:02.712+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:34:00+00:00, run_id=scheduled__2024-06-28T01:34:00+00:00, run_start_date=2024-06-28 01:35:01.024823+00:00, run_end_date=2024-06-28 01:35:02.712553+00:00, run_duration=1.68773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:34:00+00:00, data_interval_end=2024-06-28 01:35:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:35:02.728879836Z [2024-06-28T01:35:02.728+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:35:00+00:00, run_after=2024-06-28T01:36:00+00:00 2024-06-28T01:35:02.773129045Z [2024-06-28T01:35:02.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:34:00+00:00 exited with status success for try_number 1 2024-06-28T01:35:02.780517816Z [2024-06-28T01:35:02.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:34:00+00:00, map_index=-1, run_start_date=2024-06-28 01:35:01.912272+00:00, run_end_date=2024-06-28 01:35:02.328799+00:00, run_duration=0.416527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=811, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:35:01.149119+00:00, queued_by_job_id=2, pid=11867 2024-06-28T01:35:03.889590973Z [2024-06-28T01:35:03.889+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:35:03.889624346Z 2024-06-28T01:35:03.889840545Z [2024-06-28T01:35:03.889+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:35:03.891013719Z [2024-06-28T01:35:03.890+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:35:03.891033566Z 2024-06-28T01:35:03.894614690Z [2024-06-28T01:35:03.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T01:35:03.894951838Z [2024-06-28T01:35:03.894+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:35:03.955844967Z [2024-06-28T01:35:03.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:30:00+00:00 exited with status queued for try_number 1 2024-06-28T01:35:03.958140579Z [2024-06-28T01:35:03.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:30:00+00:00 exited with status success for try_number 1 2024-06-28T01:35:03.965011769Z [2024-06-28T01:35:03.964+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9b3c18c-4e09-411d-8bdb-af7f6a544085 2024-06-28T01:35:03.965398394Z [2024-06-28T01:35:03.965+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T01:30:00+00:00, map_index=-1, run_start_date=2024-06-28 01:35:03.169787+00:00, run_end_date=2024-06-28 01:35:03.535560+00:00, run_duration=0.365773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=814, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:35:01.149119+00:00, queued_by_job_id=2, pid=11893 2024-06-28T01:35:04.962363278Z [2024-06-28T01:35:04.961+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:35:04.963255856Z [2024-06-28T01:35:04.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:34:00+00:00, run_id=scheduled__2024-06-28T01:34:00+00:00, run_start_date=2024-06-28 01:35:01.027255+00:00, run_end_date=2024-06-28 01:35:04.962616+00:00, run_duration=3.935361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:34:00+00:00, data_interval_end=2024-06-28 01:35:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:35:04.981020922Z [2024-06-28T01:35:04.980+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:35:00+00:00, run_after=2024-06-28T01:36:00+00:00 2024-06-28T01:35:04.988144621Z [2024-06-28T01:35:04.987+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:35:04.988467285Z [2024-06-28T01:35:04.988+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:34:00+00:00, run_id=scheduled__2024-06-28T01:34:00+00:00, run_start_date=2024-06-28 01:35:01.029281+00:00, run_end_date=2024-06-28 01:35:04.988038+00:00, run_duration=3.958757, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:34:00+00:00, data_interval_end=2024-06-28 01:35:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:35:04.997996415Z [2024-06-28T01:35:04.997+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:35:00+00:00, run_after=2024-06-28T01:36:00+00:00 2024-06-28T01:35:05.041540748Z [2024-06-28T01:35:05.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:34:00+00:00 exited with status success for try_number 1 2024-06-28T01:35:05.041754794Z [2024-06-28T01:35:05.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:34:00+00:00 exited with status success for try_number 1 2024-06-28T01:35:05.051909456Z [2024-06-28T01:35:05.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:34:00+00:00, map_index=-1, run_start_date=2024-06-28 01:35:02.987680+00:00, run_end_date=2024-06-28 01:35:04.373157+00:00, run_duration=1.385477, state=success, executor_state=success, try_number=1, max_tries=1, job_id=812, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:35:01.149119+00:00, queued_by_job_id=2, pid=11891 2024-06-28T01:35:05.052288380Z [2024-06-28T01:35:05.052+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:34:00+00:00, map_index=-1, run_start_date=2024-06-28 01:35:03.010322+00:00, run_end_date=2024-06-28 01:35:04.543470+00:00, run_duration=1.533148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=813, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:35:01.149119+00:00, queued_by_job_id=2, pid=11892 2024-06-28T01:35:07.248565661Z [2024-06-28T01:35:07.248+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:35:07.248619662Z 2024-06-28T01:35:07.248629808Z [2024-06-28T01:35:07.248+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:35:07.249495623Z [2024-06-28T01:35:07.249+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:35:07.249541461Z 2024-06-28T01:35:07.252055435Z [2024-06-28T01:35:07.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T01:35:07.252085148Z [2024-06-28T01:35:07.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T01:35:07.336502993Z [2024-06-28T01:35:07.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:30:00+00:00 exited with status queued for try_number 1 2024-06-28T01:35:07.336955242Z [2024-06-28T01:35:07.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:30:00+00:00 exited with status success for try_number 1 2024-06-28T01:35:07.348722404Z [2024-06-28T01:35:07.348+0000] {scheduler_job.py:635} INFO - Setting external_id for to 565451ec-a6ba-4d71-a83c-11b64adb15b1 2024-06-28T01:35:07.349275546Z [2024-06-28T01:35:07.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T01:30:00+00:00, map_index=-1, run_start_date=2024-06-28 01:35:05.677222+00:00, run_end_date=2024-06-28 01:35:06.030290+00:00, run_duration=0.353068, state=success, executor_state=success, try_number=1, max_tries=1, job_id=815, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:35:03.891787+00:00, queued_by_job_id=2, pid=11916 2024-06-28T01:35:09.688903773Z [2024-06-28T01:35:09.688+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:35:09.688919941Z 2024-06-28T01:35:09.689286607Z [2024-06-28T01:35:09.689+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:35:09.690225124Z [2024-06-28T01:35:09.689+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:35:09.690243086Z 2024-06-28T01:35:09.695236776Z [2024-06-28T01:35:09.694+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:35:09.695511589Z [2024-06-28T01:35:09.695+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:35:09.753894737Z [2024-06-28T01:35:09.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:30:00+00:00 exited with status queued for try_number 1 2024-06-28T01:35:09.754061425Z [2024-06-28T01:35:09.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:30:00+00:00 exited with status success for try_number 1 2024-06-28T01:35:09.761965325Z [2024-06-28T01:35:09.761+0000] {scheduler_job.py:635} INFO - Setting external_id for to 988b89ed-a3ee-4178-9050-63ce91900739 2024-06-28T01:35:09.762179066Z [2024-06-28T01:35:09.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T01:30:00+00:00, map_index=0, run_start_date=2024-06-28 01:35:08.817796+00:00, run_end_date=2024-06-28 01:35:09.181183+00:00, run_duration=0.363387, state=success, executor_state=success, try_number=1, max_tries=1, job_id=816, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:35:07.249968+00:00, queued_by_job_id=2, pid=11924 2024-06-28T01:35:12.709159284Z [2024-06-28T01:35:12.708+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:35:12.709289733Z [2024-06-28T01:35:12.709+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:30:00+00:00, run_id=scheduled__2024-06-28T01:30:00+00:00, run_start_date=2024-06-28 01:35:01.021954+00:00, run_end_date=2024-06-28 01:35:12.708986+00:00, run_duration=11.687032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:30:00+00:00, data_interval_end=2024-06-28 01:35:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T01:35:12.715501859Z [2024-06-28T01:35:12.715+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:35:00+00:00, run_after=2024-06-28T01:40:00+00:00 2024-06-28T01:35:12.758090444Z [2024-06-28T01:35:12.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:30:00+00:00 exited with status success for try_number 1 2024-06-28T01:35:12.766482828Z [2024-06-28T01:35:12.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T01:30:00+00:00, map_index=-1, run_start_date=2024-06-28 01:35:11.227165+00:00, run_end_date=2024-06-28 01:35:11.622418+00:00, run_duration=0.395253, state=success, executor_state=success, try_number=1, max_tries=1, job_id=817, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:35:09.691558+00:00, queued_by_job_id=2, pid=11932 2024-06-28T01:36:00.488261227Z [2024-06-28T01:36:00.487+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:36:00+00:00, run_after=2024-06-28T01:37:00+00:00 2024-06-28T01:36:00.501169537Z [2024-06-28T01:36:00.500+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:36:00.522235388Z [2024-06-28T01:36:00.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:36:00+00:00, run_after=2024-06-28T01:37:00+00:00 2024-06-28T01:36:00.530535813Z [2024-06-28T01:36:00.530+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:36:00.633504308Z [2024-06-28T01:36:00.633+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:36:00.633540130Z 2024-06-28T01:36:00.633554402Z 2024-06-28T01:36:00.633561333Z 2024-06-28T01:36:00.633567800Z 2024-06-28T01:36:00.633961526Z [2024-06-28T01:36:00.633+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:36:00.634393029Z [2024-06-28T01:36:00.634+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:36:00.634885897Z [2024-06-28T01:36:00.634+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:36:00.635270981Z [2024-06-28T01:36:00.634+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:36:00.636947101Z [2024-06-28T01:36:00.636+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:36:00.636973450Z 2024-06-28T01:36:00.636983400Z 2024-06-28T01:36:00.636991818Z 2024-06-28T01:36:00.637000423Z 2024-06-28T01:36:00.644932483Z [2024-06-28T01:36:00.644+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:36:00.645289597Z [2024-06-28T01:36:00.644+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:36:00.645602334Z [2024-06-28T01:36:00.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:36:00.645893838Z [2024-06-28T01:36:00.645+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:36:00.646181895Z [2024-06-28T01:36:00.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:36:00.646375549Z [2024-06-28T01:36:00.646+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:36:00.646810116Z [2024-06-28T01:36:00.646+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:36:00.647049297Z [2024-06-28T01:36:00.646+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:36:01.093540853Z [2024-06-28T01:36:01.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:34:00+00:00 exited with status queued for try_number 1 2024-06-28T01:36:01.093696112Z [2024-06-28T01:36:01.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:35:00+00:00 exited with status queued for try_number 1 2024-06-28T01:36:01.093859795Z [2024-06-28T01:36:01.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:35:00+00:00 exited with status queued for try_number 1 2024-06-28T01:36:01.093984585Z [2024-06-28T01:36:01.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:35:00+00:00 exited with status queued for try_number 1 2024-06-28T01:36:01.107597219Z [2024-06-28T01:36:01.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to a04ea9d0-fe80-41b7-80da-fcad54f1f750 2024-06-28T01:36:01.107846157Z [2024-06-28T01:36:01.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to aae95c2c-b2ca-485a-b46a-13266617e71d 2024-06-28T01:36:01.108060508Z [2024-06-28T01:36:01.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to c45ef03a-c042-41b8-ad2f-a0654b7a6b0d 2024-06-28T01:36:01.108285604Z [2024-06-28T01:36:01.108+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d30508c-2006-4a75-8782-28a05cdd81a0 2024-06-28T01:36:03.318130308Z [2024-06-28T01:36:03.317+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:36:03.318461727Z [2024-06-28T01:36:03.318+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:34:00+00:00, run_id=scheduled__2024-06-28T01:34:00+00:00, run_start_date=2024-06-28 01:36:00.541276+00:00, run_end_date=2024-06-28 01:36:03.318070+00:00, run_duration=2.776794, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:34:00+00:00, data_interval_end=2024-06-28 01:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:36:03.328196073Z [2024-06-28T01:36:03.327+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:36:00+00:00, run_after=2024-06-28T01:38:00+00:00 2024-06-28T01:36:03.337993607Z [2024-06-28T01:36:03.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:36:03.338247620Z [2024-06-28T01:36:03.338+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:35:00+00:00, run_id=scheduled__2024-06-28T01:35:00+00:00, run_start_date=2024-06-28 01:36:00.542338+00:00, run_end_date=2024-06-28 01:36:03.337960+00:00, run_duration=2.795622, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:35:00+00:00, data_interval_end=2024-06-28 01:36:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:36:03.347605505Z [2024-06-28T01:36:03.347+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:36:00+00:00, run_after=2024-06-28T01:37:00+00:00 2024-06-28T01:36:03.433330525Z [2024-06-28T01:36:03.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:34:00+00:00 exited with status success for try_number 1 2024-06-28T01:36:03.433808841Z [2024-06-28T01:36:03.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:35:00+00:00 exited with status success for try_number 1 2024-06-28T01:36:03.441410820Z [2024-06-28T01:36:03.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:34:00+00:00, map_index=-1, run_start_date=2024-06-28 01:36:01.774306+00:00, run_end_date=2024-06-28 01:36:02.479876+00:00, run_duration=0.70557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=818, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:36:00.639996+00:00, queued_by_job_id=2, pid=11956 2024-06-28T01:36:03.441797596Z [2024-06-28T01:36:03.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:35:00+00:00, map_index=-1, run_start_date=2024-06-28 01:36:01.901427+00:00, run_end_date=2024-06-28 01:36:02.560255+00:00, run_duration=0.658828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=819, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:36:00.639996+00:00, queued_by_job_id=2, pid=11957 2024-06-28T01:36:05.784970418Z [2024-06-28T01:36:05.784+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:36:05.788454316Z [2024-06-28T01:36:05.784+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:35:00+00:00, run_id=scheduled__2024-06-28T01:35:00+00:00, run_start_date=2024-06-28 01:36:00.543526+00:00, run_end_date=2024-06-28 01:36:05.784899+00:00, run_duration=5.241373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:35:00+00:00, data_interval_end=2024-06-28 01:36:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:36:05.798738720Z [2024-06-28T01:36:05.793+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:36:00+00:00, run_after=2024-06-28T01:37:00+00:00 2024-06-28T01:36:05.802530552Z [2024-06-28T01:36:05.800+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:36:05.802541128Z [2024-06-28T01:36:05.800+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:35:00+00:00, run_id=scheduled__2024-06-28T01:35:00+00:00, run_start_date=2024-06-28 01:36:00.544479+00:00, run_end_date=2024-06-28 01:36:05.800605+00:00, run_duration=5.256126, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:35:00+00:00, data_interval_end=2024-06-28 01:36:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:36:05.810256306Z [2024-06-28T01:36:05.810+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:36:00+00:00, run_after=2024-06-28T01:37:00+00:00 2024-06-28T01:36:05.850050124Z [2024-06-28T01:36:05.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:35:00+00:00 exited with status success for try_number 1 2024-06-28T01:36:05.850081246Z [2024-06-28T01:36:05.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:35:00+00:00 exited with status success for try_number 1 2024-06-28T01:36:05.857125015Z [2024-06-28T01:36:05.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:35:00+00:00, map_index=-1, run_start_date=2024-06-28 01:36:03.123961+00:00, run_end_date=2024-06-28 01:36:04.793901+00:00, run_duration=1.66994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=820, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:36:00.639996+00:00, queued_by_job_id=2, pid=11974 2024-06-28T01:36:05.857277861Z [2024-06-28T01:36:05.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:35:00+00:00, map_index=-1, run_start_date=2024-06-28 01:36:03.491938+00:00, run_end_date=2024-06-28 01:36:05.561858+00:00, run_duration=2.06992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=821, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:36:00.639996+00:00, queued_by_job_id=2, pid=11985 2024-06-28T01:36:46.628542433Z [2024-06-28T01:36:46.627+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T01:37:00.789458623Z [2024-06-28T01:37:00.788+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:37:00+00:00, run_after=2024-06-28T01:38:00+00:00 2024-06-28T01:37:00.806607986Z [2024-06-28T01:37:00.806+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:37:00+00:00, run_after=2024-06-28T01:38:00+00:00 2024-06-28T01:37:00.815954986Z [2024-06-28T01:37:00.815+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:37:00.916180411Z [2024-06-28T01:37:00.915+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:37:00.916218273Z 2024-06-28T01:37:00.916224330Z 2024-06-28T01:37:00.916229843Z 2024-06-28T01:37:00.916235320Z [2024-06-28T01:37:00.916+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:37:00.916549338Z [2024-06-28T01:37:00.916+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:37:00.916778468Z [2024-06-28T01:37:00.916+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:37:00.917845742Z [2024-06-28T01:37:00.917+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:37:00.917860418Z 2024-06-28T01:37:00.917887068Z 2024-06-28T01:37:00.917893890Z 2024-06-28T01:37:00.922021164Z [2024-06-28T01:37:00.921+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:37:00.922254487Z [2024-06-28T01:37:00.921+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:37:00.922671969Z [2024-06-28T01:37:00.922+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:37:00.923144709Z [2024-06-28T01:37:00.922+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:37:00.923500819Z [2024-06-28T01:37:00.923+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:37:00.923802447Z [2024-06-28T01:37:00.923+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:37:01.196698500Z [2024-06-28T01:37:01.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:36:00+00:00 exited with status queued for try_number 1 2024-06-28T01:37:01.196994988Z [2024-06-28T01:37:01.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:36:00+00:00 exited with status queued for try_number 1 2024-06-28T01:37:01.197254853Z [2024-06-28T01:37:01.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:36:00+00:00 exited with status queued for try_number 1 2024-06-28T01:37:01.205935315Z [2024-06-28T01:37:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to cffaf042-1b68-4416-a116-021569b28450 2024-06-28T01:37:01.206200206Z [2024-06-28T01:37:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee793a8c-a8c7-4412-a740-7bbd2bae1fc7 2024-06-28T01:37:01.206573291Z [2024-06-28T01:37:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ce405cb-bffb-4314-95f9-0035a388c620 2024-06-28T01:37:02.142865610Z [2024-06-28T01:37:02.142+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:37:02.143229485Z [2024-06-28T01:37:02.142+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:36:00+00:00, run_id=scheduled__2024-06-28T01:36:00+00:00, run_start_date=2024-06-28 01:37:00.828718+00:00, run_end_date=2024-06-28 01:37:02.142844+00:00, run_duration=1.314126, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:36:00+00:00, data_interval_end=2024-06-28 01:37:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:37:02.152070827Z [2024-06-28T01:37:02.151+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:37:00+00:00, run_after=2024-06-28T01:38:00+00:00 2024-06-28T01:37:02.194589188Z [2024-06-28T01:37:02.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:36:00+00:00 exited with status success for try_number 1 2024-06-28T01:37:02.201154850Z [2024-06-28T01:37:02.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:36:00+00:00, map_index=-1, run_start_date=2024-06-28 01:37:01.681840+00:00, run_end_date=2024-06-28 01:37:02.060362+00:00, run_duration=0.378522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=822, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:37:00.918634+00:00, queued_by_job_id=2, pid=12011 2024-06-28T01:37:04.810994849Z [2024-06-28T01:37:04.810+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:37:04.811392315Z [2024-06-28T01:37:04.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:36:00+00:00, run_id=scheduled__2024-06-28T01:36:00+00:00, run_start_date=2024-06-28 01:37:00.831482+00:00, run_end_date=2024-06-28 01:37:04.810918+00:00, run_duration=3.979436, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:36:00+00:00, data_interval_end=2024-06-28 01:37:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:37:04.820075270Z [2024-06-28T01:37:04.819+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:37:00+00:00, run_after=2024-06-28T01:38:00+00:00 2024-06-28T01:37:04.826994447Z [2024-06-28T01:37:04.826+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:37:04.827166093Z [2024-06-28T01:37:04.826+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:36:00+00:00, run_id=scheduled__2024-06-28T01:36:00+00:00, run_start_date=2024-06-28 01:37:00.830229+00:00, run_end_date=2024-06-28 01:37:04.826827+00:00, run_duration=3.996598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:36:00+00:00, data_interval_end=2024-06-28 01:37:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:37:04.838755053Z [2024-06-28T01:37:04.838+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:37:00+00:00, run_after=2024-06-28T01:38:00+00:00 2024-06-28T01:37:04.875196200Z [2024-06-28T01:37:04.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:36:00+00:00 exited with status success for try_number 1 2024-06-28T01:37:04.875464510Z [2024-06-28T01:37:04.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:36:00+00:00 exited with status success for try_number 1 2024-06-28T01:37:04.890457921Z [2024-06-28T01:37:04.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:36:00+00:00, map_index=-1, run_start_date=2024-06-28 01:37:02.638657+00:00, run_end_date=2024-06-28 01:37:04.386114+00:00, run_duration=1.747457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=823, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:37:00.918634+00:00, queued_by_job_id=2, pid=12029 2024-06-28T01:37:04.892368023Z [2024-06-28T01:37:04.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:36:00+00:00, map_index=-1, run_start_date=2024-06-28 01:37:02.723526+00:00, run_end_date=2024-06-28 01:37:04.575811+00:00, run_duration=1.852285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=824, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:37:00.918634+00:00, queued_by_job_id=2, pid=12030 2024-06-28T01:38:01.037709337Z [2024-06-28T01:38:01.037+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:38:01.044810018Z [2024-06-28T01:38:01.044+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:38:01.056878379Z [2024-06-28T01:38:01.056+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:38:00+00:00, run_after=2024-06-28T01:39:00+00:00 2024-06-28T01:38:01.072452668Z [2024-06-28T01:38:01.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:38:00+00:00, run_after=2024-06-28T01:39:00+00:00 2024-06-28T01:38:01.196718265Z [2024-06-28T01:38:01.196+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:38:01.196748086Z 2024-06-28T01:38:01.196755919Z 2024-06-28T01:38:01.196762024Z 2024-06-28T01:38:01.196788351Z 2024-06-28T01:38:01.197028206Z [2024-06-28T01:38:01.196+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:38:01.197391290Z [2024-06-28T01:38:01.197+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:38:01.197661167Z [2024-06-28T01:38:01.197+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:38:01.198001859Z [2024-06-28T01:38:01.197+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:38:01.199598956Z [2024-06-28T01:38:01.199+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:38:01.199630040Z 2024-06-28T01:38:01.199634741Z 2024-06-28T01:38:01.199639238Z 2024-06-28T01:38:01.199642906Z 2024-06-28T01:38:01.206979022Z [2024-06-28T01:38:01.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:38:01.207521183Z [2024-06-28T01:38:01.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:38:01.207916756Z [2024-06-28T01:38:01.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:38:01.208122812Z [2024-06-28T01:38:01.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:38:01.208555830Z [2024-06-28T01:38:01.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:38:01.208978327Z [2024-06-28T01:38:01.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:38:01.209369013Z [2024-06-28T01:38:01.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:38:01.209621781Z [2024-06-28T01:38:01.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:38:01.631897826Z [2024-06-28T01:38:01.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:36:00+00:00 exited with status queued for try_number 1 2024-06-28T01:38:01.631933059Z [2024-06-28T01:38:01.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:37:00+00:00 exited with status queued for try_number 1 2024-06-28T01:38:01.631991824Z [2024-06-28T01:38:01.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:37:00+00:00 exited with status queued for try_number 1 2024-06-28T01:38:01.632024172Z [2024-06-28T01:38:01.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:37:00+00:00 exited with status queued for try_number 1 2024-06-28T01:38:01.660145096Z [2024-06-28T01:38:01.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a295a87-7111-40a6-803f-dc2c5a989e46 2024-06-28T01:38:01.660291883Z [2024-06-28T01:38:01.660+0000] {scheduler_job.py:635} INFO - Setting external_id for to eab8be06-6f51-4ae8-9841-8ccbac072b91 2024-06-28T01:38:01.660401415Z [2024-06-28T01:38:01.660+0000] {scheduler_job.py:635} INFO - Setting external_id for to 506b5627-225a-4511-bd2b-ead8634516c4 2024-06-28T01:38:01.660494789Z [2024-06-28T01:38:01.660+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57ef747b-45eb-447e-927f-069c25fe7b97 2024-06-28T01:38:03.140655533Z [2024-06-28T01:38:03.140+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:38:03.141329281Z [2024-06-28T01:38:03.141+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:37:00+00:00, run_id=scheduled__2024-06-28T01:37:00+00:00, run_start_date=2024-06-28 01:38:01.084261+00:00, run_end_date=2024-06-28 01:38:03.140786+00:00, run_duration=2.056525, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:37:00+00:00, data_interval_end=2024-06-28 01:38:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:38:03.157983523Z [2024-06-28T01:38:03.157+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:38:00+00:00, run_after=2024-06-28T01:39:00+00:00 2024-06-28T01:38:04.307555089Z [2024-06-28T01:38:04.307+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:38:04.307912519Z [2024-06-28T01:38:04.307+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:36:00+00:00, run_id=scheduled__2024-06-28T01:36:00+00:00, run_start_date=2024-06-28 01:38:01.082901+00:00, run_end_date=2024-06-28 01:38:04.307454+00:00, run_duration=3.224553, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:36:00+00:00, data_interval_end=2024-06-28 01:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:38:04.324015094Z [2024-06-28T01:38:04.323+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:38:00+00:00, run_after=2024-06-28T01:40:00+00:00 2024-06-28T01:38:04.407301697Z [2024-06-28T01:38:04.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:36:00+00:00 exited with status success for try_number 1 2024-06-28T01:38:04.407684345Z [2024-06-28T01:38:04.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:37:00+00:00 exited with status success for try_number 1 2024-06-28T01:38:04.417587871Z [2024-06-28T01:38:04.417+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:36:00+00:00, map_index=-1, run_start_date=2024-06-28 01:38:02.793760+00:00, run_end_date=2024-06-28 01:38:03.244890+00:00, run_duration=0.45113, state=success, executor_state=success, try_number=1, max_tries=1, job_id=826, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:38:01.201202+00:00, queued_by_job_id=2, pid=12065 2024-06-28T01:38:04.418117757Z [2024-06-28T01:38:04.417+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:37:00+00:00, map_index=-1, run_start_date=2024-06-28 01:38:02.620031+00:00, run_end_date=2024-06-28 01:38:03.073553+00:00, run_duration=0.453522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=825, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:38:01.201202+00:00, queued_by_job_id=2, pid=12064 2024-06-28T01:38:05.477822235Z [2024-06-28T01:38:05.477+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:38:05.478267279Z [2024-06-28T01:38:05.477+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:37:00+00:00, run_id=scheduled__2024-06-28T01:37:00+00:00, run_start_date=2024-06-28 01:38:01.087793+00:00, run_end_date=2024-06-28 01:38:05.477696+00:00, run_duration=4.389903, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:37:00+00:00, data_interval_end=2024-06-28 01:38:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:38:05.488555222Z [2024-06-28T01:38:05.488+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:38:00+00:00, run_after=2024-06-28T01:39:00+00:00 2024-06-28T01:38:05.496476618Z [2024-06-28T01:38:05.496+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:38:05.496909835Z [2024-06-28T01:38:05.496+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:37:00+00:00, run_id=scheduled__2024-06-28T01:37:00+00:00, run_start_date=2024-06-28 01:38:01.085282+00:00, run_end_date=2024-06-28 01:38:05.496350+00:00, run_duration=4.411068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:37:00+00:00, data_interval_end=2024-06-28 01:38:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:38:05.513695718Z [2024-06-28T01:38:05.512+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:38:00+00:00, run_after=2024-06-28T01:39:00+00:00 2024-06-28T01:38:05.571655379Z [2024-06-28T01:38:05.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:37:00+00:00 exited with status success for try_number 1 2024-06-28T01:38:05.571852983Z [2024-06-28T01:38:05.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:37:00+00:00 exited with status success for try_number 1 2024-06-28T01:38:05.578292626Z [2024-06-28T01:38:05.577+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:37:00+00:00, map_index=-1, run_start_date=2024-06-28 01:38:03.318269+00:00, run_end_date=2024-06-28 01:38:05.094957+00:00, run_duration=1.776688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=827, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:38:01.201202+00:00, queued_by_job_id=2, pid=12082 2024-06-28T01:38:05.578780643Z [2024-06-28T01:38:05.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:37:00+00:00, map_index=-1, run_start_date=2024-06-28 01:38:03.758909+00:00, run_end_date=2024-06-28 01:38:05.114108+00:00, run_duration=1.355199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=828, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:38:01.201202+00:00, queued_by_job_id=2, pid=12093 2024-06-28T01:39:00.288544539Z [2024-06-28T01:39:00.287+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:39:00.307503713Z [2024-06-28T01:39:00.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:39:00+00:00, run_after=2024-06-28T01:40:00+00:00 2024-06-28T01:39:00.321698664Z [2024-06-28T01:39:00.321+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:39:00+00:00, run_after=2024-06-28T01:40:00+00:00 2024-06-28T01:39:00.406676747Z [2024-06-28T01:39:00.406+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:39:00.406782653Z 2024-06-28T01:39:00.406789802Z 2024-06-28T01:39:00.406794952Z 2024-06-28T01:39:00.407192833Z [2024-06-28T01:39:00.406+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:39:00.407516055Z [2024-06-28T01:39:00.407+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:39:00.407818456Z [2024-06-28T01:39:00.407+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:39:00.408754119Z [2024-06-28T01:39:00.408+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:39:00.408770783Z 2024-06-28T01:39:00.408776336Z 2024-06-28T01:39:00.408781505Z 2024-06-28T01:39:00.414114404Z [2024-06-28T01:39:00.413+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:39:00.414609079Z [2024-06-28T01:39:00.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:39:00.415204455Z [2024-06-28T01:39:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:39:00.415658352Z [2024-06-28T01:39:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:39:00.416036410Z [2024-06-28T01:39:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:39:00.416329299Z [2024-06-28T01:39:00.416+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:39:00.653139643Z [2024-06-28T01:39:00.652+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:38:00+00:00 exited with status queued for try_number 1 2024-06-28T01:39:00.653985815Z [2024-06-28T01:39:00.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:38:00+00:00 exited with status queued for try_number 1 2024-06-28T01:39:00.654132708Z [2024-06-28T01:39:00.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:38:00+00:00 exited with status queued for try_number 1 2024-06-28T01:39:00.664714504Z [2024-06-28T01:39:00.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49371ffd-3e91-45af-8c37-ba899c17c498 2024-06-28T01:39:00.665115996Z [2024-06-28T01:39:00.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4158713-8f9f-4991-b33d-844df8d2916e 2024-06-28T01:39:00.665460843Z [2024-06-28T01:39:00.665+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10252894-7559-49d2-bc3c-b648b2ee0426 2024-06-28T01:39:01.820127307Z [2024-06-28T01:39:01.819+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:39:01.820455651Z [2024-06-28T01:39:01.820+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:38:00+00:00, run_id=scheduled__2024-06-28T01:38:00+00:00, run_start_date=2024-06-28 01:39:00.332797+00:00, run_end_date=2024-06-28 01:39:01.820122+00:00, run_duration=1.487325, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:38:00+00:00, data_interval_end=2024-06-28 01:39:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:39:01.830828048Z [2024-06-28T01:39:01.830+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:39:00+00:00, run_after=2024-06-28T01:40:00+00:00 2024-06-28T01:39:01.895676144Z [2024-06-28T01:39:01.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:38:00+00:00 exited with status success for try_number 1 2024-06-28T01:39:01.900983921Z [2024-06-28T01:39:01.900+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:38:00+00:00, map_index=-1, run_start_date=2024-06-28 01:39:01.185105+00:00, run_end_date=2024-06-28 01:39:01.610381+00:00, run_duration=0.425276, state=success, executor_state=success, try_number=1, max_tries=1, job_id=829, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:39:00.409808+00:00, queued_by_job_id=2, pid=12119 2024-06-28T01:39:04.212860481Z [2024-06-28T01:39:04.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:39:04.213156562Z [2024-06-28T01:39:04.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:38:00+00:00, run_id=scheduled__2024-06-28T01:38:00+00:00, run_start_date=2024-06-28 01:39:00.334108+00:00, run_end_date=2024-06-28 01:39:04.212774+00:00, run_duration=3.878666, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:38:00+00:00, data_interval_end=2024-06-28 01:39:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:39:04.226805426Z [2024-06-28T01:39:04.224+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:39:00+00:00, run_after=2024-06-28T01:40:00+00:00 2024-06-28T01:39:04.243243942Z [2024-06-28T01:39:04.242+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:39:04.243920710Z [2024-06-28T01:39:04.243+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:38:00+00:00, run_id=scheduled__2024-06-28T01:38:00+00:00, run_start_date=2024-06-28 01:39:00.335198+00:00, run_end_date=2024-06-28 01:39:04.243176+00:00, run_duration=3.907978, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:38:00+00:00, data_interval_end=2024-06-28 01:39:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:39:04.259129848Z [2024-06-28T01:39:04.258+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:39:00+00:00, run_after=2024-06-28T01:40:00+00:00 2024-06-28T01:39:04.318113323Z [2024-06-28T01:39:04.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:38:00+00:00 exited with status success for try_number 1 2024-06-28T01:39:04.323753891Z [2024-06-28T01:39:04.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:38:00+00:00, map_index=-1, run_start_date=2024-06-28 01:39:02.210579+00:00, run_end_date=2024-06-28 01:39:03.687772+00:00, run_duration=1.477193, state=success, executor_state=success, try_number=1, max_tries=1, job_id=830, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:39:00.409808+00:00, queued_by_job_id=2, pid=12137 2024-06-28T01:39:05.428307636Z [2024-06-28T01:39:05.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:38:00+00:00 exited with status success for try_number 1 2024-06-28T01:39:05.447349106Z [2024-06-28T01:39:05.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:38:00+00:00, map_index=-1, run_start_date=2024-06-28 01:39:02.302729+00:00, run_end_date=2024-06-28 01:39:04.132273+00:00, run_duration=1.829544, state=success, executor_state=success, try_number=1, max_tries=1, job_id=831, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:39:00.409808+00:00, queued_by_job_id=2, pid=12138 2024-06-28T01:40:00.296338424Z [2024-06-28T01:40:00.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:40:00+00:00, run_after=2024-06-28T01:45:00+00:00 2024-06-28T01:40:00.306075736Z [2024-06-28T01:40:00.305+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:40:00.314098501Z [2024-06-28T01:40:00.313+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:40:00.342823316Z [2024-06-28T01:40:00.342+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:40:00+00:00, run_after=2024-06-28T01:41:00+00:00 2024-06-28T01:40:00.370178898Z [2024-06-28T01:40:00.369+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:40:00+00:00, run_after=2024-06-28T01:41:00+00:00 2024-06-28T01:40:00.524535469Z [2024-06-28T01:40:00.523+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-28T01:40:00.524582299Z 2024-06-28T01:40:00.524592319Z 2024-06-28T01:40:00.524601945Z 2024-06-28T01:40:00.524610679Z 2024-06-28T01:40:00.524619445Z 2024-06-28T01:40:00.525080470Z [2024-06-28T01:40:00.524+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:40:00.525612620Z [2024-06-28T01:40:00.525+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:40:00.526162850Z [2024-06-28T01:40:00.525+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:40:00.526893155Z [2024-06-28T01:40:00.526+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:40:00.527326496Z [2024-06-28T01:40:00.526+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:40:00.529376930Z [2024-06-28T01:40:00.528+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:40:00.529390220Z 2024-06-28T01:40:00.529396341Z 2024-06-28T01:40:00.529402910Z 2024-06-28T01:40:00.529430434Z 2024-06-28T01:40:00.529436691Z 2024-06-28T01:40:00.539127143Z [2024-06-28T01:40:00.538+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T01:40:00.539337245Z [2024-06-28T01:40:00.538+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:40:00.539905011Z [2024-06-28T01:40:00.539+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:40:00.540319651Z [2024-06-28T01:40:00.539+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:40:00.540962389Z [2024-06-28T01:40:00.540+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:40:00.541182520Z [2024-06-28T01:40:00.540+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:40:00.541714971Z [2024-06-28T01:40:00.541+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:40:00.542141433Z [2024-06-28T01:40:00.541+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:40:00.542942485Z [2024-06-28T01:40:00.542+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:40:00.543048637Z [2024-06-28T01:40:00.542+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:40:00.888145941Z [2024-06-28T01:40:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:35:00+00:00 exited with status queued for try_number 1 2024-06-28T01:40:00.890327568Z [2024-06-28T01:40:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:38:00+00:00 exited with status queued for try_number 1 2024-06-28T01:40:00.890442798Z [2024-06-28T01:40:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:39:00+00:00 exited with status queued for try_number 1 2024-06-28T01:40:00.890545934Z [2024-06-28T01:40:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:39:00+00:00 exited with status queued for try_number 1 2024-06-28T01:40:00.890642173Z [2024-06-28T01:40:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:39:00+00:00 exited with status queued for try_number 1 2024-06-28T01:40:00.908717731Z [2024-06-28T01:40:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1c7f4af-fa29-4c0a-af0a-a0c9494f9299 2024-06-28T01:40:00.909096717Z [2024-06-28T01:40:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to 839d9a62-9ab1-4bf3-ac6a-a28e12eb735a 2024-06-28T01:40:00.909660353Z [2024-06-28T01:40:00.909+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68fff6b2-18ac-4110-b452-18301c9e2d4e 2024-06-28T01:40:00.910734501Z [2024-06-28T01:40:00.909+0000] {scheduler_job.py:635} INFO - Setting external_id for to f564aa1a-615f-4f52-b76c-6a6fc702eb51 2024-06-28T01:40:00.910747593Z [2024-06-28T01:40:00.910+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec5818c5-78dd-4405-b422-015e63c89e1e 2024-06-28T01:40:02.155513544Z [2024-06-28T01:40:02.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:40:02.155939149Z [2024-06-28T01:40:02.155+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:38:00+00:00, run_id=scheduled__2024-06-28T01:38:00+00:00, run_start_date=2024-06-28 01:40:00.387630+00:00, run_end_date=2024-06-28 01:40:02.155588+00:00, run_duration=1.767958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:38:00+00:00, data_interval_end=2024-06-28 01:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:40:02.164105035Z [2024-06-28T01:40:02.163+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:40:00+00:00, run_after=2024-06-28T01:42:00+00:00 2024-06-28T01:40:02.287781091Z [2024-06-28T01:40:02.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:38:00+00:00 exited with status success for try_number 1 2024-06-28T01:40:02.305957519Z [2024-06-28T01:40:02.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:38:00+00:00, map_index=-1, run_start_date=2024-06-28 01:40:01.552115+00:00, run_end_date=2024-06-28 01:40:01.985735+00:00, run_duration=0.43362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=832, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:40:00.532957+00:00, queued_by_job_id=2, pid=12171 2024-06-28T01:40:03.352994012Z [2024-06-28T01:40:03.352+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:40:03.353322135Z [2024-06-28T01:40:03.353+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:39:00+00:00, run_id=scheduled__2024-06-28T01:39:00+00:00, run_start_date=2024-06-28 01:40:00.389098+00:00, run_end_date=2024-06-28 01:40:03.352873+00:00, run_duration=2.963775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:39:00+00:00, data_interval_end=2024-06-28 01:40:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:40:03.364461052Z [2024-06-28T01:40:03.364+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:40:00+00:00, run_after=2024-06-28T01:41:00+00:00 2024-06-28T01:40:03.431738488Z [2024-06-28T01:40:03.431+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:40:03.431767965Z 2024-06-28T01:40:03.431785543Z [2024-06-28T01:40:03.431+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:40:03.432274700Z [2024-06-28T01:40:03.432+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:40:03.432289153Z 2024-06-28T01:40:03.435010068Z [2024-06-28T01:40:03.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T01:40:03.435072271Z [2024-06-28T01:40:03.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:40:03.482544127Z [2024-06-28T01:40:03.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:35:00+00:00 exited with status queued for try_number 1 2024-06-28T01:40:03.482572348Z [2024-06-28T01:40:03.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:35:00+00:00 exited with status success for try_number 1 2024-06-28T01:40:03.482620153Z [2024-06-28T01:40:03.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:39:00+00:00 exited with status success for try_number 1 2024-06-28T01:40:03.492017561Z [2024-06-28T01:40:03.491+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:39:00+00:00, map_index=-1, run_start_date=2024-06-28 01:40:01.739303+00:00, run_end_date=2024-06-28 01:40:02.328169+00:00, run_duration=0.588866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=833, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:40:00.532957+00:00, queued_by_job_id=2, pid=12173 2024-06-28T01:40:03.492079086Z [2024-06-28T01:40:03.491+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T01:35:00+00:00, map_index=-1, run_start_date=2024-06-28 01:40:02.696282+00:00, run_end_date=2024-06-28 01:40:03.182665+00:00, run_duration=0.486383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=834, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:40:00.532957+00:00, queued_by_job_id=2, pid=12197 2024-06-28T01:40:03.492239435Z [2024-06-28T01:40:03.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d9edcf3-049b-46be-8fdf-1441450bd466 2024-06-28T01:40:03.999371494Z [2024-06-28T01:40:03.998+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:40:03.999849824Z [2024-06-28T01:40:03.999+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:39:00+00:00, run_id=scheduled__2024-06-28T01:39:00+00:00, run_start_date=2024-06-28 01:40:00.390592+00:00, run_end_date=2024-06-28 01:40:03.999293+00:00, run_duration=3.608701, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:39:00+00:00, data_interval_end=2024-06-28 01:40:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:40:04.023826101Z [2024-06-28T01:40:04.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:40:00+00:00, run_after=2024-06-28T01:41:00+00:00 2024-06-28T01:40:05.123300946Z [2024-06-28T01:40:05.122+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:40:05.123540247Z [2024-06-28T01:40:05.123+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:39:00+00:00, run_id=scheduled__2024-06-28T01:39:00+00:00, run_start_date=2024-06-28 01:40:00.392116+00:00, run_end_date=2024-06-28 01:40:05.123209+00:00, run_duration=4.731093, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:39:00+00:00, data_interval_end=2024-06-28 01:40:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:40:05.131844244Z [2024-06-28T01:40:05.131+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:40:00+00:00, run_after=2024-06-28T01:41:00+00:00 2024-06-28T01:40:05.174303198Z [2024-06-28T01:40:05.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:39:00+00:00 exited with status success for try_number 1 2024-06-28T01:40:05.176372184Z [2024-06-28T01:40:05.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:39:00+00:00 exited with status success for try_number 1 2024-06-28T01:40:05.182072202Z [2024-06-28T01:40:05.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:39:00+00:00, map_index=-1, run_start_date=2024-06-28 01:40:03.013697+00:00, run_end_date=2024-06-28 01:40:04.763138+00:00, run_duration=1.749441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=836, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:40:00.532957+00:00, queued_by_job_id=2, pid=12208 2024-06-28T01:40:05.182367041Z [2024-06-28T01:40:05.182+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:39:00+00:00, map_index=-1, run_start_date=2024-06-28 01:40:02.667436+00:00, run_end_date=2024-06-28 01:40:03.934488+00:00, run_duration=1.267052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=835, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:40:00.532957+00:00, queued_by_job_id=2, pid=12196 2024-06-28T01:40:06.004741132Z [2024-06-28T01:40:06.004+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:40:06.004784978Z 2024-06-28T01:40:06.005070381Z [2024-06-28T01:40:06.004+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:40:06.006042890Z [2024-06-28T01:40:06.005+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:40:06.006055944Z 2024-06-28T01:40:06.009410895Z [2024-06-28T01:40:06.009+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T01:40:06.009725904Z [2024-06-28T01:40:06.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T01:40:06.058400871Z [2024-06-28T01:40:06.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:35:00+00:00 exited with status queued for try_number 1 2024-06-28T01:40:06.058917209Z [2024-06-28T01:40:06.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:35:00+00:00 exited with status success for try_number 1 2024-06-28T01:40:06.064227800Z [2024-06-28T01:40:06.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to eebbe24b-76ea-459f-9029-a23b5a1e77d6 2024-06-28T01:40:06.064504861Z [2024-06-28T01:40:06.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T01:35:00+00:00, map_index=-1, run_start_date=2024-06-28 01:40:05.298282+00:00, run_end_date=2024-06-28 01:40:05.737797+00:00, run_duration=0.439515, state=success, executor_state=success, try_number=1, max_tries=1, job_id=837, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:40:03.432739+00:00, queued_by_job_id=2, pid=12226 2024-06-28T01:40:09.406361040Z [2024-06-28T01:40:09.406+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:40:09.406383713Z 2024-06-28T01:40:09.406518794Z [2024-06-28T01:40:09.406+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:40:09.407211971Z [2024-06-28T01:40:09.406+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:40:09.407226992Z 2024-06-28T01:40:09.412037705Z [2024-06-28T01:40:09.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:40:09.412260878Z [2024-06-28T01:40:09.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:40:09.511501175Z [2024-06-28T01:40:09.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:35:00+00:00 exited with status queued for try_number 1 2024-06-28T01:40:09.511874161Z [2024-06-28T01:40:09.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:35:00+00:00 exited with status success for try_number 1 2024-06-28T01:40:09.517964724Z [2024-06-28T01:40:09.517+0000] {scheduler_job.py:635} INFO - Setting external_id for to a773bdbd-c3c4-46fd-81c1-5fe26ebf2e48 2024-06-28T01:40:09.518297642Z [2024-06-28T01:40:09.518+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T01:35:00+00:00, map_index=0, run_start_date=2024-06-28 01:40:07.718761+00:00, run_end_date=2024-06-28 01:40:08.192750+00:00, run_duration=0.473989, state=success, executor_state=success, try_number=1, max_tries=1, job_id=838, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:40:06.006667+00:00, queued_by_job_id=2, pid=12234 2024-06-28T01:40:12.251962125Z [2024-06-28T01:40:12.251+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:40:12.252543106Z [2024-06-28T01:40:12.252+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:35:00+00:00, run_id=scheduled__2024-06-28T01:35:00+00:00, run_start_date=2024-06-28 01:40:00.385747+00:00, run_end_date=2024-06-28 01:40:12.251784+00:00, run_duration=11.866037, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:35:00+00:00, data_interval_end=2024-06-28 01:40:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T01:40:12.264351479Z [2024-06-28T01:40:12.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:40:00+00:00, run_after=2024-06-28T01:45:00+00:00 2024-06-28T01:40:12.303857071Z [2024-06-28T01:40:12.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:35:00+00:00 exited with status success for try_number 1 2024-06-28T01:40:12.312018567Z [2024-06-28T01:40:12.311+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T01:35:00+00:00, map_index=-1, run_start_date=2024-06-28 01:40:11.124803+00:00, run_end_date=2024-06-28 01:40:11.540397+00:00, run_duration=0.415594, state=success, executor_state=success, try_number=1, max_tries=1, job_id=839, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:40:09.407639+00:00, queued_by_job_id=2, pid=12242 2024-06-28T01:41:00.824590822Z [2024-06-28T01:41:00.824+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:41:00+00:00, run_after=2024-06-28T01:42:00+00:00 2024-06-28T01:41:00.848782968Z [2024-06-28T01:41:00.848+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:41:00+00:00, run_after=2024-06-28T01:42:00+00:00 2024-06-28T01:41:00.857824338Z [2024-06-28T01:41:00.857+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:41:00.928079692Z [2024-06-28T01:41:00.927+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:41:00.928132475Z 2024-06-28T01:41:00.928142046Z 2024-06-28T01:41:00.928150922Z 2024-06-28T01:41:00.928442393Z [2024-06-28T01:41:00.927+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:41:00.928620857Z [2024-06-28T01:41:00.928+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:41:00.928859472Z [2024-06-28T01:41:00.928+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:41:00.930448038Z [2024-06-28T01:41:00.929+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:41:00.930491653Z 2024-06-28T01:41:00.930501186Z 2024-06-28T01:41:00.930509727Z 2024-06-28T01:41:00.937836782Z [2024-06-28T01:41:00.937+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:41:00.938056729Z [2024-06-28T01:41:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:41:00.938355381Z [2024-06-28T01:41:00.938+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:41:00.938571998Z [2024-06-28T01:41:00.938+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:41:00.939012327Z [2024-06-28T01:41:00.938+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:41:00.939284048Z [2024-06-28T01:41:00.938+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:41:01.217578570Z [2024-06-28T01:41:01.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:40:00+00:00 exited with status queued for try_number 1 2024-06-28T01:41:01.217684529Z [2024-06-28T01:41:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:40:00+00:00 exited with status queued for try_number 1 2024-06-28T01:41:01.217689932Z [2024-06-28T01:41:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:40:00+00:00 exited with status queued for try_number 1 2024-06-28T01:41:01.232499338Z [2024-06-28T01:41:01.232+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89b23670-afcf-4d84-a1ca-6586c6c83a47 2024-06-28T01:41:01.232600704Z [2024-06-28T01:41:01.232+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ebd3bb7-c544-40f1-af95-4b473dcbbe67 2024-06-28T01:41:01.232673535Z [2024-06-28T01:41:01.232+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cf2ef55-86f6-4d8a-ba05-4da9da2fb595 2024-06-28T01:41:03.171339226Z [2024-06-28T01:41:03.170+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:41:03.172750059Z [2024-06-28T01:41:03.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:40:00+00:00, run_id=scheduled__2024-06-28T01:40:00+00:00, run_start_date=2024-06-28 01:41:00.868769+00:00, run_end_date=2024-06-28 01:41:03.171258+00:00, run_duration=2.302489, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:40:00+00:00, data_interval_end=2024-06-28 01:41:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:41:03.191550815Z [2024-06-28T01:41:03.191+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:41:00+00:00, run_after=2024-06-28T01:42:00+00:00 2024-06-28T01:41:03.277296777Z [2024-06-28T01:41:03.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:40:00+00:00 exited with status success for try_number 1 2024-06-28T01:41:03.289465228Z [2024-06-28T01:41:03.284+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:40:00+00:00, map_index=-1, run_start_date=2024-06-28 01:41:01.748064+00:00, run_end_date=2024-06-28 01:41:02.230385+00:00, run_duration=0.482321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=840, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:41:00.932413+00:00, queued_by_job_id=2, pid=12263 2024-06-28T01:41:05.555466923Z [2024-06-28T01:41:05.546+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:41:05.555494725Z [2024-06-28T01:41:05.547+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:40:00+00:00, run_id=scheduled__2024-06-28T01:40:00+00:00, run_start_date=2024-06-28 01:41:00.870333+00:00, run_end_date=2024-06-28 01:41:05.547050+00:00, run_duration=4.676717, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:40:00+00:00, data_interval_end=2024-06-28 01:41:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:41:05.560947325Z [2024-06-28T01:41:05.556+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:41:00+00:00, run_after=2024-06-28T01:42:00+00:00 2024-06-28T01:41:05.619683429Z [2024-06-28T01:41:05.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:40:00+00:00 exited with status success for try_number 1 2024-06-28T01:41:05.626902756Z [2024-06-28T01:41:05.626+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:40:00+00:00, map_index=-1, run_start_date=2024-06-28 01:41:03.022019+00:00, run_end_date=2024-06-28 01:41:05.366799+00:00, run_duration=2.34478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=842, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:41:00.932413+00:00, queued_by_job_id=2, pid=12282 2024-06-28T01:41:06.767963966Z [2024-06-28T01:41:06.767+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:41:06.768257880Z [2024-06-28T01:41:06.768+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:40:00+00:00, run_id=scheduled__2024-06-28T01:40:00+00:00, run_start_date=2024-06-28 01:41:00.871796+00:00, run_end_date=2024-06-28 01:41:06.767880+00:00, run_duration=5.896084, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:40:00+00:00, data_interval_end=2024-06-28 01:41:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:41:06.777635035Z [2024-06-28T01:41:06.777+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:41:00+00:00, run_after=2024-06-28T01:42:00+00:00 2024-06-28T01:41:06.831391091Z [2024-06-28T01:41:06.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:40:00+00:00 exited with status success for try_number 1 2024-06-28T01:41:06.844133925Z [2024-06-28T01:41:06.843+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:40:00+00:00, map_index=-1, run_start_date=2024-06-28 01:41:02.989248+00:00, run_end_date=2024-06-28 01:41:05.836012+00:00, run_duration=2.846764, state=success, executor_state=success, try_number=1, max_tries=1, job_id=841, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:41:00.932413+00:00, queued_by_job_id=2, pid=12281 2024-06-28T01:41:46.725505519Z [2024-06-28T01:41:46.724+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T01:42:01.099522919Z [2024-06-28T01:42:01.099+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:42:00+00:00, run_after=2024-06-28T01:43:00+00:00 2024-06-28T01:42:01.114399932Z [2024-06-28T01:42:01.113+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:42:00+00:00, run_after=2024-06-28T01:43:00+00:00 2024-06-28T01:42:01.123123854Z [2024-06-28T01:42:01.122+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:42:01.130555716Z [2024-06-28T01:42:01.130+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:42:01.244914961Z [2024-06-28T01:42:01.243+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:42:01.244964223Z 2024-06-28T01:42:01.244973186Z 2024-06-28T01:42:01.244980076Z 2024-06-28T01:42:01.244986933Z 2024-06-28T01:42:01.245325103Z [2024-06-28T01:42:01.244+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:42:01.246404692Z [2024-06-28T01:42:01.245+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:42:01.246832526Z [2024-06-28T01:42:01.246+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:42:01.247011177Z [2024-06-28T01:42:01.246+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:42:01.248571011Z [2024-06-28T01:42:01.248+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:42:01.248606626Z 2024-06-28T01:42:01.248617520Z 2024-06-28T01:42:01.248626544Z 2024-06-28T01:42:01.248635343Z 2024-06-28T01:42:01.256975986Z [2024-06-28T01:42:01.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:42:01.257071853Z [2024-06-28T01:42:01.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:42:01.257390977Z [2024-06-28T01:42:01.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:42:01.257448769Z [2024-06-28T01:42:01.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:42:01.257794143Z [2024-06-28T01:42:01.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:42:01.257882497Z [2024-06-28T01:42:01.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:42:01.258313660Z [2024-06-28T01:42:01.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:42:01.258354230Z [2024-06-28T01:42:01.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:42:01.501861489Z [2024-06-28T01:42:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:40:00+00:00 exited with status queued for try_number 1 2024-06-28T01:42:01.501934750Z [2024-06-28T01:42:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:41:00+00:00 exited with status queued for try_number 1 2024-06-28T01:42:01.502036966Z [2024-06-28T01:42:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:41:00+00:00 exited with status queued for try_number 1 2024-06-28T01:42:01.502149923Z [2024-06-28T01:42:01.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:41:00+00:00 exited with status queued for try_number 1 2024-06-28T01:42:01.516217997Z [2024-06-28T01:42:01.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to b360d036-482d-4112-9256-7d4bd500fb2b 2024-06-28T01:42:01.516333030Z [2024-06-28T01:42:01.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7947f27-c273-4c88-afcd-2d702ee51cb8 2024-06-28T01:42:01.516526841Z [2024-06-28T01:42:01.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26e4d257-02e6-4cbd-93e6-bd9d2e2713be 2024-06-28T01:42:01.516703239Z [2024-06-28T01:42:01.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to b64e66ae-71c3-4fbd-a681-c28cd06bdc4e 2024-06-28T01:42:02.732212612Z [2024-06-28T01:42:02.731+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:42:02.732431305Z [2024-06-28T01:42:02.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:40:00+00:00, run_id=scheduled__2024-06-28T01:40:00+00:00, run_start_date=2024-06-28 01:42:01.144138+00:00, run_end_date=2024-06-28 01:42:02.732113+00:00, run_duration=1.587975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:40:00+00:00, data_interval_end=2024-06-28 01:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:42:02.747738944Z [2024-06-28T01:42:02.742+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:42:00+00:00, run_after=2024-06-28T01:44:00+00:00 2024-06-28T01:42:03.025078667Z [2024-06-28T01:42:03.024+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:42:03.025581287Z [2024-06-28T01:42:03.025+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:41:00+00:00, run_id=scheduled__2024-06-28T01:41:00+00:00, run_start_date=2024-06-28 01:42:01.145692+00:00, run_end_date=2024-06-28 01:42:03.025243+00:00, run_duration=1.879551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:41:00+00:00, data_interval_end=2024-06-28 01:42:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:42:03.034176797Z [2024-06-28T01:42:03.033+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:42:00+00:00, run_after=2024-06-28T01:43:00+00:00 2024-06-28T01:42:03.094071173Z [2024-06-28T01:42:03.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:40:00+00:00 exited with status success for try_number 1 2024-06-28T01:42:03.094095837Z [2024-06-28T01:42:03.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:41:00+00:00 exited with status success for try_number 1 2024-06-28T01:42:03.099683900Z [2024-06-28T01:42:03.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:40:00+00:00, map_index=-1, run_start_date=2024-06-28 01:42:02.134502+00:00, run_end_date=2024-06-28 01:42:02.643049+00:00, run_duration=0.508547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=843, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:42:01.251448+00:00, queued_by_job_id=2, pid=12315 2024-06-28T01:42:03.100132454Z [2024-06-28T01:42:03.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:41:00+00:00, map_index=-1, run_start_date=2024-06-28 01:42:02.324909+00:00, run_end_date=2024-06-28 01:42:02.744026+00:00, run_duration=0.419117, state=success, executor_state=success, try_number=1, max_tries=1, job_id=844, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:42:01.251448+00:00, queued_by_job_id=2, pid=12316 2024-06-28T01:42:05.975887573Z [2024-06-28T01:42:05.975+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:42:05.976273950Z [2024-06-28T01:42:05.976+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:41:00+00:00, run_id=scheduled__2024-06-28T01:41:00+00:00, run_start_date=2024-06-28 01:42:01.146977+00:00, run_end_date=2024-06-28 01:42:05.975789+00:00, run_duration=4.828812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:41:00+00:00, data_interval_end=2024-06-28 01:42:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:42:05.985594545Z [2024-06-28T01:42:05.985+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:42:00+00:00, run_after=2024-06-28T01:43:00+00:00 2024-06-28T01:42:05.992442418Z [2024-06-28T01:42:05.992+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:42:05.992843873Z [2024-06-28T01:42:05.992+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:41:00+00:00, run_id=scheduled__2024-06-28T01:41:00+00:00, run_start_date=2024-06-28 01:42:01.148570+00:00, run_end_date=2024-06-28 01:42:05.992349+00:00, run_duration=4.843779, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:41:00+00:00, data_interval_end=2024-06-28 01:42:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:42:06.002875157Z [2024-06-28T01:42:06.002+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:42:00+00:00, run_after=2024-06-28T01:43:00+00:00 2024-06-28T01:42:06.047541230Z [2024-06-28T01:42:06.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:41:00+00:00 exited with status success for try_number 1 2024-06-28T01:42:06.047965791Z [2024-06-28T01:42:06.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:41:00+00:00 exited with status success for try_number 1 2024-06-28T01:42:06.063466451Z [2024-06-28T01:42:06.062+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:41:00+00:00, map_index=-1, run_start_date=2024-06-28 01:42:03.647202+00:00, run_end_date=2024-06-28 01:42:05.362287+00:00, run_duration=1.715085, state=success, executor_state=success, try_number=1, max_tries=1, job_id=846, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:42:01.251448+00:00, queued_by_job_id=2, pid=12340 2024-06-28T01:42:06.064220199Z [2024-06-28T01:42:06.063+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:41:00+00:00, map_index=-1, run_start_date=2024-06-28 01:42:03.514180+00:00, run_end_date=2024-06-28 01:42:05.016765+00:00, run_duration=1.502585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=845, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:42:01.251448+00:00, queued_by_job_id=2, pid=12339 2024-06-28T01:43:00.088599685Z [2024-06-28T01:43:00.088+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:43:00+00:00, run_after=2024-06-28T01:44:00+00:00 2024-06-28T01:43:00.105268370Z [2024-06-28T01:43:00.104+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:43:00+00:00, run_after=2024-06-28T01:44:00+00:00 2024-06-28T01:43:00.114499639Z [2024-06-28T01:43:00.114+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:43:00.184359089Z [2024-06-28T01:43:00.184+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:43:00.184390856Z 2024-06-28T01:43:00.184396953Z 2024-06-28T01:43:00.184402472Z 2024-06-28T01:43:00.184698974Z [2024-06-28T01:43:00.184+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:43:00.184858231Z [2024-06-28T01:43:00.184+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:43:00.185021672Z [2024-06-28T01:43:00.184+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:43:00.185599411Z [2024-06-28T01:43:00.185+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:43:00.185614359Z 2024-06-28T01:43:00.185620466Z 2024-06-28T01:43:00.185625929Z 2024-06-28T01:43:00.188554978Z [2024-06-28T01:43:00.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:43:00.188743615Z [2024-06-28T01:43:00.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:43:00.189043733Z [2024-06-28T01:43:00.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:43:00.189175744Z [2024-06-28T01:43:00.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:43:00.189422369Z [2024-06-28T01:43:00.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:43:00.189565724Z [2024-06-28T01:43:00.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:43:00.433135062Z [2024-06-28T01:43:00.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:42:00+00:00 exited with status queued for try_number 1 2024-06-28T01:43:00.433165638Z [2024-06-28T01:43:00.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:42:00+00:00 exited with status queued for try_number 1 2024-06-28T01:43:00.433237855Z [2024-06-28T01:43:00.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:42:00+00:00 exited with status queued for try_number 1 2024-06-28T01:43:00.442048810Z [2024-06-28T01:43:00.441+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09cec453-7525-4974-8e30-4f4c7fb94fe2 2024-06-28T01:43:00.442165717Z [2024-06-28T01:43:00.442+0000] {scheduler_job.py:635} INFO - Setting external_id for to f281c86b-edc2-4ab9-9b60-9a780d4ece65 2024-06-28T01:43:00.442274903Z [2024-06-28T01:43:00.442+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d01dd28-46a2-432f-9577-361adab0053a 2024-06-28T01:43:01.582009537Z [2024-06-28T01:43:01.581+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:43:01.582191785Z [2024-06-28T01:43:01.582+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:42:00+00:00, run_id=scheduled__2024-06-28T01:42:00+00:00, run_start_date=2024-06-28 01:43:00.129790+00:00, run_end_date=2024-06-28 01:43:01.581910+00:00, run_duration=1.45212, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:42:00+00:00, data_interval_end=2024-06-28 01:43:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:43:01.594552632Z [2024-06-28T01:43:01.594+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:43:00+00:00, run_after=2024-06-28T01:44:00+00:00 2024-06-28T01:43:01.651842580Z [2024-06-28T01:43:01.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:42:00+00:00 exited with status success for try_number 1 2024-06-28T01:43:01.659255696Z [2024-06-28T01:43:01.658+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:42:00+00:00, map_index=-1, run_start_date=2024-06-28 01:43:00.923397+00:00, run_end_date=2024-06-28 01:43:01.336892+00:00, run_duration=0.413495, state=success, executor_state=success, try_number=1, max_tries=1, job_id=847, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:43:00.186190+00:00, queued_by_job_id=2, pid=12372 2024-06-28T01:43:03.851863901Z [2024-06-28T01:43:03.851+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:43:03.852442660Z [2024-06-28T01:43:03.852+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:42:00+00:00, run_id=scheduled__2024-06-28T01:42:00+00:00, run_start_date=2024-06-28 01:43:00.131070+00:00, run_end_date=2024-06-28 01:43:03.851778+00:00, run_duration=3.720708, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:42:00+00:00, data_interval_end=2024-06-28 01:43:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:43:03.862863652Z [2024-06-28T01:43:03.862+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:43:00+00:00, run_after=2024-06-28T01:44:00+00:00 2024-06-28T01:43:03.871083619Z [2024-06-28T01:43:03.870+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:43:03.871593947Z [2024-06-28T01:43:03.871+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:42:00+00:00, run_id=scheduled__2024-06-28T01:42:00+00:00, run_start_date=2024-06-28 01:43:00.132094+00:00, run_end_date=2024-06-28 01:43:03.870998+00:00, run_duration=3.738904, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:42:00+00:00, data_interval_end=2024-06-28 01:43:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:43:03.888681356Z [2024-06-28T01:43:03.888+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:43:00+00:00, run_after=2024-06-28T01:44:00+00:00 2024-06-28T01:43:03.946040763Z [2024-06-28T01:43:03.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:42:00+00:00 exited with status success for try_number 1 2024-06-28T01:43:03.946136065Z [2024-06-28T01:43:03.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:42:00+00:00 exited with status success for try_number 1 2024-06-28T01:43:03.954351679Z [2024-06-28T01:43:03.953+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:42:00+00:00, map_index=-1, run_start_date=2024-06-28 01:43:01.881088+00:00, run_end_date=2024-06-28 01:43:03.137699+00:00, run_duration=1.256611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=848, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:43:00.186190+00:00, queued_by_job_id=2, pid=12390 2024-06-28T01:43:03.954599079Z [2024-06-28T01:43:03.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:42:00+00:00, map_index=-1, run_start_date=2024-06-28 01:43:01.984513+00:00, run_end_date=2024-06-28 01:43:03.616592+00:00, run_duration=1.632079, state=success, executor_state=success, try_number=1, max_tries=1, job_id=849, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:43:00.186190+00:00, queued_by_job_id=2, pid=12391 2024-06-28T01:44:00.664979186Z [2024-06-28T01:44:00.664+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:44:00+00:00, run_after=2024-06-28T01:45:00+00:00 2024-06-28T01:44:00.672023868Z [2024-06-28T01:44:00.671+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:44:00.679016847Z [2024-06-28T01:44:00.678+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:44:00.692909842Z [2024-06-28T01:44:00.692+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:44:00+00:00, run_after=2024-06-28T01:45:00+00:00 2024-06-28T01:44:00.794494077Z [2024-06-28T01:44:00.794+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:44:00.794524077Z 2024-06-28T01:44:00.794534176Z 2024-06-28T01:44:00.794539553Z 2024-06-28T01:44:00.794544526Z 2024-06-28T01:44:00.794567612Z [2024-06-28T01:44:00.794+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:44:00.794628203Z [2024-06-28T01:44:00.794+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:44:00.794762965Z [2024-06-28T01:44:00.794+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:44:00.794810603Z [2024-06-28T01:44:00.794+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:44:00.795544436Z [2024-06-28T01:44:00.795+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:44:00.795563455Z 2024-06-28T01:44:00.795591003Z 2024-06-28T01:44:00.795595747Z 2024-06-28T01:44:00.795600188Z 2024-06-28T01:44:00.802420992Z [2024-06-28T01:44:00.802+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:44:00.802604856Z [2024-06-28T01:44:00.802+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:44:00.803079357Z [2024-06-28T01:44:00.802+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:44:00.803187983Z [2024-06-28T01:44:00.802+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:44:00.803516786Z [2024-06-28T01:44:00.803+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:44:00.803677523Z [2024-06-28T01:44:00.803+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:44:00.803964308Z [2024-06-28T01:44:00.803+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:44:00.804107979Z [2024-06-28T01:44:00.803+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:44:01.113467303Z [2024-06-28T01:44:01.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:42:00+00:00 exited with status queued for try_number 1 2024-06-28T01:44:01.113491116Z [2024-06-28T01:44:01.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:43:00+00:00 exited with status queued for try_number 1 2024-06-28T01:44:01.113636321Z [2024-06-28T01:44:01.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:43:00+00:00 exited with status queued for try_number 1 2024-06-28T01:44:01.113717416Z [2024-06-28T01:44:01.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:43:00+00:00 exited with status queued for try_number 1 2024-06-28T01:44:01.125633390Z [2024-06-28T01:44:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3187b6e3-1a00-474b-ad38-b79f700523db 2024-06-28T01:44:01.125779689Z [2024-06-28T01:44:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to d62b0303-43d8-4f63-8d62-2c1e9f230b82 2024-06-28T01:44:01.125958735Z [2024-06-28T01:44:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97f3505f-b22c-468d-986b-0b2b269d89ad 2024-06-28T01:44:01.126191835Z [2024-06-28T01:44:01.126+0000] {scheduler_job.py:635} INFO - Setting external_id for to fea930ee-a511-499f-8608-e2fcbbb43d18 2024-06-28T01:44:02.305870648Z [2024-06-28T01:44:02.305+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:44:02.306445410Z [2024-06-28T01:44:02.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:42:00+00:00, run_id=scheduled__2024-06-28T01:42:00+00:00, run_start_date=2024-06-28 01:44:00.704229+00:00, run_end_date=2024-06-28 01:44:02.306070+00:00, run_duration=1.601841, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:42:00+00:00, data_interval_end=2024-06-28 01:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:44:02.314886704Z [2024-06-28T01:44:02.314+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:44:00+00:00, run_after=2024-06-28T01:46:00+00:00 2024-06-28T01:44:02.321673110Z [2024-06-28T01:44:02.321+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:44:02.322135471Z [2024-06-28T01:44:02.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:43:00+00:00, run_id=scheduled__2024-06-28T01:43:00+00:00, run_start_date=2024-06-28 01:44:00.705488+00:00, run_end_date=2024-06-28 01:44:02.321825+00:00, run_duration=1.616337, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:43:00+00:00, data_interval_end=2024-06-28 01:44:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:44:02.332062137Z [2024-06-28T01:44:02.331+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:44:00+00:00, run_after=2024-06-28T01:45:00+00:00 2024-06-28T01:44:02.375609746Z [2024-06-28T01:44:02.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:42:00+00:00 exited with status success for try_number 1 2024-06-28T01:44:02.375865836Z [2024-06-28T01:44:02.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:43:00+00:00 exited with status success for try_number 1 2024-06-28T01:44:02.381779791Z [2024-06-28T01:44:02.381+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:42:00+00:00, map_index=-1, run_start_date=2024-06-28 01:44:01.552685+00:00, run_end_date=2024-06-28 01:44:02.000795+00:00, run_duration=0.44811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=850, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:44:00.797035+00:00, queued_by_job_id=2, pid=12424 2024-06-28T01:44:02.382181490Z [2024-06-28T01:44:02.381+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:43:00+00:00, map_index=-1, run_start_date=2024-06-28 01:44:01.642667+00:00, run_end_date=2024-06-28 01:44:02.030089+00:00, run_duration=0.387422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=851, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:44:00.797035+00:00, queued_by_job_id=2, pid=12425 2024-06-28T01:44:04.526868508Z [2024-06-28T01:44:04.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:44:04.527138604Z [2024-06-28T01:44:04.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:43:00+00:00, run_id=scheduled__2024-06-28T01:43:00+00:00, run_start_date=2024-06-28 01:44:00.706476+00:00, run_end_date=2024-06-28 01:44:04.526550+00:00, run_duration=3.820074, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:43:00+00:00, data_interval_end=2024-06-28 01:44:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:44:04.537468420Z [2024-06-28T01:44:04.537+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:44:00+00:00, run_after=2024-06-28T01:45:00+00:00 2024-06-28T01:44:04.623794906Z [2024-06-28T01:44:04.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:43:00+00:00 exited with status success for try_number 1 2024-06-28T01:44:04.631732165Z [2024-06-28T01:44:04.631+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:43:00+00:00, map_index=-1, run_start_date=2024-06-28 01:44:02.796308+00:00, run_end_date=2024-06-28 01:44:04.165244+00:00, run_duration=1.368936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=852, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:44:00.797035+00:00, queued_by_job_id=2, pid=12448 2024-06-28T01:44:05.118619612Z [2024-06-28T01:44:05.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:44:05.119031627Z [2024-06-28T01:44:05.118+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:43:00+00:00, run_id=scheduled__2024-06-28T01:43:00+00:00, run_start_date=2024-06-28 01:44:00.707541+00:00, run_end_date=2024-06-28 01:44:05.118473+00:00, run_duration=4.410932, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:43:00+00:00, data_interval_end=2024-06-28 01:44:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:44:05.128117293Z [2024-06-28T01:44:05.127+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:44:00+00:00, run_after=2024-06-28T01:45:00+00:00 2024-06-28T01:44:05.163754496Z [2024-06-28T01:44:05.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:43:00+00:00 exited with status success for try_number 1 2024-06-28T01:44:05.169433725Z [2024-06-28T01:44:05.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:43:00+00:00, map_index=-1, run_start_date=2024-06-28 01:44:02.879830+00:00, run_end_date=2024-06-28 01:44:04.878392+00:00, run_duration=1.998562, state=success, executor_state=success, try_number=1, max_tries=1, job_id=853, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:44:00.797035+00:00, queued_by_job_id=2, pid=12449 2024-06-28T01:45:00.252708996Z [2024-06-28T01:45:00.252+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:45:00+00:00, run_after=2024-06-28T01:46:00+00:00 2024-06-28T01:45:00.263391424Z [2024-06-28T01:45:00.262+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:45:00.277287758Z [2024-06-28T01:45:00.276+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:45:00+00:00, run_after=2024-06-28T01:50:00+00:00 2024-06-28T01:45:00.290362963Z [2024-06-28T01:45:00.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:45:00+00:00, run_after=2024-06-28T01:46:00+00:00 2024-06-28T01:45:00.410450019Z [2024-06-28T01:45:00.409+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:45:00.410493338Z 2024-06-28T01:45:00.410500439Z 2024-06-28T01:45:00.410507781Z 2024-06-28T01:45:00.410516184Z 2024-06-28T01:45:00.412145522Z [2024-06-28T01:45:00.410+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:45:00.412680923Z [2024-06-28T01:45:00.412+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:45:00.413143057Z [2024-06-28T01:45:00.412+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:45:00.413321622Z [2024-06-28T01:45:00.413+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:45:00.414778590Z [2024-06-28T01:45:00.414+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:45:00.414822110Z 2024-06-28T01:45:00.414828141Z 2024-06-28T01:45:00.414833255Z 2024-06-28T01:45:00.414838421Z 2024-06-28T01:45:00.421346936Z [2024-06-28T01:45:00.421+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T01:45:00.421650459Z [2024-06-28T01:45:00.421+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:45:00.421975547Z [2024-06-28T01:45:00.421+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:45:00.422119930Z [2024-06-28T01:45:00.421+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:45:00.422436707Z [2024-06-28T01:45:00.422+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:45:00.422590471Z [2024-06-28T01:45:00.422+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:45:00.422950566Z [2024-06-28T01:45:00.422+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:45:00.423161174Z [2024-06-28T01:45:00.422+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:45:00.934529809Z [2024-06-28T01:45:00.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:40:00+00:00 exited with status queued for try_number 1 2024-06-28T01:45:00.936615739Z [2024-06-28T01:45:00.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:44:00+00:00 exited with status queued for try_number 1 2024-06-28T01:45:00.936732303Z [2024-06-28T01:45:00.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:44:00+00:00 exited with status queued for try_number 1 2024-06-28T01:45:00.936818432Z [2024-06-28T01:45:00.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:44:00+00:00 exited with status queued for try_number 1 2024-06-28T01:45:00.960082593Z [2024-06-28T01:45:00.959+0000] {scheduler_job.py:635} INFO - Setting external_id for to b139b14a-e9f5-4603-b26e-755b0bf1c49d 2024-06-28T01:45:00.960311707Z [2024-06-28T01:45:00.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4abad11-e9f6-4210-a803-2b4a78bb06ea 2024-06-28T01:45:00.960476370Z [2024-06-28T01:45:00.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5842401f-8181-4dfb-8352-f139f11acf22 2024-06-28T01:45:00.960621841Z [2024-06-28T01:45:00.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to e93d22f4-ba98-4e70-a439-29a28e507af1 2024-06-28T01:45:02.650833231Z [2024-06-28T01:45:02.650+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:45:02.651007052Z [2024-06-28T01:45:02.650+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:44:00+00:00, run_id=scheduled__2024-06-28T01:44:00+00:00, run_start_date=2024-06-28 01:45:00.301798+00:00, run_end_date=2024-06-28 01:45:02.650709+00:00, run_duration=2.348911, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:44:00+00:00, data_interval_end=2024-06-28 01:45:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:45:02.660742746Z [2024-06-28T01:45:02.659+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:45:00+00:00, run_after=2024-06-28T01:46:00+00:00 2024-06-28T01:45:02.734107609Z [2024-06-28T01:45:02.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:44:00+00:00 exited with status success for try_number 1 2024-06-28T01:45:02.742889605Z [2024-06-28T01:45:02.742+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:44:00+00:00, map_index=-1, run_start_date=2024-06-28 01:45:01.389562+00:00, run_end_date=2024-06-28 01:45:01.732999+00:00, run_duration=0.343437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=854, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:45:00.416728+00:00, queued_by_job_id=2, pid=12482 2024-06-28T01:45:03.868239143Z [2024-06-28T01:45:03.867+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:45:03.868276775Z 2024-06-28T01:45:03.868288614Z [2024-06-28T01:45:03.868+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:45:03.868737944Z [2024-06-28T01:45:03.868+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:45:03.868753398Z 2024-06-28T01:45:03.871087449Z [2024-06-28T01:45:03.870+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T01:45:03.871140771Z [2024-06-28T01:45:03.871+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:45:03.978645221Z [2024-06-28T01:45:03.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:40:00+00:00 exited with status queued for try_number 1 2024-06-28T01:45:03.979041473Z [2024-06-28T01:45:03.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:40:00+00:00 exited with status success for try_number 1 2024-06-28T01:45:03.988347955Z [2024-06-28T01:45:03.988+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3508fe8b-ea5a-4ac4-a42a-9d16596ce80d 2024-06-28T01:45:03.988655103Z [2024-06-28T01:45:03.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T01:40:00+00:00, map_index=-1, run_start_date=2024-06-28 01:45:02.589406+00:00, run_end_date=2024-06-28 01:45:03.032932+00:00, run_duration=0.443526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=857, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:45:00.416728+00:00, queued_by_job_id=2, pid=12508 2024-06-28T01:45:05.152535880Z [2024-06-28T01:45:05.151+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:45:05.153328560Z [2024-06-28T01:45:05.152+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:44:00+00:00, run_id=scheduled__2024-06-28T01:44:00+00:00, run_start_date=2024-06-28 01:45:00.303825+00:00, run_end_date=2024-06-28 01:45:05.152819+00:00, run_duration=4.848994, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:44:00+00:00, data_interval_end=2024-06-28 01:45:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:45:05.166251133Z [2024-06-28T01:45:05.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:45:00+00:00, run_after=2024-06-28T01:46:00+00:00 2024-06-28T01:45:05.172834825Z [2024-06-28T01:45:05.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:45:05.173191823Z [2024-06-28T01:45:05.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:44:00+00:00, run_id=scheduled__2024-06-28T01:44:00+00:00, run_start_date=2024-06-28 01:45:00.302786+00:00, run_end_date=2024-06-28 01:45:05.172900+00:00, run_duration=4.870114, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:44:00+00:00, data_interval_end=2024-06-28 01:45:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:45:05.183415104Z [2024-06-28T01:45:05.183+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:45:00+00:00, run_after=2024-06-28T01:46:00+00:00 2024-06-28T01:45:05.237635433Z [2024-06-28T01:45:05.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:44:00+00:00 exited with status success for try_number 1 2024-06-28T01:45:05.237893816Z [2024-06-28T01:45:05.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:44:00+00:00 exited with status success for try_number 1 2024-06-28T01:45:05.244221482Z [2024-06-28T01:45:05.243+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:44:00+00:00, map_index=-1, run_start_date=2024-06-28 01:45:02.446061+00:00, run_end_date=2024-06-28 01:45:04.062539+00:00, run_duration=1.616478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=855, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:45:00.416728+00:00, queued_by_job_id=2, pid=12506 2024-06-28T01:45:05.244440609Z [2024-06-28T01:45:05.244+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:44:00+00:00, map_index=-1, run_start_date=2024-06-28 01:45:02.538466+00:00, run_end_date=2024-06-28 01:45:03.931101+00:00, run_duration=1.392635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=856, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:45:00.416728+00:00, queued_by_job_id=2, pid=12507 2024-06-28T01:45:07.199170804Z [2024-06-28T01:45:07.198+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:45:07.199243151Z 2024-06-28T01:45:07.199274853Z [2024-06-28T01:45:07.199+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:45:07.200239699Z [2024-06-28T01:45:07.199+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:45:07.200309683Z 2024-06-28T01:45:07.203797386Z [2024-06-28T01:45:07.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T01:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T01:45:07.203920006Z [2024-06-28T01:45:07.203+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T01:45:07.269286815Z [2024-06-28T01:45:07.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:40:00+00:00 exited with status queued for try_number 1 2024-06-28T01:45:07.271226030Z [2024-06-28T01:45:07.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:40:00+00:00 exited with status success for try_number 1 2024-06-28T01:45:07.277123659Z [2024-06-28T01:45:07.276+0000] {scheduler_job.py:635} INFO - Setting external_id for to 808e6eaa-2718-440c-9c8a-898c82953dd9 2024-06-28T01:45:07.277294053Z [2024-06-28T01:45:07.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T01:40:00+00:00, map_index=-1, run_start_date=2024-06-28 01:45:05.849495+00:00, run_end_date=2024-06-28 01:45:06.229943+00:00, run_duration=0.380448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=858, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:45:03.869002+00:00, queued_by_job_id=2, pid=12531 2024-06-28T01:45:09.566579436Z [2024-06-28T01:45:09.566+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:45:09.566609328Z 2024-06-28T01:45:09.566991573Z [2024-06-28T01:45:09.566+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:45:09.567976532Z [2024-06-28T01:45:09.567+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:45:09.567991095Z 2024-06-28T01:45:09.571264271Z [2024-06-28T01:45:09.570+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:45:09.571762018Z [2024-06-28T01:45:09.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:45:09.636173068Z [2024-06-28T01:45:09.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:40:00+00:00 exited with status queued for try_number 1 2024-06-28T01:45:09.643388171Z [2024-06-28T01:45:09.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to b621eb06-4c82-4d72-b8ed-de4950a9d524 2024-06-28T01:45:09.728207072Z [2024-06-28T01:45:09.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:40:00+00:00 exited with status success for try_number 1 2024-06-28T01:45:09.734585186Z [2024-06-28T01:45:09.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T01:40:00+00:00, map_index=0, run_start_date=2024-06-28 01:45:09.003745+00:00, run_end_date=2024-06-28 01:45:09.470195+00:00, run_duration=0.46645, state=success, executor_state=success, try_number=1, max_tries=1, job_id=859, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:45:07.200644+00:00, queued_by_job_id=2, pid=12539 2024-06-28T01:45:12.306163474Z [2024-06-28T01:45:12.305+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:45:12.306573131Z [2024-06-28T01:45:12.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:40:00+00:00, run_id=scheduled__2024-06-28T01:40:00+00:00, run_start_date=2024-06-28 01:45:00.300595+00:00, run_end_date=2024-06-28 01:45:12.305897+00:00, run_duration=12.005302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:40:00+00:00, data_interval_end=2024-06-28 01:45:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T01:45:12.318087465Z [2024-06-28T01:45:12.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:45:00+00:00, run_after=2024-06-28T01:50:00+00:00 2024-06-28T01:45:12.364762123Z [2024-06-28T01:45:12.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:40:00+00:00 exited with status success for try_number 1 2024-06-28T01:45:12.370248640Z [2024-06-28T01:45:12.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T01:40:00+00:00, map_index=-1, run_start_date=2024-06-28 01:45:11.241190+00:00, run_end_date=2024-06-28 01:45:11.653582+00:00, run_duration=0.412392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=860, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:45:09.568685+00:00, queued_by_job_id=2, pid=12547 2024-06-28T01:46:00.323263111Z [2024-06-28T01:46:00.322+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:46:00.343654143Z [2024-06-28T01:46:00.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:46:00+00:00, run_after=2024-06-28T01:47:00+00:00 2024-06-28T01:46:00.362034044Z [2024-06-28T01:46:00.361+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:46:00+00:00, run_after=2024-06-28T01:47:00+00:00 2024-06-28T01:46:00.373394435Z [2024-06-28T01:46:00.373+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:46:00.487601029Z [2024-06-28T01:46:00.487+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:46:00.487639664Z 2024-06-28T01:46:00.487648800Z 2024-06-28T01:46:00.487682847Z 2024-06-28T01:46:00.487690441Z 2024-06-28T01:46:00.488136278Z [2024-06-28T01:46:00.487+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:46:00.488814769Z [2024-06-28T01:46:00.488+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:46:00.489267872Z [2024-06-28T01:46:00.488+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:46:00.489652200Z [2024-06-28T01:46:00.489+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:46:00.491797510Z [2024-06-28T01:46:00.491+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:46:00.491829466Z 2024-06-28T01:46:00.491841661Z 2024-06-28T01:46:00.491852355Z 2024-06-28T01:46:00.491862996Z 2024-06-28T01:46:00.500901582Z [2024-06-28T01:46:00.500+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:46:00.501275017Z [2024-06-28T01:46:00.500+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:46:00.501774070Z [2024-06-28T01:46:00.501+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:46:00.502013886Z [2024-06-28T01:46:00.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:46:00.502451936Z [2024-06-28T01:46:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:46:00.502742546Z [2024-06-28T01:46:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:46:00.503172981Z [2024-06-28T01:46:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:46:00.503408338Z [2024-06-28T01:46:00.503+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:46:00.975822585Z [2024-06-28T01:46:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:44:00+00:00 exited with status queued for try_number 1 2024-06-28T01:46:00.975858773Z [2024-06-28T01:46:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:45:00+00:00 exited with status queued for try_number 1 2024-06-28T01:46:00.975889086Z [2024-06-28T01:46:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:45:00+00:00 exited with status queued for try_number 1 2024-06-28T01:46:00.975967571Z [2024-06-28T01:46:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:45:00+00:00 exited with status queued for try_number 1 2024-06-28T01:46:00.991998803Z [2024-06-28T01:46:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 134dc916-716a-49aa-9d0f-0643cb554ee9 2024-06-28T01:46:00.992052966Z [2024-06-28T01:46:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 109ece49-df16-4d4b-b898-2a0113c3d295 2024-06-28T01:46:00.992168870Z [2024-06-28T01:46:00.992+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92d13594-d58c-4d85-960e-96cb37ee74af 2024-06-28T01:46:00.992266108Z [2024-06-28T01:46:00.992+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9caca26c-b0a1-4a45-8504-4cb207494156 2024-06-28T01:46:01.875298060Z [2024-06-28T01:46:01.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:46:01.875797112Z [2024-06-28T01:46:01.875+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:44:00+00:00, run_id=scheduled__2024-06-28T01:44:00+00:00, run_start_date=2024-06-28 01:46:00.386315+00:00, run_end_date=2024-06-28 01:46:01.875220+00:00, run_duration=1.488905, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:44:00+00:00, data_interval_end=2024-06-28 01:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:46:01.884802057Z [2024-06-28T01:46:01.884+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:46:00+00:00, run_after=2024-06-28T01:48:00+00:00 2024-06-28T01:46:01.892347586Z [2024-06-28T01:46:01.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:46:01.892523500Z [2024-06-28T01:46:01.892+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:45:00+00:00, run_id=scheduled__2024-06-28T01:45:00+00:00, run_start_date=2024-06-28 01:46:00.388373+00:00, run_end_date=2024-06-28 01:46:01.892261+00:00, run_duration=1.503888, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:45:00+00:00, data_interval_end=2024-06-28 01:46:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:46:01.907800414Z [2024-06-28T01:46:01.907+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:46:00+00:00, run_after=2024-06-28T01:47:00+00:00 2024-06-28T01:46:01.979105021Z [2024-06-28T01:46:01.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:44:00+00:00 exited with status success for try_number 1 2024-06-28T01:46:01.979175231Z [2024-06-28T01:46:01.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:45:00+00:00 exited with status success for try_number 1 2024-06-28T01:46:01.991697534Z [2024-06-28T01:46:01.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:44:00+00:00, map_index=-1, run_start_date=2024-06-28 01:46:01.226317+00:00, run_end_date=2024-06-28 01:46:01.558949+00:00, run_duration=0.332632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=861, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:46:00.494653+00:00, queued_by_job_id=2, pid=12571 2024-06-28T01:46:01.991805732Z [2024-06-28T01:46:01.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:45:00+00:00, map_index=-1, run_start_date=2024-06-28 01:46:01.368575+00:00, run_end_date=2024-06-28 01:46:01.719457+00:00, run_duration=0.350882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=862, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:46:00.494653+00:00, queued_by_job_id=2, pid=12572 2024-06-28T01:46:04.195676843Z [2024-06-28T01:46:04.194+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:46:04.195706789Z [2024-06-28T01:46:04.195+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:45:00+00:00, run_id=scheduled__2024-06-28T01:45:00+00:00, run_start_date=2024-06-28 01:46:00.390122+00:00, run_end_date=2024-06-28 01:46:04.194935+00:00, run_duration=3.804813, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:45:00+00:00, data_interval_end=2024-06-28 01:46:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:46:04.214038202Z [2024-06-28T01:46:04.212+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:46:00+00:00, run_after=2024-06-28T01:47:00+00:00 2024-06-28T01:46:04.220794269Z [2024-06-28T01:46:04.220+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:46:04.220875110Z [2024-06-28T01:46:04.220+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:45:00+00:00, run_id=scheduled__2024-06-28T01:45:00+00:00, run_start_date=2024-06-28 01:46:00.391356+00:00, run_end_date=2024-06-28 01:46:04.220650+00:00, run_duration=3.829294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:45:00+00:00, data_interval_end=2024-06-28 01:46:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:46:04.232210202Z [2024-06-28T01:46:04.231+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:46:00+00:00, run_after=2024-06-28T01:47:00+00:00 2024-06-28T01:46:04.272649717Z [2024-06-28T01:46:04.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:45:00+00:00 exited with status success for try_number 1 2024-06-28T01:46:04.272731248Z [2024-06-28T01:46:04.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:45:00+00:00 exited with status success for try_number 1 2024-06-28T01:46:04.279521400Z [2024-06-28T01:46:04.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:45:00+00:00, map_index=-1, run_start_date=2024-06-28 01:46:02.377709+00:00, run_end_date=2024-06-28 01:46:03.936588+00:00, run_duration=1.558879, state=success, executor_state=success, try_number=1, max_tries=1, job_id=863, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:46:00.494653+00:00, queued_by_job_id=2, pid=12595 2024-06-28T01:46:04.279592022Z [2024-06-28T01:46:04.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:45:00+00:00, map_index=-1, run_start_date=2024-06-28 01:46:02.439555+00:00, run_end_date=2024-06-28 01:46:03.667306+00:00, run_duration=1.227751, state=success, executor_state=success, try_number=1, max_tries=1, job_id=864, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:46:00.494653+00:00, queued_by_job_id=2, pid=12596 2024-06-28T01:46:46.827723297Z [2024-06-28T01:46:46.826+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T01:47:00.040133392Z [2024-06-28T01:47:00.039+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:47:00+00:00, run_after=2024-06-28T01:48:00+00:00 2024-06-28T01:47:00.047639779Z [2024-06-28T01:47:00.047+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:47:00.082825700Z [2024-06-28T01:47:00.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:47:00+00:00, run_after=2024-06-28T01:48:00+00:00 2024-06-28T01:47:00.149493099Z [2024-06-28T01:47:00.149+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:47:00.149529056Z 2024-06-28T01:47:00.149555552Z 2024-06-28T01:47:00.149559005Z 2024-06-28T01:47:00.149562146Z [2024-06-28T01:47:00.149+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:47:00.150552496Z [2024-06-28T01:47:00.150+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:47:00.150565338Z [2024-06-28T01:47:00.150+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:47:00.151292131Z [2024-06-28T01:47:00.151+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:47:00.151307355Z 2024-06-28T01:47:00.151312685Z 2024-06-28T01:47:00.151318308Z 2024-06-28T01:47:00.154888429Z [2024-06-28T01:47:00.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:47:00.155071257Z [2024-06-28T01:47:00.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:47:00.155379974Z [2024-06-28T01:47:00.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:47:00.155568184Z [2024-06-28T01:47:00.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:47:00.155844344Z [2024-06-28T01:47:00.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:47:00.156017974Z [2024-06-28T01:47:00.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:47:00.523403011Z [2024-06-28T01:47:00.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:46:00+00:00 exited with status queued for try_number 1 2024-06-28T01:47:00.523996783Z [2024-06-28T01:47:00.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:46:00+00:00 exited with status queued for try_number 1 2024-06-28T01:47:00.524145033Z [2024-06-28T01:47:00.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:46:00+00:00 exited with status queued for try_number 1 2024-06-28T01:47:00.531938205Z [2024-06-28T01:47:00.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab2d724e-5060-442e-a291-3fd14b2dac06 2024-06-28T01:47:00.532157515Z [2024-06-28T01:47:00.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd201687-f6cb-49e1-93e9-59ea216ef7ad 2024-06-28T01:47:00.532325417Z [2024-06-28T01:47:00.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbfc4938-f7ab-4a89-b43f-4d433a254187 2024-06-28T01:47:01.806661173Z [2024-06-28T01:47:01.806+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:47:01.807178893Z [2024-06-28T01:47:01.806+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:46:00+00:00, run_id=scheduled__2024-06-28T01:46:00+00:00, run_start_date=2024-06-28 01:47:00.100061+00:00, run_end_date=2024-06-28 01:47:01.806568+00:00, run_duration=1.706507, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:46:00+00:00, data_interval_end=2024-06-28 01:47:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:47:01.823055915Z [2024-06-28T01:47:01.822+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:47:00+00:00, run_after=2024-06-28T01:48:00+00:00 2024-06-28T01:47:02.290755478Z [2024-06-28T01:47:02.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:46:00+00:00 exited with status success for try_number 1 2024-06-28T01:47:02.297734416Z [2024-06-28T01:47:02.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:46:00+00:00, map_index=-1, run_start_date=2024-06-28 01:47:01.234767+00:00, run_end_date=2024-06-28 01:47:01.761110+00:00, run_duration=0.526343, state=success, executor_state=success, try_number=1, max_tries=1, job_id=865, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:47:00.152382+00:00, queued_by_job_id=2, pid=12628 2024-06-28T01:47:05.226004197Z [2024-06-28T01:47:05.225+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:47:05.227677528Z [2024-06-28T01:47:05.227+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:46:00+00:00, run_id=scheduled__2024-06-28T01:46:00+00:00, run_start_date=2024-06-28 01:47:00.102856+00:00, run_end_date=2024-06-28 01:47:05.226830+00:00, run_duration=5.123974, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:46:00+00:00, data_interval_end=2024-06-28 01:47:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:47:05.249927634Z [2024-06-28T01:47:05.249+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:47:00+00:00, run_after=2024-06-28T01:48:00+00:00 2024-06-28T01:47:05.272337078Z [2024-06-28T01:47:05.271+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:47:05.272534306Z [2024-06-28T01:47:05.272+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:46:00+00:00, run_id=scheduled__2024-06-28T01:46:00+00:00, run_start_date=2024-06-28 01:47:00.101586+00:00, run_end_date=2024-06-28 01:47:05.272213+00:00, run_duration=5.170627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:46:00+00:00, data_interval_end=2024-06-28 01:47:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:47:05.300731048Z [2024-06-28T01:47:05.300+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:47:00+00:00, run_after=2024-06-28T01:48:00+00:00 2024-06-28T01:47:05.341391581Z [2024-06-28T01:47:05.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:46:00+00:00 exited with status success for try_number 1 2024-06-28T01:47:05.341618913Z [2024-06-28T01:47:05.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:46:00+00:00 exited with status success for try_number 1 2024-06-28T01:47:05.347223587Z [2024-06-28T01:47:05.346+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:46:00+00:00, map_index=-1, run_start_date=2024-06-28 01:47:02.493783+00:00, run_end_date=2024-06-28 01:47:04.300503+00:00, run_duration=1.80672, state=success, executor_state=success, try_number=1, max_tries=1, job_id=867, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:47:00.152382+00:00, queued_by_job_id=2, pid=12647 2024-06-28T01:47:05.347583334Z [2024-06-28T01:47:05.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:46:00+00:00, map_index=-1, run_start_date=2024-06-28 01:47:02.255575+00:00, run_end_date=2024-06-28 01:47:04.408458+00:00, run_duration=2.152883, state=success, executor_state=success, try_number=1, max_tries=1, job_id=866, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:47:00.152382+00:00, queued_by_job_id=2, pid=12641 2024-06-28T01:48:01.043163429Z [2024-06-28T01:48:01.042+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:48:00+00:00, run_after=2024-06-28T01:49:00+00:00 2024-06-28T01:48:01.053463714Z [2024-06-28T01:48:01.053+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:48:01.069198171Z [2024-06-28T01:48:01.068+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:48:00+00:00, run_after=2024-06-28T01:49:00+00:00 2024-06-28T01:48:01.076593582Z [2024-06-28T01:48:01.076+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:48:01.167885077Z [2024-06-28T01:48:01.167+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:48:01.167949091Z 2024-06-28T01:48:01.167958568Z 2024-06-28T01:48:01.167965011Z 2024-06-28T01:48:01.167971149Z 2024-06-28T01:48:01.167978380Z [2024-06-28T01:48:01.167+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:48:01.168013311Z [2024-06-28T01:48:01.167+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:48:01.168018255Z [2024-06-28T01:48:01.167+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:48:01.168102333Z [2024-06-28T01:48:01.168+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:48:01.168602376Z [2024-06-28T01:48:01.168+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:48:01.168610551Z 2024-06-28T01:48:01.168614621Z 2024-06-28T01:48:01.168618330Z 2024-06-28T01:48:01.168621851Z 2024-06-28T01:48:01.172424310Z [2024-06-28T01:48:01.172+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:48:01.172474012Z [2024-06-28T01:48:01.172+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:48:01.172666513Z [2024-06-28T01:48:01.172+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:48:01.172724279Z [2024-06-28T01:48:01.172+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:48:01.172892836Z [2024-06-28T01:48:01.172+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:48:01.172958028Z [2024-06-28T01:48:01.172+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:48:01.173115478Z [2024-06-28T01:48:01.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:48:01.173177417Z [2024-06-28T01:48:01.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:48:01.579824296Z [2024-06-28T01:48:01.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:46:00+00:00 exited with status queued for try_number 1 2024-06-28T01:48:01.579854152Z [2024-06-28T01:48:01.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:47:00+00:00 exited with status queued for try_number 1 2024-06-28T01:48:01.579927894Z [2024-06-28T01:48:01.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:47:00+00:00 exited with status queued for try_number 1 2024-06-28T01:48:01.579971320Z [2024-06-28T01:48:01.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:47:00+00:00 exited with status queued for try_number 1 2024-06-28T01:48:01.590654056Z [2024-06-28T01:48:01.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3af17ea5-6e45-447f-aad8-551d63ca7ad7 2024-06-28T01:48:01.590786463Z [2024-06-28T01:48:01.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4075d7da-f225-43b4-8b45-c0e2d3a0d331 2024-06-28T01:48:01.590914830Z [2024-06-28T01:48:01.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to d92fb267-d5cb-4c8b-a78f-0280a40ddc8c 2024-06-28T01:48:01.591032482Z [2024-06-28T01:48:01.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e7db8ba-dfe3-42fe-b5c8-51da58320308 2024-06-28T01:48:02.553867723Z [2024-06-28T01:48:02.553+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:48:02.554204969Z [2024-06-28T01:48:02.553+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:46:00+00:00, run_id=scheduled__2024-06-28T01:46:00+00:00, run_start_date=2024-06-28 01:48:01.087659+00:00, run_end_date=2024-06-28 01:48:02.553821+00:00, run_duration=1.466162, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:46:00+00:00, data_interval_end=2024-06-28 01:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:48:02.574010135Z [2024-06-28T01:48:02.573+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:48:00+00:00, run_after=2024-06-28T01:50:00+00:00 2024-06-28T01:48:02.631407926Z [2024-06-28T01:48:02.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:46:00+00:00 exited with status success for try_number 1 2024-06-28T01:48:02.637396084Z [2024-06-28T01:48:02.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:46:00+00:00, map_index=-1, run_start_date=2024-06-28 01:48:01.969593+00:00, run_end_date=2024-06-28 01:48:02.288410+00:00, run_duration=0.318817, state=success, executor_state=success, try_number=1, max_tries=1, job_id=868, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:48:01.169467+00:00, queued_by_job_id=2, pid=12681 2024-06-28T01:48:03.682051654Z [2024-06-28T01:48:03.681+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:48:03.682465057Z [2024-06-28T01:48:03.682+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:47:00+00:00, run_id=scheduled__2024-06-28T01:47:00+00:00, run_start_date=2024-06-28 01:48:01.089060+00:00, run_end_date=2024-06-28 01:48:03.681933+00:00, run_duration=2.592873, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:47:00+00:00, data_interval_end=2024-06-28 01:48:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:48:03.695972552Z [2024-06-28T01:48:03.695+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:48:00+00:00, run_after=2024-06-28T01:49:00+00:00 2024-06-28T01:48:03.763871788Z [2024-06-28T01:48:03.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:47:00+00:00 exited with status success for try_number 1 2024-06-28T01:48:03.769822548Z [2024-06-28T01:48:03.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:47:00+00:00, map_index=-1, run_start_date=2024-06-28 01:48:02.205298+00:00, run_end_date=2024-06-28 01:48:02.568584+00:00, run_duration=0.363286, state=success, executor_state=success, try_number=1, max_tries=1, job_id=869, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:48:01.169467+00:00, queued_by_job_id=2, pid=12686 2024-06-28T01:48:05.140260529Z [2024-06-28T01:48:05.139+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:48:05.140504296Z [2024-06-28T01:48:05.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:47:00+00:00, run_id=scheduled__2024-06-28T01:47:00+00:00, run_start_date=2024-06-28 01:48:01.090162+00:00, run_end_date=2024-06-28 01:48:05.140240+00:00, run_duration=4.050078, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:47:00+00:00, data_interval_end=2024-06-28 01:48:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:48:05.148409751Z [2024-06-28T01:48:05.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:48:00+00:00, run_after=2024-06-28T01:49:00+00:00 2024-06-28T01:48:05.154991847Z [2024-06-28T01:48:05.154+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:48:05.155307684Z [2024-06-28T01:48:05.155+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:47:00+00:00, run_id=scheduled__2024-06-28T01:47:00+00:00, run_start_date=2024-06-28 01:48:01.091571+00:00, run_end_date=2024-06-28 01:48:05.155041+00:00, run_duration=4.06347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:47:00+00:00, data_interval_end=2024-06-28 01:48:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:48:05.163857768Z [2024-06-28T01:48:05.163+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:48:00+00:00, run_after=2024-06-28T01:49:00+00:00 2024-06-28T01:48:05.197832677Z [2024-06-28T01:48:05.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:47:00+00:00 exited with status success for try_number 1 2024-06-28T01:48:05.198096495Z [2024-06-28T01:48:05.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:47:00+00:00 exited with status success for try_number 1 2024-06-28T01:48:05.210918965Z [2024-06-28T01:48:05.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:47:00+00:00, map_index=-1, run_start_date=2024-06-28 01:48:03.066685+00:00, run_end_date=2024-06-28 01:48:04.367595+00:00, run_duration=1.30091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=870, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:48:01.169467+00:00, queued_by_job_id=2, pid=12700 2024-06-28T01:48:05.211735691Z [2024-06-28T01:48:05.211+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:47:00+00:00, map_index=-1, run_start_date=2024-06-28 01:48:03.309048+00:00, run_end_date=2024-06-28 01:48:04.844857+00:00, run_duration=1.535809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=871, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:48:01.169467+00:00, queued_by_job_id=2, pid=12706 2024-06-28T01:49:00.028463271Z [2024-06-28T01:49:00.027+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:49:00.049020847Z [2024-06-28T01:49:00.048+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:49:00+00:00, run_after=2024-06-28T01:50:00+00:00 2024-06-28T01:49:00.076050109Z [2024-06-28T01:49:00.075+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:49:00+00:00, run_after=2024-06-28T01:50:00+00:00 2024-06-28T01:49:00.166881599Z [2024-06-28T01:49:00.166+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:49:00.166922275Z 2024-06-28T01:49:00.166929996Z 2024-06-28T01:49:00.166936813Z 2024-06-28T01:49:00.167327098Z [2024-06-28T01:49:00.166+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:49:00.167708647Z [2024-06-28T01:49:00.167+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:49:00.168021283Z [2024-06-28T01:49:00.167+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:49:00.169248241Z [2024-06-28T01:49:00.168+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:49:00.169269930Z 2024-06-28T01:49:00.169277181Z 2024-06-28T01:49:00.169284229Z 2024-06-28T01:49:00.174671087Z [2024-06-28T01:49:00.174+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:49:00.174848951Z [2024-06-28T01:49:00.174+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:49:00.175378768Z [2024-06-28T01:49:00.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:49:00.175881753Z [2024-06-28T01:49:00.175+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:49:00.176179279Z [2024-06-28T01:49:00.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:49:00.176367206Z [2024-06-28T01:49:00.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:49:00.437106363Z [2024-06-28T01:49:00.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:48:00+00:00 exited with status queued for try_number 1 2024-06-28T01:49:00.437266716Z [2024-06-28T01:49:00.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:48:00+00:00 exited with status queued for try_number 1 2024-06-28T01:49:00.437469591Z [2024-06-28T01:49:00.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:48:00+00:00 exited with status queued for try_number 1 2024-06-28T01:49:00.445401965Z [2024-06-28T01:49:00.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce0f278e-d009-456c-9510-9acebc659527 2024-06-28T01:49:00.445603235Z [2024-06-28T01:49:00.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4bcd280c-852d-4d94-a8e1-dbb95d43a235 2024-06-28T01:49:00.445786562Z [2024-06-28T01:49:00.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ad6a8c9-1763-4f50-bb12-478f69c7813b 2024-06-28T01:49:01.582670465Z [2024-06-28T01:49:01.582+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:49:01.582979825Z [2024-06-28T01:49:01.582+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:48:00+00:00, run_id=scheduled__2024-06-28T01:48:00+00:00, run_start_date=2024-06-28 01:49:00.092731+00:00, run_end_date=2024-06-28 01:49:01.582574+00:00, run_duration=1.489843, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:48:00+00:00, data_interval_end=2024-06-28 01:49:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:49:01.593141817Z [2024-06-28T01:49:01.592+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:49:00+00:00, run_after=2024-06-28T01:50:00+00:00 2024-06-28T01:49:01.643846354Z [2024-06-28T01:49:01.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:48:00+00:00 exited with status success for try_number 1 2024-06-28T01:49:01.654742501Z [2024-06-28T01:49:01.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:48:00+00:00, map_index=-1, run_start_date=2024-06-28 01:49:00.917280+00:00, run_end_date=2024-06-28 01:49:01.266735+00:00, run_duration=0.349455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=872, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:49:00.170636+00:00, queued_by_job_id=2, pid=12739 2024-06-28T01:49:04.034655250Z [2024-06-28T01:49:04.033+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:49:04.035714779Z [2024-06-28T01:49:04.035+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:48:00+00:00, run_id=scheduled__2024-06-28T01:48:00+00:00, run_start_date=2024-06-28 01:49:00.094338+00:00, run_end_date=2024-06-28 01:49:04.034611+00:00, run_duration=3.940273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:48:00+00:00, data_interval_end=2024-06-28 01:49:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:49:04.058073028Z [2024-06-28T01:49:04.057+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:49:00+00:00, run_after=2024-06-28T01:50:00+00:00 2024-06-28T01:49:04.071943581Z [2024-06-28T01:49:04.071+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:49:04.072364236Z [2024-06-28T01:49:04.072+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:48:00+00:00, run_id=scheduled__2024-06-28T01:48:00+00:00, run_start_date=2024-06-28 01:49:00.095665+00:00, run_end_date=2024-06-28 01:49:04.071921+00:00, run_duration=3.976256, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:48:00+00:00, data_interval_end=2024-06-28 01:49:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:49:04.087746289Z [2024-06-28T01:49:04.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:49:00+00:00, run_after=2024-06-28T01:50:00+00:00 2024-06-28T01:49:04.175403592Z [2024-06-28T01:49:04.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:48:00+00:00 exited with status success for try_number 1 2024-06-28T01:49:04.175463572Z [2024-06-28T01:49:04.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:48:00+00:00 exited with status success for try_number 1 2024-06-28T01:49:04.182067497Z [2024-06-28T01:49:04.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:48:00+00:00, map_index=-1, run_start_date=2024-06-28 01:49:01.912315+00:00, run_end_date=2024-06-28 01:49:03.197206+00:00, run_duration=1.284891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=874, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:49:00.170636+00:00, queued_by_job_id=2, pid=12758 2024-06-28T01:49:04.182202003Z [2024-06-28T01:49:04.182+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:48:00+00:00, map_index=-1, run_start_date=2024-06-28 01:49:01.883222+00:00, run_end_date=2024-06-28 01:49:03.610468+00:00, run_duration=1.727246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=873, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:49:00.170636+00:00, queued_by_job_id=2, pid=12757 2024-06-28T01:50:00.260320562Z [2024-06-28T01:50:00.259+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:50:00+00:00, run_after=2024-06-28T01:51:00+00:00 2024-06-28T01:50:00.285891238Z [2024-06-28T01:50:00.278+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:50:00+00:00, run_after=2024-06-28T01:51:00+00:00 2024-06-28T01:50:00.289207299Z [2024-06-28T01:50:00.288+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:50:00.296655049Z [2024-06-28T01:50:00.296+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:50:00.314904518Z [2024-06-28T01:50:00.312+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:50:00+00:00, run_after=2024-06-28T01:55:00+00:00 2024-06-28T01:50:00.445579527Z [2024-06-28T01:50:00.444+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-28T01:50:00.445625802Z 2024-06-28T01:50:00.445636757Z 2024-06-28T01:50:00.445646397Z 2024-06-28T01:50:00.445655524Z 2024-06-28T01:50:00.445664340Z 2024-06-28T01:50:00.446071012Z [2024-06-28T01:50:00.445+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:50:00.446521531Z [2024-06-28T01:50:00.446+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:50:00.446948795Z [2024-06-28T01:50:00.446+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:50:00.447307986Z [2024-06-28T01:50:00.447+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:50:00.447720882Z [2024-06-28T01:50:00.447+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:50:00.449037034Z [2024-06-28T01:50:00.448+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:50:00.449055856Z 2024-06-28T01:50:00.449065314Z 2024-06-28T01:50:00.449074083Z 2024-06-28T01:50:00.449082773Z 2024-06-28T01:50:00.449122399Z 2024-06-28T01:50:00.456277876Z [2024-06-28T01:50:00.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T01:50:00.456576752Z [2024-06-28T01:50:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:50:00.456987720Z [2024-06-28T01:50:00.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:50:00.457288178Z [2024-06-28T01:50:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:50:00.457670395Z [2024-06-28T01:50:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:50:00.457932025Z [2024-06-28T01:50:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:50:00.458344652Z [2024-06-28T01:50:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:50:00.458605122Z [2024-06-28T01:50:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:50:00.459032672Z [2024-06-28T01:50:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:50:00.459290437Z [2024-06-28T01:50:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:50:01.144695931Z [2024-06-28T01:50:01.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:45:00+00:00 exited with status queued for try_number 1 2024-06-28T01:50:01.145186233Z [2024-06-28T01:50:01.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:48:00+00:00 exited with status queued for try_number 1 2024-06-28T01:50:01.145527354Z [2024-06-28T01:50:01.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:49:00+00:00 exited with status queued for try_number 1 2024-06-28T01:50:01.145796775Z [2024-06-28T01:50:01.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:49:00+00:00 exited with status queued for try_number 1 2024-06-28T01:50:01.146137602Z [2024-06-28T01:50:01.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:49:00+00:00 exited with status queued for try_number 1 2024-06-28T01:50:01.186301218Z [2024-06-28T01:50:01.185+0000] {scheduler_job.py:635} INFO - Setting external_id for to bffef68f-d36f-4c8f-8ab0-df14b76bc98a 2024-06-28T01:50:01.192967847Z [2024-06-28T01:50:01.186+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65d5d49f-aef9-420d-884f-02e3195b9301 2024-06-28T01:50:01.193604475Z [2024-06-28T01:50:01.193+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95ce4778-6f56-455e-b48a-2bd42c23a681 2024-06-28T01:50:01.194007575Z [2024-06-28T01:50:01.193+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa49044c-54ac-4059-97f0-e5068e7e5fc7 2024-06-28T01:50:01.194420872Z [2024-06-28T01:50:01.194+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c108236-2230-4644-8ead-69566ca43cfb 2024-06-28T01:50:02.593452931Z [2024-06-28T01:50:02.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:50:02.594385259Z [2024-06-28T01:50:02.594+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:48:00+00:00, run_id=scheduled__2024-06-28T01:48:00+00:00, run_start_date=2024-06-28 01:50:00.328379+00:00, run_end_date=2024-06-28 01:50:02.593324+00:00, run_duration=2.264945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:48:00+00:00, data_interval_end=2024-06-28 01:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:50:02.606029636Z [2024-06-28T01:50:02.605+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:50:00+00:00, run_after=2024-06-28T01:52:00+00:00 2024-06-28T01:50:02.627179185Z [2024-06-28T01:50:02.626+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:50:02.627492425Z [2024-06-28T01:50:02.627+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:49:00+00:00, run_id=scheduled__2024-06-28T01:49:00+00:00, run_start_date=2024-06-28 01:50:00.329557+00:00, run_end_date=2024-06-28 01:50:02.627006+00:00, run_duration=2.297449, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:49:00+00:00, data_interval_end=2024-06-28 01:50:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:50:02.641006761Z [2024-06-28T01:50:02.640+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:50:00+00:00, run_after=2024-06-28T01:51:00+00:00 2024-06-28T01:50:02.737123450Z [2024-06-28T01:50:02.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:48:00+00:00 exited with status success for try_number 1 2024-06-28T01:50:02.737163017Z [2024-06-28T01:50:02.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:49:00+00:00 exited with status success for try_number 1 2024-06-28T01:50:02.748386077Z [2024-06-28T01:50:02.748+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:49:00+00:00, map_index=-1, run_start_date=2024-06-28 01:50:01.650074+00:00, run_end_date=2024-06-28 01:50:02.030326+00:00, run_duration=0.380252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=876, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:50:00.450848+00:00, queued_by_job_id=2, pid=12798 2024-06-28T01:50:02.748687734Z [2024-06-28T01:50:02.748+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:48:00+00:00, map_index=-1, run_start_date=2024-06-28 01:50:01.297354+00:00, run_end_date=2024-06-28 01:50:01.721645+00:00, run_duration=0.424291, state=success, executor_state=success, try_number=1, max_tries=1, job_id=875, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:50:00.450848+00:00, queued_by_job_id=2, pid=12788 2024-06-28T01:50:03.287105193Z [2024-06-28T01:50:03.286+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:50:03.287146719Z 2024-06-28T01:50:03.287490308Z [2024-06-28T01:50:03.287+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:50:03.288185277Z [2024-06-28T01:50:03.287+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:50:03.288198425Z 2024-06-28T01:50:03.290670241Z [2024-06-28T01:50:03.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T01:50:03.291144683Z [2024-06-28T01:50:03.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:50:03.354213721Z [2024-06-28T01:50:03.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:45:00+00:00 exited with status queued for try_number 1 2024-06-28T01:50:03.368453394Z [2024-06-28T01:50:03.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4de802a6-e032-4323-803a-6d49effd83e2 2024-06-28T01:50:03.467622385Z [2024-06-28T01:50:03.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:45:00+00:00 exited with status success for try_number 1 2024-06-28T01:50:03.478530811Z [2024-06-28T01:50:03.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T01:45:00+00:00, map_index=-1, run_start_date=2024-06-28 01:50:02.810423+00:00, run_end_date=2024-06-28 01:50:03.193791+00:00, run_duration=0.383368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=879, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:50:00.450848+00:00, queued_by_job_id=2, pid=12825 2024-06-28T01:50:04.522381962Z [2024-06-28T01:50:04.521+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:50:04.522839953Z [2024-06-28T01:50:04.522+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:49:00+00:00, run_id=scheduled__2024-06-28T01:49:00+00:00, run_start_date=2024-06-28 01:50:00.332079+00:00, run_end_date=2024-06-28 01:50:04.522299+00:00, run_duration=4.19022, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:49:00+00:00, data_interval_end=2024-06-28 01:50:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:50:04.531777595Z [2024-06-28T01:50:04.531+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:50:00+00:00, run_after=2024-06-28T01:51:00+00:00 2024-06-28T01:50:04.539247485Z [2024-06-28T01:50:04.538+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:50:04.539645560Z [2024-06-28T01:50:04.539+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:49:00+00:00, run_id=scheduled__2024-06-28T01:49:00+00:00, run_start_date=2024-06-28 01:50:00.330870+00:00, run_end_date=2024-06-28 01:50:04.539172+00:00, run_duration=4.208302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:49:00+00:00, data_interval_end=2024-06-28 01:50:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:50:04.549107887Z [2024-06-28T01:50:04.548+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:50:00+00:00, run_after=2024-06-28T01:51:00+00:00 2024-06-28T01:50:04.597387596Z [2024-06-28T01:50:04.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:49:00+00:00 exited with status success for try_number 1 2024-06-28T01:50:04.597630025Z [2024-06-28T01:50:04.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:49:00+00:00 exited with status success for try_number 1 2024-06-28T01:50:04.613268405Z [2024-06-28T01:50:04.612+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:49:00+00:00, map_index=-1, run_start_date=2024-06-28 01:50:02.614861+00:00, run_end_date=2024-06-28 01:50:04.017506+00:00, run_duration=1.402645, state=success, executor_state=success, try_number=1, max_tries=1, job_id=877, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:50:00.450848+00:00, queued_by_job_id=2, pid=12823 2024-06-28T01:50:04.613706236Z [2024-06-28T01:50:04.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:49:00+00:00, map_index=-1, run_start_date=2024-06-28 01:50:02.705169+00:00, run_end_date=2024-06-28 01:50:04.412907+00:00, run_duration=1.707738, state=success, executor_state=success, try_number=1, max_tries=1, job_id=878, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:50:00.450848+00:00, queued_by_job_id=2, pid=12824 2024-06-28T01:50:05.698812280Z [2024-06-28T01:50:05.698+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:50:05.698837713Z 2024-06-28T01:50:05.702552962Z [2024-06-28T01:50:05.702+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:50:05.704965005Z [2024-06-28T01:50:05.704+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:50:05.704982982Z 2024-06-28T01:50:05.724173323Z [2024-06-28T01:50:05.723+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T01:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T01:50:05.730215651Z [2024-06-28T01:50:05.729+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T01:50:05.817758117Z [2024-06-28T01:50:05.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:45:00+00:00 exited with status queued for try_number 1 2024-06-28T01:50:05.817787472Z [2024-06-28T01:50:05.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:45:00+00:00 exited with status success for try_number 1 2024-06-28T01:50:05.828567499Z [2024-06-28T01:50:05.828+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18c5cf78-50c0-43d3-8f91-44bc5ec8d8c0 2024-06-28T01:50:05.828672894Z [2024-06-28T01:50:05.828+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T01:45:00+00:00, map_index=-1, run_start_date=2024-06-28 01:50:05.178117+00:00, run_end_date=2024-06-28 01:50:05.603383+00:00, run_duration=0.425266, state=success, executor_state=success, try_number=1, max_tries=1, job_id=880, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:50:03.288580+00:00, queued_by_job_id=2, pid=12848 2024-06-28T01:50:08.231538712Z [2024-06-28T01:50:08.230+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:50:08.231573508Z 2024-06-28T01:50:08.231665393Z [2024-06-28T01:50:08.231+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:50:08.232492928Z [2024-06-28T01:50:08.232+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:50:08.232501478Z 2024-06-28T01:50:08.236100816Z [2024-06-28T01:50:08.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:50:08.236273205Z [2024-06-28T01:50:08.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:50:08.300955258Z [2024-06-28T01:50:08.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:45:00+00:00 exited with status queued for try_number 1 2024-06-28T01:50:08.301007904Z [2024-06-28T01:50:08.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:45:00+00:00 exited with status success for try_number 1 2024-06-28T01:50:08.310415317Z [2024-06-28T01:50:08.309+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac036243-a6f6-4c77-937c-e2b6a2896743 2024-06-28T01:50:08.310642203Z [2024-06-28T01:50:08.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T01:45:00+00:00, map_index=0, run_start_date=2024-06-28 01:50:07.609222+00:00, run_end_date=2024-06-28 01:50:07.983496+00:00, run_duration=0.374274, state=success, executor_state=success, try_number=1, max_tries=1, job_id=881, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:50:05.707272+00:00, queued_by_job_id=2, pid=12856 2024-06-28T01:50:10.546818025Z [2024-06-28T01:50:10.546+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:50:10.547207180Z [2024-06-28T01:50:10.546+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:45:00+00:00, run_id=scheduled__2024-06-28T01:45:00+00:00, run_start_date=2024-06-28 01:50:00.326944+00:00, run_end_date=2024-06-28 01:50:10.546900+00:00, run_duration=10.219956, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:45:00+00:00, data_interval_end=2024-06-28 01:50:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T01:50:10.552746301Z [2024-06-28T01:50:10.552+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:50:00+00:00, run_after=2024-06-28T01:55:00+00:00 2024-06-28T01:50:10.582165674Z [2024-06-28T01:50:10.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:45:00+00:00 exited with status success for try_number 1 2024-06-28T01:50:10.587784632Z [2024-06-28T01:50:10.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T01:45:00+00:00, map_index=-1, run_start_date=2024-06-28 01:50:09.883864+00:00, run_end_date=2024-06-28 01:50:10.323229+00:00, run_duration=0.439365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=882, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:50:08.233170+00:00, queued_by_job_id=2, pid=12864 2024-06-28T01:51:00.705801541Z [2024-06-28T01:51:00.705+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:51:00+00:00, run_after=2024-06-28T01:52:00+00:00 2024-06-28T01:51:00.724547811Z [2024-06-28T01:51:00.724+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:51:00+00:00, run_after=2024-06-28T01:52:00+00:00 2024-06-28T01:51:00.734413300Z [2024-06-28T01:51:00.734+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:51:00.829095847Z [2024-06-28T01:51:00.828+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:51:00.829135412Z 2024-06-28T01:51:00.829142988Z 2024-06-28T01:51:00.829148849Z 2024-06-28T01:51:00.829521331Z [2024-06-28T01:51:00.829+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:51:00.829823626Z [2024-06-28T01:51:00.829+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:51:00.830090316Z [2024-06-28T01:51:00.829+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:51:00.831271912Z [2024-06-28T01:51:00.830+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:51:00.831302781Z 2024-06-28T01:51:00.831312575Z 2024-06-28T01:51:00.831321347Z 2024-06-28T01:51:00.835864245Z [2024-06-28T01:51:00.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:51:00.836251714Z [2024-06-28T01:51:00.836+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:51:00.836669386Z [2024-06-28T01:51:00.836+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:51:00.836957925Z [2024-06-28T01:51:00.836+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:51:00.837399475Z [2024-06-28T01:51:00.837+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:51:00.837656357Z [2024-06-28T01:51:00.837+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:51:01.180467869Z [2024-06-28T01:51:01.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:50:00+00:00 exited with status queued for try_number 1 2024-06-28T01:51:01.180652011Z [2024-06-28T01:51:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:50:00+00:00 exited with status queued for try_number 1 2024-06-28T01:51:01.180814472Z [2024-06-28T01:51:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:50:00+00:00 exited with status queued for try_number 1 2024-06-28T01:51:01.188363822Z [2024-06-28T01:51:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9697cd9c-8309-4a1d-8c5b-a5384f441a2b 2024-06-28T01:51:01.188596683Z [2024-06-28T01:51:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to c07bce52-8074-45d8-9a5e-8e460bfa34c5 2024-06-28T01:51:01.188796116Z [2024-06-28T01:51:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a9af8aa-432f-4891-b360-2c6898bfe3bf 2024-06-28T01:51:02.318469380Z [2024-06-28T01:51:02.318+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:51:02.318722562Z [2024-06-28T01:51:02.318+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:50:00+00:00, run_id=scheduled__2024-06-28T01:50:00+00:00, run_start_date=2024-06-28 01:51:00.745800+00:00, run_end_date=2024-06-28 01:51:02.318381+00:00, run_duration=1.572581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:50:00+00:00, data_interval_end=2024-06-28 01:51:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:51:02.328440010Z [2024-06-28T01:51:02.328+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:51:00+00:00, run_after=2024-06-28T01:52:00+00:00 2024-06-28T01:51:02.376031173Z [2024-06-28T01:51:02.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:50:00+00:00 exited with status success for try_number 1 2024-06-28T01:51:02.381454207Z [2024-06-28T01:51:02.381+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:50:00+00:00, map_index=-1, run_start_date=2024-06-28 01:51:01.716344+00:00, run_end_date=2024-06-28 01:51:02.117347+00:00, run_duration=0.401003, state=success, executor_state=success, try_number=1, max_tries=1, job_id=883, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:51:00.832368+00:00, queued_by_job_id=2, pid=12886 2024-06-28T01:51:04.809063594Z [2024-06-28T01:51:04.808+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:51:04.809740917Z [2024-06-28T01:51:04.809+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:50:00+00:00, run_id=scheduled__2024-06-28T01:50:00+00:00, run_start_date=2024-06-28 01:51:00.748531+00:00, run_end_date=2024-06-28 01:51:04.809292+00:00, run_duration=4.060761, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:50:00+00:00, data_interval_end=2024-06-28 01:51:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:51:04.824607872Z [2024-06-28T01:51:04.824+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:51:00+00:00, run_after=2024-06-28T01:52:00+00:00 2024-06-28T01:51:04.869765660Z [2024-06-28T01:51:04.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:50:00+00:00 exited with status success for try_number 1 2024-06-28T01:51:04.875257537Z [2024-06-28T01:51:04.874+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:50:00+00:00, map_index=-1, run_start_date=2024-06-28 01:51:02.788590+00:00, run_end_date=2024-06-28 01:51:04.445280+00:00, run_duration=1.65669, state=success, executor_state=success, try_number=1, max_tries=1, job_id=884, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:51:00.832368+00:00, queued_by_job_id=2, pid=12904 2024-06-28T01:51:05.940035309Z [2024-06-28T01:51:05.939+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:51:05.940977540Z [2024-06-28T01:51:05.940+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:50:00+00:00, run_id=scheduled__2024-06-28T01:50:00+00:00, run_start_date=2024-06-28 01:51:00.753971+00:00, run_end_date=2024-06-28 01:51:05.940540+00:00, run_duration=5.186569, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:50:00+00:00, data_interval_end=2024-06-28 01:51:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:51:05.950007182Z [2024-06-28T01:51:05.949+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:51:00+00:00, run_after=2024-06-28T01:52:00+00:00 2024-06-28T01:51:06.007247239Z [2024-06-28T01:51:05.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:50:00+00:00 exited with status success for try_number 1 2024-06-28T01:51:06.015888950Z [2024-06-28T01:51:06.015+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:50:00+00:00, map_index=-1, run_start_date=2024-06-28 01:51:02.886138+00:00, run_end_date=2024-06-28 01:51:05.384466+00:00, run_duration=2.498328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=885, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:51:00.832368+00:00, queued_by_job_id=2, pid=12905 2024-06-28T01:51:46.914961546Z [2024-06-28T01:51:46.914+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T01:52:00.083991086Z [2024-06-28T01:52:00.083+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:52:00.102243108Z [2024-06-28T01:52:00.101+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:52:00.132698254Z [2024-06-28T01:52:00.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:52:00+00:00, run_after=2024-06-28T01:53:00+00:00 2024-06-28T01:52:00.157699753Z [2024-06-28T01:52:00.157+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:52:00+00:00, run_after=2024-06-28T01:53:00+00:00 2024-06-28T01:52:00.271473040Z [2024-06-28T01:52:00.270+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:52:00.271558081Z 2024-06-28T01:52:00.271577126Z 2024-06-28T01:52:00.271591019Z 2024-06-28T01:52:00.271606087Z 2024-06-28T01:52:00.272845594Z [2024-06-28T01:52:00.272+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:52:00.273119920Z [2024-06-28T01:52:00.272+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:52:00.273238528Z [2024-06-28T01:52:00.273+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:52:00.273444123Z [2024-06-28T01:52:00.273+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:52:00.274538869Z [2024-06-28T01:52:00.274+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:52:00.274565203Z 2024-06-28T01:52:00.274578474Z 2024-06-28T01:52:00.274591574Z 2024-06-28T01:52:00.274607145Z 2024-06-28T01:52:00.281616889Z [2024-06-28T01:52:00.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:52:00.282496955Z [2024-06-28T01:52:00.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:52:00.283453125Z [2024-06-28T01:52:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:52:00.284202735Z [2024-06-28T01:52:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:52:00.285080737Z [2024-06-28T01:52:00.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:52:00.285809764Z [2024-06-28T01:52:00.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:52:00.286662425Z [2024-06-28T01:52:00.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:52:00.287288199Z [2024-06-28T01:52:00.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:52:00.745996125Z [2024-06-28T01:52:00.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:50:00+00:00 exited with status queued for try_number 1 2024-06-28T01:52:00.746094453Z [2024-06-28T01:52:00.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:51:00+00:00 exited with status queued for try_number 1 2024-06-28T01:52:00.746209624Z [2024-06-28T01:52:00.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:51:00+00:00 exited with status queued for try_number 1 2024-06-28T01:52:00.746306596Z [2024-06-28T01:52:00.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:51:00+00:00 exited with status queued for try_number 1 2024-06-28T01:52:00.759167921Z [2024-06-28T01:52:00.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebcde551-24e8-4ab6-a0a4-ede99386842e 2024-06-28T01:52:00.759314278Z [2024-06-28T01:52:00.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83df2546-39f3-491e-9145-30b1157bb495 2024-06-28T01:52:00.759472144Z [2024-06-28T01:52:00.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to b52934be-3316-4a4b-9cd1-4dfdb53a39fc 2024-06-28T01:52:00.759671036Z [2024-06-28T01:52:00.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7af446b-0c4f-458b-a14b-805cfb645f72 2024-06-28T01:52:01.926594764Z [2024-06-28T01:52:01.926+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:52:01.927153029Z [2024-06-28T01:52:01.926+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:50:00+00:00, run_id=scheduled__2024-06-28T01:50:00+00:00, run_start_date=2024-06-28 01:52:00.174944+00:00, run_end_date=2024-06-28 01:52:01.926783+00:00, run_duration=1.751839, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:50:00+00:00, data_interval_end=2024-06-28 01:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:52:01.936486982Z [2024-06-28T01:52:01.936+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:52:00+00:00, run_after=2024-06-28T01:54:00+00:00 2024-06-28T01:52:01.943788230Z [2024-06-28T01:52:01.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:52:01.944234242Z [2024-06-28T01:52:01.944+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:51:00+00:00, run_id=scheduled__2024-06-28T01:51:00+00:00, run_start_date=2024-06-28 01:52:00.177174+00:00, run_end_date=2024-06-28 01:52:01.943947+00:00, run_duration=1.766773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:51:00+00:00, data_interval_end=2024-06-28 01:52:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:52:01.954361974Z [2024-06-28T01:52:01.953+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:52:00+00:00, run_after=2024-06-28T01:53:00+00:00 2024-06-28T01:52:02.017828704Z [2024-06-28T01:52:02.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:50:00+00:00 exited with status success for try_number 1 2024-06-28T01:52:02.018153984Z [2024-06-28T01:52:02.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:51:00+00:00 exited with status success for try_number 1 2024-06-28T01:52:02.032889759Z [2024-06-28T01:52:02.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:50:00+00:00, map_index=-1, run_start_date=2024-06-28 01:52:01.101109+00:00, run_end_date=2024-06-28 01:52:01.486087+00:00, run_duration=0.384978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=886, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:52:00.276124+00:00, queued_by_job_id=2, pid=12938 2024-06-28T01:52:02.034370360Z [2024-06-28T01:52:02.034+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:51:00+00:00, map_index=-1, run_start_date=2024-06-28 01:52:01.180965+00:00, run_end_date=2024-06-28 01:52:01.563597+00:00, run_duration=0.382632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=887, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:52:00.276124+00:00, queued_by_job_id=2, pid=12939 2024-06-28T01:52:03.616630014Z [2024-06-28T01:52:03.616+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:52:03.617082867Z [2024-06-28T01:52:03.616+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:51:00+00:00, run_id=scheduled__2024-06-28T01:51:00+00:00, run_start_date=2024-06-28 01:52:00.178805+00:00, run_end_date=2024-06-28 01:52:03.616508+00:00, run_duration=3.437703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:51:00+00:00, data_interval_end=2024-06-28 01:52:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:52:03.634156328Z [2024-06-28T01:52:03.633+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:52:00+00:00, run_after=2024-06-28T01:53:00+00:00 2024-06-28T01:52:03.694271138Z [2024-06-28T01:52:03.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:51:00+00:00 exited with status success for try_number 1 2024-06-28T01:52:03.706450944Z [2024-06-28T01:52:03.705+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:51:00+00:00, map_index=-1, run_start_date=2024-06-28 01:52:02.168502+00:00, run_end_date=2024-06-28 01:52:03.471836+00:00, run_duration=1.303334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=888, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:52:00.276124+00:00, queued_by_job_id=2, pid=12962 2024-06-28T01:52:05.005971000Z [2024-06-28T01:52:05.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:52:05.009155599Z [2024-06-28T01:52:05.008+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:51:00+00:00, run_id=scheduled__2024-06-28T01:51:00+00:00, run_start_date=2024-06-28 01:52:00.180264+00:00, run_end_date=2024-06-28 01:52:05.005863+00:00, run_duration=4.825599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:51:00+00:00, data_interval_end=2024-06-28 01:52:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:52:05.023953229Z [2024-06-28T01:52:05.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:52:00+00:00, run_after=2024-06-28T01:53:00+00:00 2024-06-28T01:52:05.053366467Z [2024-06-28T01:52:05.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:51:00+00:00 exited with status success for try_number 1 2024-06-28T01:52:05.062616824Z [2024-06-28T01:52:05.062+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:51:00+00:00, map_index=-1, run_start_date=2024-06-28 01:52:02.315826+00:00, run_end_date=2024-06-28 01:52:03.973916+00:00, run_duration=1.65809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=889, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:52:00.276124+00:00, queued_by_job_id=2, pid=12963 2024-06-28T01:53:00.743902686Z [2024-06-28T01:53:00.743+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:53:00.764215553Z [2024-06-28T01:53:00.763+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:53:00+00:00, run_after=2024-06-28T01:54:00+00:00 2024-06-28T01:53:00.780871746Z [2024-06-28T01:53:00.780+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:53:00+00:00, run_after=2024-06-28T01:54:00+00:00 2024-06-28T01:53:00.851100725Z [2024-06-28T01:53:00.850+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:53:00.851136061Z 2024-06-28T01:53:00.851141877Z 2024-06-28T01:53:00.851147096Z 2024-06-28T01:53:00.851404271Z [2024-06-28T01:53:00.851+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:53:00.851686380Z [2024-06-28T01:53:00.851+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:53:00.851895854Z [2024-06-28T01:53:00.851+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:53:00.852650499Z [2024-06-28T01:53:00.852+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:53:00.852683916Z 2024-06-28T01:53:00.852689709Z 2024-06-28T01:53:00.852694822Z 2024-06-28T01:53:00.856530999Z [2024-06-28T01:53:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:53:00.856881543Z [2024-06-28T01:53:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:53:00.857276824Z [2024-06-28T01:53:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:53:00.857656608Z [2024-06-28T01:53:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:53:00.857932119Z [2024-06-28T01:53:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:53:00.858205682Z [2024-06-28T01:53:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:53:01.122247202Z [2024-06-28T01:53:01.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:52:00+00:00 exited with status queued for try_number 1 2024-06-28T01:53:01.122606564Z [2024-06-28T01:53:01.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:52:00+00:00 exited with status queued for try_number 1 2024-06-28T01:53:01.122617067Z [2024-06-28T01:53:01.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:52:00+00:00 exited with status queued for try_number 1 2024-06-28T01:53:01.131253292Z [2024-06-28T01:53:01.130+0000] {scheduler_job.py:635} INFO - Setting external_id for to e04661c2-384d-4e4a-8802-0ec1ed4296b3 2024-06-28T01:53:01.131386302Z [2024-06-28T01:53:01.131+0000] {scheduler_job.py:635} INFO - Setting external_id for to 502c3ffd-d692-4094-9d57-c4aa8e356b7b 2024-06-28T01:53:01.131568433Z [2024-06-28T01:53:01.131+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6847d98-6859-4318-a485-ce2784867654 2024-06-28T01:53:02.309403573Z [2024-06-28T01:53:02.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:53:02.309795488Z [2024-06-28T01:53:02.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:52:00+00:00, run_id=scheduled__2024-06-28T01:52:00+00:00, run_start_date=2024-06-28 01:53:00.790525+00:00, run_end_date=2024-06-28 01:53:02.309304+00:00, run_duration=1.518779, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:52:00+00:00, data_interval_end=2024-06-28 01:53:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:53:02.319861161Z [2024-06-28T01:53:02.319+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:53:00+00:00, run_after=2024-06-28T01:54:00+00:00 2024-06-28T01:53:02.382477674Z [2024-06-28T01:53:02.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:52:00+00:00 exited with status success for try_number 1 2024-06-28T01:53:02.393601234Z [2024-06-28T01:53:02.393+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:52:00+00:00, map_index=-1, run_start_date=2024-06-28 01:53:01.615739+00:00, run_end_date=2024-06-28 01:53:01.998181+00:00, run_duration=0.382442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=890, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:53:00.853522+00:00, queued_by_job_id=2, pid=12995 2024-06-28T01:53:04.196720973Z [2024-06-28T01:53:04.195+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:53:04.196747293Z [2024-06-28T01:53:04.196+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:52:00+00:00, run_id=scheduled__2024-06-28T01:52:00+00:00, run_start_date=2024-06-28 01:53:00.791909+00:00, run_end_date=2024-06-28 01:53:04.196362+00:00, run_duration=3.404453, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:52:00+00:00, data_interval_end=2024-06-28 01:53:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:53:04.210847833Z [2024-06-28T01:53:04.210+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:53:00+00:00, run_after=2024-06-28T01:54:00+00:00 2024-06-28T01:53:04.277471996Z [2024-06-28T01:53:04.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:52:00+00:00 exited with status success for try_number 1 2024-06-28T01:53:04.288163325Z [2024-06-28T01:53:04.287+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:52:00+00:00, map_index=-1, run_start_date=2024-06-28 01:53:02.761944+00:00, run_end_date=2024-06-28 01:53:03.974675+00:00, run_duration=1.212731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=892, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:53:00.853522+00:00, queued_by_job_id=2, pid=13014 2024-06-28T01:53:04.746398719Z [2024-06-28T01:53:04.746+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:53:04.746935348Z [2024-06-28T01:53:04.746+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:52:00+00:00, run_id=scheduled__2024-06-28T01:52:00+00:00, run_start_date=2024-06-28 01:53:00.792885+00:00, run_end_date=2024-06-28 01:53:04.746300+00:00, run_duration=3.953415, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:52:00+00:00, data_interval_end=2024-06-28 01:53:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:53:04.756676789Z [2024-06-28T01:53:04.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:53:00+00:00, run_after=2024-06-28T01:54:00+00:00 2024-06-28T01:53:04.814506458Z [2024-06-28T01:53:04.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:52:00+00:00 exited with status success for try_number 1 2024-06-28T01:53:04.822853461Z [2024-06-28T01:53:04.822+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:52:00+00:00, map_index=-1, run_start_date=2024-06-28 01:53:02.555687+00:00, run_end_date=2024-06-28 01:53:04.184049+00:00, run_duration=1.628362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=891, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:53:00.853522+00:00, queued_by_job_id=2, pid=13013 2024-06-28T01:54:00.723170330Z [2024-06-28T01:54:00.722+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:54:00.745817583Z [2024-06-28T01:54:00.745+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:54:00+00:00, run_after=2024-06-28T01:55:00+00:00 2024-06-28T01:54:00.755697125Z [2024-06-28T01:54:00.755+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:54:00.770594328Z [2024-06-28T01:54:00.770+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:54:00+00:00, run_after=2024-06-28T01:55:00+00:00 2024-06-28T01:54:00.888128864Z [2024-06-28T01:54:00.887+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:54:00.888181201Z 2024-06-28T01:54:00.888196066Z 2024-06-28T01:54:00.888205703Z 2024-06-28T01:54:00.888264908Z 2024-06-28T01:54:00.888471594Z [2024-06-28T01:54:00.888+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:54:00.888993758Z [2024-06-28T01:54:00.888+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:54:00.889534436Z [2024-06-28T01:54:00.889+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:54:00.889910737Z [2024-06-28T01:54:00.889+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:54:00.891676301Z [2024-06-28T01:54:00.891+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:54:00.891699025Z 2024-06-28T01:54:00.891733457Z 2024-06-28T01:54:00.891741978Z 2024-06-28T01:54:00.891749293Z 2024-06-28T01:54:00.898891025Z [2024-06-28T01:54:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:54:00.899106694Z [2024-06-28T01:54:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:54:00.899545553Z [2024-06-28T01:54:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:54:00.899733188Z [2024-06-28T01:54:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:54:00.900225549Z [2024-06-28T01:54:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:54:00.900461282Z [2024-06-28T01:54:00.900+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:54:00.900869599Z [2024-06-28T01:54:00.900+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:54:00.901088545Z [2024-06-28T01:54:00.900+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:54:01.260385994Z [2024-06-28T01:54:01.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:52:00+00:00 exited with status queued for try_number 1 2024-06-28T01:54:01.260536157Z [2024-06-28T01:54:01.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:53:00+00:00 exited with status queued for try_number 1 2024-06-28T01:54:01.260708433Z [2024-06-28T01:54:01.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:53:00+00:00 exited with status queued for try_number 1 2024-06-28T01:54:01.260839022Z [2024-06-28T01:54:01.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:53:00+00:00 exited with status queued for try_number 1 2024-06-28T01:54:01.282729835Z [2024-06-28T01:54:01.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdef658a-9e11-42ee-84f0-3287677f4ee7 2024-06-28T01:54:01.282763710Z [2024-06-28T01:54:01.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to 794701d4-b0dc-4f10-b364-5f792a0b594f 2024-06-28T01:54:01.282906336Z [2024-06-28T01:54:01.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to 904e73b1-ebcc-453d-9a09-b4006f36e216 2024-06-28T01:54:01.283055447Z [2024-06-28T01:54:01.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to 749bf5ce-18f3-4997-80ca-c8fc908f85a6 2024-06-28T01:54:02.552039712Z [2024-06-28T01:54:02.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:54:02.552514356Z [2024-06-28T01:54:02.552+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:53:00+00:00, run_id=scheduled__2024-06-28T01:53:00+00:00, run_start_date=2024-06-28 01:54:00.785152+00:00, run_end_date=2024-06-28 01:54:02.551928+00:00, run_duration=1.766776, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:53:00+00:00, data_interval_end=2024-06-28 01:54:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:54:02.562390759Z [2024-06-28T01:54:02.562+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:54:00+00:00, run_after=2024-06-28T01:55:00+00:00 2024-06-28T01:54:02.612077029Z [2024-06-28T01:54:02.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:52:00+00:00 exited with status success for try_number 1 2024-06-28T01:54:02.612541436Z [2024-06-28T01:54:02.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:53:00+00:00 exited with status success for try_number 1 2024-06-28T01:54:02.625991519Z [2024-06-28T01:54:02.625+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:53:00+00:00, map_index=-1, run_start_date=2024-06-28 01:54:01.831959+00:00, run_end_date=2024-06-28 01:54:02.275058+00:00, run_duration=0.443099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=893, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:54:00.893799+00:00, queued_by_job_id=2, pid=13048 2024-06-28T01:54:02.626582333Z [2024-06-28T01:54:02.626+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:52:00+00:00, map_index=-1, run_start_date=2024-06-28 01:54:02.019458+00:00, run_end_date=2024-06-28 01:54:02.454638+00:00, run_duration=0.43518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=894, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:54:00.893799+00:00, queued_by_job_id=2, pid=13049 2024-06-28T01:54:03.676250934Z [2024-06-28T01:54:03.675+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:54:03.676615424Z [2024-06-28T01:54:03.676+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:52:00+00:00, run_id=scheduled__2024-06-28T01:52:00+00:00, run_start_date=2024-06-28 01:54:00.783552+00:00, run_end_date=2024-06-28 01:54:03.676246+00:00, run_duration=2.892694, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:52:00+00:00, data_interval_end=2024-06-28 01:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:54:03.685268443Z [2024-06-28T01:54:03.684+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:54:00+00:00, run_after=2024-06-28T01:56:00+00:00 2024-06-28T01:54:05.725416860Z [2024-06-28T01:54:05.724+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:54:05.725769562Z [2024-06-28T01:54:05.725+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:53:00+00:00, run_id=scheduled__2024-06-28T01:53:00+00:00, run_start_date=2024-06-28 01:54:00.786430+00:00, run_end_date=2024-06-28 01:54:05.725295+00:00, run_duration=4.938865, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:53:00+00:00, data_interval_end=2024-06-28 01:54:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:54:05.735628424Z [2024-06-28T01:54:05.735+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:54:00+00:00, run_after=2024-06-28T01:55:00+00:00 2024-06-28T01:54:05.744761245Z [2024-06-28T01:54:05.742+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:54:05.744788146Z [2024-06-28T01:54:05.743+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:53:00+00:00, run_id=scheduled__2024-06-28T01:53:00+00:00, run_start_date=2024-06-28 01:54:00.787674+00:00, run_end_date=2024-06-28 01:54:05.743215+00:00, run_duration=4.955541, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:53:00+00:00, data_interval_end=2024-06-28 01:54:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:54:05.757091568Z [2024-06-28T01:54:05.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:54:00+00:00, run_after=2024-06-28T01:55:00+00:00 2024-06-28T01:54:05.792824007Z [2024-06-28T01:54:05.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:53:00+00:00 exited with status success for try_number 1 2024-06-28T01:54:05.793070623Z [2024-06-28T01:54:05.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:53:00+00:00 exited with status success for try_number 1 2024-06-28T01:54:05.800573483Z [2024-06-28T01:54:05.800+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:53:00+00:00, map_index=-1, run_start_date=2024-06-28 01:54:03.037168+00:00, run_end_date=2024-06-28 01:54:05.617919+00:00, run_duration=2.580751, state=success, executor_state=success, try_number=1, max_tries=1, job_id=895, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:54:00.893799+00:00, queued_by_job_id=2, pid=13072 2024-06-28T01:54:05.801046001Z [2024-06-28T01:54:05.800+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:53:00+00:00, map_index=-1, run_start_date=2024-06-28 01:54:03.216427+00:00, run_end_date=2024-06-28 01:54:05.383149+00:00, run_duration=2.166722, state=success, executor_state=success, try_number=1, max_tries=1, job_id=896, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:54:00.893799+00:00, queued_by_job_id=2, pid=13073 2024-06-28T01:55:00.374045502Z [2024-06-28T01:55:00.373+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:55:00.393282080Z [2024-06-28T01:55:00.392+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:55:00+00:00, run_after=2024-06-28T01:56:00+00:00 2024-06-28T01:55:00.408435407Z [2024-06-28T01:55:00.408+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:55:00+00:00, run_after=2024-06-28T02:00:00+00:00 2024-06-28T01:55:00.421696770Z [2024-06-28T01:55:00.421+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:55:00+00:00, run_after=2024-06-28T01:56:00+00:00 2024-06-28T01:55:00.525804523Z [2024-06-28T01:55:00.525+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:55:00.525851688Z 2024-06-28T01:55:00.525862283Z 2024-06-28T01:55:00.525903165Z 2024-06-28T01:55:00.525912191Z 2024-06-28T01:55:00.526366749Z [2024-06-28T01:55:00.525+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:55:00.526894239Z [2024-06-28T01:55:00.526+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:55:00.527330887Z [2024-06-28T01:55:00.526+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:55:00.527860435Z [2024-06-28T01:55:00.527+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:55:00.529441178Z [2024-06-28T01:55:00.529+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:55:00.529454702Z 2024-06-28T01:55:00.529459485Z 2024-06-28T01:55:00.529463882Z 2024-06-28T01:55:00.529468211Z 2024-06-28T01:55:00.535212219Z [2024-06-28T01:55:00.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T01:55:00.535399229Z [2024-06-28T01:55:00.535+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:55:00.535882587Z [2024-06-28T01:55:00.535+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:55:00.535951315Z [2024-06-28T01:55:00.535+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:55:00.536487253Z [2024-06-28T01:55:00.536+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:55:00.536658267Z [2024-06-28T01:55:00.536+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:55:00.537154291Z [2024-06-28T01:55:00.536+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:55:00.537418671Z [2024-06-28T01:55:00.537+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:55:00.935015128Z [2024-06-28T01:55:00.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:50:00+00:00 exited with status queued for try_number 1 2024-06-28T01:55:00.935391121Z [2024-06-28T01:55:00.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:54:00+00:00 exited with status queued for try_number 1 2024-06-28T01:55:00.935587651Z [2024-06-28T01:55:00.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:54:00+00:00 exited with status queued for try_number 1 2024-06-28T01:55:00.935813534Z [2024-06-28T01:55:00.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:54:00+00:00 exited with status queued for try_number 1 2024-06-28T01:55:00.946351207Z [2024-06-28T01:55:00.946+0000] {scheduler_job.py:635} INFO - Setting external_id for to d17f12b7-f479-434a-9f9f-c39d765629dd 2024-06-28T01:55:00.946845865Z [2024-06-28T01:55:00.946+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45418ea5-edf0-42cb-a2a4-b0c5a212361c 2024-06-28T01:55:00.947292591Z [2024-06-28T01:55:00.947+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7ace6cc-48eb-4980-9b7c-0e4bb497a3ee 2024-06-28T01:55:00.947574148Z [2024-06-28T01:55:00.947+0000] {scheduler_job.py:635} INFO - Setting external_id for to adce7286-ba46-4600-af08-1108ecd218b0 2024-06-28T01:55:02.134408867Z [2024-06-28T01:55:02.134+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:55:02.134865175Z [2024-06-28T01:55:02.134+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:54:00+00:00, run_id=scheduled__2024-06-28T01:54:00+00:00, run_start_date=2024-06-28 01:55:00.435991+00:00, run_end_date=2024-06-28 01:55:02.134481+00:00, run_duration=1.69849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:54:00+00:00, data_interval_end=2024-06-28 01:55:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:55:02.151278798Z [2024-06-28T01:55:02.150+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:55:00+00:00, run_after=2024-06-28T01:56:00+00:00 2024-06-28T01:55:02.264533767Z [2024-06-28T01:55:02.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:54:00+00:00 exited with status success for try_number 1 2024-06-28T01:55:02.274265673Z [2024-06-28T01:55:02.273+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:54:00+00:00, map_index=-1, run_start_date=2024-06-28 01:55:01.496506+00:00, run_end_date=2024-06-28 01:55:01.871043+00:00, run_duration=0.374537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=897, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:55:00.531166+00:00, queued_by_job_id=2, pid=13105 2024-06-28T01:55:03.426426590Z [2024-06-28T01:55:03.425+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:55:03.426461985Z 2024-06-28T01:55:03.426614732Z [2024-06-28T01:55:03.426+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:55:03.427705084Z [2024-06-28T01:55:03.427+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:55:03.427737435Z 2024-06-28T01:55:03.431887795Z [2024-06-28T01:55:03.431+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T01:55:03.432397713Z [2024-06-28T01:55:03.431+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:55:03.505555037Z [2024-06-28T01:55:03.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:50:00+00:00 exited with status queued for try_number 1 2024-06-28T01:55:03.505787863Z [2024-06-28T01:55:03.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:50:00+00:00 exited with status success for try_number 1 2024-06-28T01:55:03.515219341Z [2024-06-28T01:55:03.514+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2121b545-0fa5-486d-b24e-4ba2d81a7f83 2024-06-28T01:55:03.515568171Z [2024-06-28T01:55:03.515+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T01:50:00+00:00, map_index=-1, run_start_date=2024-06-28 01:55:02.333775+00:00, run_end_date=2024-06-28 01:55:02.681228+00:00, run_duration=0.347453, state=success, executor_state=success, try_number=1, max_tries=1, job_id=898, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:55:00.531166+00:00, queued_by_job_id=2, pid=13129 2024-06-28T01:55:04.695202865Z [2024-06-28T01:55:04.694+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:55:04.695577978Z [2024-06-28T01:55:04.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:54:00+00:00, run_id=scheduled__2024-06-28T01:54:00+00:00, run_start_date=2024-06-28 01:55:00.437143+00:00, run_end_date=2024-06-28 01:55:04.695242+00:00, run_duration=4.258099, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:54:00+00:00, data_interval_end=2024-06-28 01:55:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:55:04.704591278Z [2024-06-28T01:55:04.704+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:55:00+00:00, run_after=2024-06-28T01:56:00+00:00 2024-06-28T01:55:04.751789050Z [2024-06-28T01:55:04.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:54:00+00:00 exited with status success for try_number 1 2024-06-28T01:55:04.756124379Z [2024-06-28T01:55:04.755+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:54:00+00:00, map_index=-1, run_start_date=2024-06-28 01:55:02.523048+00:00, run_end_date=2024-06-28 01:55:04.018146+00:00, run_duration=1.495098, state=success, executor_state=success, try_number=1, max_tries=1, job_id=900, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:55:00.531166+00:00, queued_by_job_id=2, pid=13131 2024-06-28T01:55:06.060366748Z [2024-06-28T01:55:06.059+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:55:06.061310926Z [2024-06-28T01:55:06.060+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:54:00+00:00, run_id=scheduled__2024-06-28T01:54:00+00:00, run_start_date=2024-06-28 01:55:00.438220+00:00, run_end_date=2024-06-28 01:55:06.060321+00:00, run_duration=5.622101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:54:00+00:00, data_interval_end=2024-06-28 01:55:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:55:06.078408870Z [2024-06-28T01:55:06.078+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:55:00+00:00, run_after=2024-06-28T01:56:00+00:00 2024-06-28T01:55:06.119005784Z [2024-06-28T01:55:06.118+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:55:06.119031459Z 2024-06-28T01:55:06.119148810Z [2024-06-28T01:55:06.118+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:55:06.120046815Z [2024-06-28T01:55:06.119+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:55:06.120057635Z 2024-06-28T01:55:06.123518072Z [2024-06-28T01:55:06.123+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T01:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T01:55:06.123725857Z [2024-06-28T01:55:06.123+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T01:55:06.197945912Z [2024-06-28T01:55:06.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:50:00+00:00 exited with status queued for try_number 1 2024-06-28T01:55:06.197968424Z [2024-06-28T01:55:06.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:54:00+00:00 exited with status success for try_number 1 2024-06-28T01:55:06.219160658Z [2024-06-28T01:55:06.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:50:00+00:00 exited with status success for try_number 1 2024-06-28T01:55:06.230524552Z [2024-06-28T01:55:06.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T01:50:00+00:00, map_index=-1, run_start_date=2024-06-28 01:55:05.376043+00:00, run_end_date=2024-06-28 01:55:05.781395+00:00, run_duration=0.405352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=901, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:55:03.428319+00:00, queued_by_job_id=2, pid=13154 2024-06-28T01:55:06.230900372Z [2024-06-28T01:55:06.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:54:00+00:00, map_index=-1, run_start_date=2024-06-28 01:55:02.488695+00:00, run_end_date=2024-06-28 01:55:05.848128+00:00, run_duration=3.359433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=899, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:55:00.531166+00:00, queued_by_job_id=2, pid=13130 2024-06-28T01:55:06.231099234Z [2024-06-28T01:55:06.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e943c64-1aa0-4aa6-a1a2-52a587ead70a 2024-06-28T01:55:08.492006559Z [2024-06-28T01:55:08.491+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T01:55:08.492065834Z 2024-06-28T01:55:08.492317401Z [2024-06-28T01:55:08.491+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:55:08.493033052Z [2024-06-28T01:55:08.492+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:55:08.493054170Z 2024-06-28T01:55:08.496020203Z [2024-06-28T01:55:08.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:55:08.496168394Z [2024-06-28T01:55:08.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T01:55:08.559136781Z [2024-06-28T01:55:08.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:50:00+00:00 exited with status queued for try_number 1 2024-06-28T01:55:08.559439963Z [2024-06-28T01:55:08.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:50:00+00:00 exited with status success for try_number 1 2024-06-28T01:55:08.584698440Z [2024-06-28T01:55:08.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to 507013de-e0ee-4857-a789-79d30dfa7a7e 2024-06-28T01:55:08.585380448Z [2024-06-28T01:55:08.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T01:50:00+00:00, map_index=0, run_start_date=2024-06-28 01:55:07.834140+00:00, run_end_date=2024-06-28 01:55:08.239056+00:00, run_duration=0.404916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=902, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:55:06.120618+00:00, queued_by_job_id=2, pid=13162 2024-06-28T01:55:10.815530912Z [2024-06-28T01:55:10.814+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:55:10.816171421Z [2024-06-28T01:55:10.815+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:50:00+00:00, run_id=scheduled__2024-06-28T01:50:00+00:00, run_start_date=2024-06-28 01:55:00.434506+00:00, run_end_date=2024-06-28 01:55:10.815317+00:00, run_duration=10.380811, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:50:00+00:00, data_interval_end=2024-06-28 01:55:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T01:55:10.829498815Z [2024-06-28T01:55:10.828+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:55:00+00:00, run_after=2024-06-28T02:00:00+00:00 2024-06-28T01:55:10.870854100Z [2024-06-28T01:55:10.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:50:00+00:00 exited with status success for try_number 1 2024-06-28T01:55:10.877728833Z [2024-06-28T01:55:10.877+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T01:50:00+00:00, map_index=-1, run_start_date=2024-06-28 01:55:10.140108+00:00, run_end_date=2024-06-28 01:55:10.543475+00:00, run_duration=0.403367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=903, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:55:08.493501+00:00, queued_by_job_id=2, pid=13170 2024-06-28T01:56:00.384889922Z [2024-06-28T01:56:00.384+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:56:00+00:00, run_after=2024-06-28T01:57:00+00:00 2024-06-28T01:56:00.423388557Z [2024-06-28T01:56:00.423+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:56:00+00:00, run_after=2024-06-28T01:57:00+00:00 2024-06-28T01:56:00.436683680Z [2024-06-28T01:56:00.436+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:56:00.457610991Z [2024-06-28T01:56:00.457+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:56:00.553161172Z [2024-06-28T01:56:00.552+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:56:00.553183910Z 2024-06-28T01:56:00.553188253Z 2024-06-28T01:56:00.553191625Z 2024-06-28T01:56:00.553194783Z 2024-06-28T01:56:00.553455791Z [2024-06-28T01:56:00.553+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:56:00.553619608Z [2024-06-28T01:56:00.553+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:56:00.553789300Z [2024-06-28T01:56:00.553+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:56:00.553951341Z [2024-06-28T01:56:00.553+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:56:00.554814165Z [2024-06-28T01:56:00.554+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:56:00.554827574Z 2024-06-28T01:56:00.554831402Z 2024-06-28T01:56:00.554834650Z 2024-06-28T01:56:00.554837934Z 2024-06-28T01:56:00.558551483Z [2024-06-28T01:56:00.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:56:00.558958107Z [2024-06-28T01:56:00.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:56:00.559284887Z [2024-06-28T01:56:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:56:00.559548576Z [2024-06-28T01:56:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:56:00.560060790Z [2024-06-28T01:56:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:56:00.560283713Z [2024-06-28T01:56:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:56:00.560586585Z [2024-06-28T01:56:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:56:00.560806557Z [2024-06-28T01:56:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:56:00.991479280Z [2024-06-28T01:56:00.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:54:00+00:00 exited with status queued for try_number 1 2024-06-28T01:56:00.991589278Z [2024-06-28T01:56:00.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:55:00+00:00 exited with status queued for try_number 1 2024-06-28T01:56:00.991731143Z [2024-06-28T01:56:00.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:55:00+00:00 exited with status queued for try_number 1 2024-06-28T01:56:00.991932846Z [2024-06-28T01:56:00.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:55:00+00:00 exited with status queued for try_number 1 2024-06-28T01:56:01.004914866Z [2024-06-28T01:56:01.004+0000] {scheduler_job.py:635} INFO - Setting external_id for to b53f6055-d593-4f22-a91a-f9d5a8de8858 2024-06-28T01:56:01.005101570Z [2024-06-28T01:56:01.004+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2b4ce38-bc53-4642-8dc8-f3fc236b3c73 2024-06-28T01:56:01.005246321Z [2024-06-28T01:56:01.005+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdbe27d9-e857-4c9c-82fa-3cacfb4a03fa 2024-06-28T01:56:01.005394881Z [2024-06-28T01:56:01.005+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9dcb508-f1ad-460f-a060-1bf2157973ef 2024-06-28T01:56:03.303614883Z [2024-06-28T01:56:03.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:56:03.304876648Z [2024-06-28T01:56:03.304+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:54:00+00:00, run_id=scheduled__2024-06-28T01:54:00+00:00, run_start_date=2024-06-28 01:56:00.471741+00:00, run_end_date=2024-06-28 01:56:03.303514+00:00, run_duration=2.831773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:54:00+00:00, data_interval_end=2024-06-28 01:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:56:03.316771458Z [2024-06-28T01:56:03.316+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:56:00+00:00, run_after=2024-06-28T01:58:00+00:00 2024-06-28T01:56:03.331822830Z [2024-06-28T01:56:03.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:56:03.332200374Z [2024-06-28T01:56:03.331+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:55:00+00:00, run_id=scheduled__2024-06-28T01:55:00+00:00, run_start_date=2024-06-28 01:56:00.474209+00:00, run_end_date=2024-06-28 01:56:03.331737+00:00, run_duration=2.857528, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:55:00+00:00, data_interval_end=2024-06-28 01:56:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:56:03.345848157Z [2024-06-28T01:56:03.345+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:56:00+00:00, run_after=2024-06-28T01:57:00+00:00 2024-06-28T01:56:03.405895403Z [2024-06-28T01:56:03.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:54:00+00:00 exited with status success for try_number 1 2024-06-28T01:56:03.406080710Z [2024-06-28T01:56:03.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:55:00+00:00 exited with status success for try_number 1 2024-06-28T01:56:03.419475862Z [2024-06-28T01:56:03.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:55:00+00:00, map_index=-1, run_start_date=2024-06-28 01:56:02.273257+00:00, run_end_date=2024-06-28 01:56:02.977834+00:00, run_duration=0.704577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=905, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:56:00.555901+00:00, queued_by_job_id=2, pid=13195 2024-06-28T01:56:03.420342991Z [2024-06-28T01:56:03.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:54:00+00:00, map_index=-1, run_start_date=2024-06-28 01:56:02.252948+00:00, run_end_date=2024-06-28 01:56:02.990003+00:00, run_duration=0.737055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=904, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:56:00.555901+00:00, queued_by_job_id=2, pid=13194 2024-06-28T01:56:06.311775733Z [2024-06-28T01:56:06.311+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:56:06.311913668Z [2024-06-28T01:56:06.311+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:55:00+00:00, run_id=scheduled__2024-06-28T01:55:00+00:00, run_start_date=2024-06-28 01:56:00.475362+00:00, run_end_date=2024-06-28 01:56:06.311659+00:00, run_duration=5.836297, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:55:00+00:00, data_interval_end=2024-06-28 01:56:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:56:06.330743632Z [2024-06-28T01:56:06.329+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:56:00+00:00, run_after=2024-06-28T01:57:00+00:00 2024-06-28T01:56:06.399463488Z [2024-06-28T01:56:06.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:55:00+00:00 exited with status success for try_number 1 2024-06-28T01:56:06.400982203Z [2024-06-28T01:56:06.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:55:00+00:00 exited with status success for try_number 1 2024-06-28T01:56:06.407982062Z [2024-06-28T01:56:06.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:55:00+00:00, map_index=-1, run_start_date=2024-06-28 01:56:03.373831+00:00, run_end_date=2024-06-28 01:56:06.192228+00:00, run_duration=2.818397, state=success, executor_state=success, try_number=1, max_tries=1, job_id=906, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:56:00.555901+00:00, queued_by_job_id=2, pid=13217 2024-06-28T01:56:06.407998831Z [2024-06-28T01:56:06.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:55:00+00:00, map_index=-1, run_start_date=2024-06-28 01:56:03.573691+00:00, run_end_date=2024-06-28 01:56:05.911769+00:00, run_duration=2.338078, state=success, executor_state=success, try_number=1, max_tries=1, job_id=907, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:56:00.555901+00:00, queued_by_job_id=2, pid=13218 2024-06-28T01:56:07.452653158Z [2024-06-28T01:56:07.452+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:56:07.453149814Z [2024-06-28T01:56:07.452+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:55:00+00:00, run_id=scheduled__2024-06-28T01:55:00+00:00, run_start_date=2024-06-28 01:56:00.476294+00:00, run_end_date=2024-06-28 01:56:07.452571+00:00, run_duration=6.976277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:55:00+00:00, data_interval_end=2024-06-28 01:56:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:56:07.461103558Z [2024-06-28T01:56:07.460+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:56:00+00:00, run_after=2024-06-28T01:57:00+00:00 2024-06-28T01:56:47.014421480Z [2024-06-28T01:56:47.013+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T01:57:00.359538099Z [2024-06-28T01:57:00.358+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:57:00+00:00, run_after=2024-06-28T01:58:00+00:00 2024-06-28T01:57:00.369018157Z [2024-06-28T01:57:00.368+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:57:00.388746898Z [2024-06-28T01:57:00.388+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:57:00+00:00, run_after=2024-06-28T01:58:00+00:00 2024-06-28T01:57:00.512875437Z [2024-06-28T01:57:00.512+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:57:00.512917034Z 2024-06-28T01:57:00.512921143Z 2024-06-28T01:57:00.512924384Z 2024-06-28T01:57:00.513227431Z [2024-06-28T01:57:00.512+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:57:00.513622270Z [2024-06-28T01:57:00.513+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:57:00.513978800Z [2024-06-28T01:57:00.513+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:57:00.515551841Z [2024-06-28T01:57:00.515+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:57:00.515560488Z 2024-06-28T01:57:00.515565507Z 2024-06-28T01:57:00.515570129Z 2024-06-28T01:57:00.523795105Z [2024-06-28T01:57:00.523+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:57:00.524275603Z [2024-06-28T01:57:00.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:57:00.524873674Z [2024-06-28T01:57:00.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:57:00.525125406Z [2024-06-28T01:57:00.524+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:57:00.525615164Z [2024-06-28T01:57:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:57:00.525908185Z [2024-06-28T01:57:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:57:00.810028601Z [2024-06-28T01:57:00.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:56:00+00:00 exited with status queued for try_number 1 2024-06-28T01:57:00.812540134Z [2024-06-28T01:57:00.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:56:00+00:00 exited with status queued for try_number 1 2024-06-28T01:57:00.812779827Z [2024-06-28T01:57:00.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:56:00+00:00 exited with status queued for try_number 1 2024-06-28T01:57:00.820093422Z [2024-06-28T01:57:00.819+0000] {scheduler_job.py:635} INFO - Setting external_id for to df24e7e1-1d2c-4f1d-827a-729c84c4f85d 2024-06-28T01:57:00.820380909Z [2024-06-28T01:57:00.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to e09fed26-1189-42ca-a6a1-a2d665837288 2024-06-28T01:57:00.821657372Z [2024-06-28T01:57:00.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03114e56-0507-4388-8d73-bbd24382ee0e 2024-06-28T01:57:02.007007314Z [2024-06-28T01:57:02.006+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:57:02.007631506Z [2024-06-28T01:57:02.007+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:56:00+00:00, run_id=scheduled__2024-06-28T01:56:00+00:00, run_start_date=2024-06-28 01:57:00.409984+00:00, run_end_date=2024-06-28 01:57:02.006897+00:00, run_duration=1.596913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:56:00+00:00, data_interval_end=2024-06-28 01:57:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:57:02.017360367Z [2024-06-28T01:57:02.017+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:57:00+00:00, run_after=2024-06-28T01:58:00+00:00 2024-06-28T01:57:02.074250848Z [2024-06-28T01:57:02.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:56:00+00:00 exited with status success for try_number 1 2024-06-28T01:57:02.080738659Z [2024-06-28T01:57:02.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:56:00+00:00, map_index=-1, run_start_date=2024-06-28 01:57:01.444274+00:00, run_end_date=2024-06-28 01:57:01.859094+00:00, run_duration=0.41482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=908, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:57:00.518136+00:00, queued_by_job_id=2, pid=13250 2024-06-28T01:57:04.341443237Z [2024-06-28T01:57:04.341+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:57:04.341639090Z [2024-06-28T01:57:04.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:56:00+00:00, run_id=scheduled__2024-06-28T01:56:00+00:00, run_start_date=2024-06-28 01:57:00.413169+00:00, run_end_date=2024-06-28 01:57:04.341354+00:00, run_duration=3.928185, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:56:00+00:00, data_interval_end=2024-06-28 01:57:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:57:04.361486131Z [2024-06-28T01:57:04.361+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:57:00+00:00, run_after=2024-06-28T01:58:00+00:00 2024-06-28T01:57:04.416444259Z [2024-06-28T01:57:04.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:56:00+00:00 exited with status success for try_number 1 2024-06-28T01:57:04.423360957Z [2024-06-28T01:57:04.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:56:00+00:00, map_index=-1, run_start_date=2024-06-28 01:57:02.356638+00:00, run_end_date=2024-06-28 01:57:04.154284+00:00, run_duration=1.797646, state=success, executor_state=success, try_number=1, max_tries=1, job_id=909, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:57:00.518136+00:00, queued_by_job_id=2, pid=13263 2024-06-28T01:57:05.529113356Z [2024-06-28T01:57:05.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:57:05.529139404Z [2024-06-28T01:57:05.527+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:56:00+00:00, run_id=scheduled__2024-06-28T01:56:00+00:00, run_start_date=2024-06-28 01:57:00.415856+00:00, run_end_date=2024-06-28 01:57:05.527300+00:00, run_duration=5.111444, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:56:00+00:00, data_interval_end=2024-06-28 01:57:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:57:05.538515660Z [2024-06-28T01:57:05.536+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:57:00+00:00, run_after=2024-06-28T01:58:00+00:00 2024-06-28T01:57:05.623675874Z [2024-06-28T01:57:05.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:56:00+00:00 exited with status success for try_number 1 2024-06-28T01:57:05.630457862Z [2024-06-28T01:57:05.630+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:56:00+00:00, map_index=-1, run_start_date=2024-06-28 01:57:02.640714+00:00, run_end_date=2024-06-28 01:57:05.087325+00:00, run_duration=2.446611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=910, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:57:00.518136+00:00, queued_by_job_id=2, pid=13269 2024-06-28T01:58:00.177754633Z [2024-06-28T01:58:00.177+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:58:00+00:00, run_after=2024-06-28T01:59:00+00:00 2024-06-28T01:58:00.189395048Z [2024-06-28T01:58:00.188+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:58:00.201089940Z [2024-06-28T01:58:00.200+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:58:00.216051157Z [2024-06-28T01:58:00.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:58:00+00:00, run_after=2024-06-28T01:59:00+00:00 2024-06-28T01:58:00.318381695Z [2024-06-28T01:58:00.317+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T01:58:00.318424260Z 2024-06-28T01:58:00.318435221Z 2024-06-28T01:58:00.318443731Z 2024-06-28T01:58:00.318452790Z 2024-06-28T01:58:00.318604433Z [2024-06-28T01:58:00.318+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T01:58:00.318876984Z [2024-06-28T01:58:00.318+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:58:00.319044271Z [2024-06-28T01:58:00.318+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:58:00.319246032Z [2024-06-28T01:58:00.319+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:58:00.320856056Z [2024-06-28T01:58:00.320+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:58:00.320888552Z 2024-06-28T01:58:00.320897019Z 2024-06-28T01:58:00.320904306Z 2024-06-28T01:58:00.320911468Z 2024-06-28T01:58:00.328248958Z [2024-06-28T01:58:00.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:58:00.328305532Z [2024-06-28T01:58:00.328+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T01:58:00.328691472Z [2024-06-28T01:58:00.328+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:58:00.328828308Z [2024-06-28T01:58:00.328+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:58:00.329033794Z [2024-06-28T01:58:00.328+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:58:00.329288989Z [2024-06-28T01:58:00.328+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:58:00.329655797Z [2024-06-28T01:58:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:58:00.329844007Z [2024-06-28T01:58:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:58:00.675106918Z [2024-06-28T01:58:00.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:56:00+00:00 exited with status queued for try_number 1 2024-06-28T01:58:00.675171932Z [2024-06-28T01:58:00.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:57:00+00:00 exited with status queued for try_number 1 2024-06-28T01:58:00.675285541Z [2024-06-28T01:58:00.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:57:00+00:00 exited with status queued for try_number 1 2024-06-28T01:58:00.675417811Z [2024-06-28T01:58:00.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:57:00+00:00 exited with status queued for try_number 1 2024-06-28T01:58:00.685421231Z [2024-06-28T01:58:00.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4b77fec-eb62-422b-9889-b0da114d682f 2024-06-28T01:58:00.685549973Z [2024-06-28T01:58:00.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to c064ce23-9efe-49d3-b378-431e545a00e6 2024-06-28T01:58:00.685720161Z [2024-06-28T01:58:00.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7782061-4649-4167-8766-ebba16c47acd 2024-06-28T01:58:00.685870919Z [2024-06-28T01:58:00.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2005f3f2-d622-4fdb-a157-ead9a215f8a8 2024-06-28T01:58:01.898878795Z [2024-06-28T01:58:01.898+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:58:01.899344934Z [2024-06-28T01:58:01.899+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:56:00+00:00, run_id=scheduled__2024-06-28T01:56:00+00:00, run_start_date=2024-06-28 01:58:00.226485+00:00, run_end_date=2024-06-28 01:58:01.898734+00:00, run_duration=1.672249, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:56:00+00:00, data_interval_end=2024-06-28 01:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T01:58:01.913690838Z [2024-06-28T01:58:01.913+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T01:58:00+00:00, run_after=2024-06-28T02:00:00+00:00 2024-06-28T01:58:01.926445214Z [2024-06-28T01:58:01.926+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:58:01.927246315Z [2024-06-28T01:58:01.926+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:57:00+00:00, run_id=scheduled__2024-06-28T01:57:00+00:00, run_start_date=2024-06-28 01:58:00.227896+00:00, run_end_date=2024-06-28 01:58:01.926804+00:00, run_duration=1.698908, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:57:00+00:00, data_interval_end=2024-06-28 01:58:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:58:01.945777496Z [2024-06-28T01:58:01.945+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:58:00+00:00, run_after=2024-06-28T01:59:00+00:00 2024-06-28T01:58:02.014352063Z [2024-06-28T01:58:02.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:56:00+00:00 exited with status success for try_number 1 2024-06-28T01:58:02.014643060Z [2024-06-28T01:58:02.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:57:00+00:00 exited with status success for try_number 1 2024-06-28T01:58:02.022563469Z [2024-06-28T01:58:02.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:56:00+00:00, map_index=-1, run_start_date=2024-06-28 01:58:01.128303+00:00, run_end_date=2024-06-28 01:58:01.447219+00:00, run_duration=0.318916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=911, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:58:00.322541+00:00, queued_by_job_id=2, pid=13302 2024-06-28T01:58:02.023045516Z [2024-06-28T01:58:02.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:57:00+00:00, map_index=-1, run_start_date=2024-06-28 01:58:01.349057+00:00, run_end_date=2024-06-28 01:58:01.757091+00:00, run_duration=0.408034, state=success, executor_state=success, try_number=1, max_tries=1, job_id=912, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:58:00.322541+00:00, queued_by_job_id=2, pid=13303 2024-06-28T01:58:03.578983831Z [2024-06-28T01:58:03.578+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:58:03.579108827Z [2024-06-28T01:58:03.578+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:57:00+00:00, run_id=scheduled__2024-06-28T01:57:00+00:00, run_start_date=2024-06-28 01:58:00.228973+00:00, run_end_date=2024-06-28 01:58:03.578883+00:00, run_duration=3.34991, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:57:00+00:00, data_interval_end=2024-06-28 01:58:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:58:03.596265496Z [2024-06-28T01:58:03.595+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:58:00+00:00, run_after=2024-06-28T01:59:00+00:00 2024-06-28T01:58:04.708318360Z [2024-06-28T01:58:04.707+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:58:04.708452316Z [2024-06-28T01:58:04.708+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:57:00+00:00, run_id=scheduled__2024-06-28T01:57:00+00:00, run_start_date=2024-06-28 01:58:00.230064+00:00, run_end_date=2024-06-28 01:58:04.708226+00:00, run_duration=4.478162, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:57:00+00:00, data_interval_end=2024-06-28 01:58:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:58:04.717526546Z [2024-06-28T01:58:04.717+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:58:00+00:00, run_after=2024-06-28T01:59:00+00:00 2024-06-28T01:58:04.762408828Z [2024-06-28T01:58:04.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:57:00+00:00 exited with status success for try_number 1 2024-06-28T01:58:04.762448980Z [2024-06-28T01:58:04.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:57:00+00:00 exited with status success for try_number 1 2024-06-28T01:58:04.775109937Z [2024-06-28T01:58:04.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:57:00+00:00, map_index=-1, run_start_date=2024-06-28 01:58:02.276243+00:00, run_end_date=2024-06-28 01:58:03.534542+00:00, run_duration=1.258299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=913, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:58:00.322541+00:00, queued_by_job_id=2, pid=13326 2024-06-28T01:58:04.775197372Z [2024-06-28T01:58:04.775+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:57:00+00:00, map_index=-1, run_start_date=2024-06-28 01:58:02.413787+00:00, run_end_date=2024-06-28 01:58:04.350170+00:00, run_duration=1.936383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=914, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:58:00.322541+00:00, queued_by_job_id=2, pid=13327 2024-06-28T01:59:00.224445722Z [2024-06-28T01:59:00.224+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:59:00+00:00, run_after=2024-06-28T02:00:00+00:00 2024-06-28T01:59:00.231547606Z [2024-06-28T01:59:00.231+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T01:59:00.246932396Z [2024-06-28T01:59:00.246+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:59:00+00:00, run_after=2024-06-28T02:00:00+00:00 2024-06-28T01:59:00.312923029Z [2024-06-28T01:59:00.312+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T01:59:00.312977414Z 2024-06-28T01:59:00.312984796Z 2024-06-28T01:59:00.313001495Z 2024-06-28T01:59:00.313030052Z [2024-06-28T01:59:00.312+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T01:59:00.313315724Z [2024-06-28T01:59:00.313+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:59:00.313622266Z [2024-06-28T01:59:00.313+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T01:59:00.314399912Z [2024-06-28T01:59:00.314+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T01:59:00.314414436Z 2024-06-28T01:59:00.314419876Z 2024-06-28T01:59:00.314425416Z 2024-06-28T01:59:00.317664990Z [2024-06-28T01:59:00.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:59:00.317729613Z [2024-06-28T01:59:00.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T01:59:00.318052830Z [2024-06-28T01:59:00.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:59:00.318194889Z [2024-06-28T01:59:00.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T01:59:00.318485156Z [2024-06-28T01:59:00.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T01:59:00.318621867Z [2024-06-28T01:59:00.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T01:59:00.655648754Z [2024-06-28T01:59:00.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:58:00+00:00 exited with status queued for try_number 1 2024-06-28T01:59:00.655825475Z [2024-06-28T01:59:00.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:58:00+00:00 exited with status queued for try_number 1 2024-06-28T01:59:00.656034174Z [2024-06-28T01:59:00.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:58:00+00:00 exited with status queued for try_number 1 2024-06-28T01:59:00.663135042Z [2024-06-28T01:59:00.662+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0516f07-b4e0-4339-ba05-44aa02bb20e9 2024-06-28T01:59:00.663500683Z [2024-06-28T01:59:00.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3dde4164-829e-408c-9565-2c616682a180 2024-06-28T01:59:00.663699696Z [2024-06-28T01:59:00.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to da1371ea-8a0d-4e4a-907d-8eb450b32a33 2024-06-28T01:59:01.707748157Z [2024-06-28T01:59:01.707+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:59:01.708265933Z [2024-06-28T01:59:01.708+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:58:00+00:00, run_id=scheduled__2024-06-28T01:58:00+00:00, run_start_date=2024-06-28 01:59:00.257124+00:00, run_end_date=2024-06-28 01:59:01.707897+00:00, run_duration=1.450773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:58:00+00:00, data_interval_end=2024-06-28 01:59:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T01:59:01.720102618Z [2024-06-28T01:59:01.719+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T01:59:00+00:00, run_after=2024-06-28T02:00:00+00:00 2024-06-28T01:59:01.791713383Z [2024-06-28T01:59:01.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:58:00+00:00 exited with status success for try_number 1 2024-06-28T01:59:01.798222169Z [2024-06-28T01:59:01.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:58:00+00:00, map_index=-1, run_start_date=2024-06-28 01:59:01.118184+00:00, run_end_date=2024-06-28 01:59:01.558652+00:00, run_duration=0.440468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=915, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:59:00.315158+00:00, queued_by_job_id=2, pid=13359 2024-06-28T01:59:03.984054644Z [2024-06-28T01:59:03.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:59:03.984595927Z [2024-06-28T01:59:03.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:58:00+00:00, run_id=scheduled__2024-06-28T01:58:00+00:00, run_start_date=2024-06-28 01:59:00.259451+00:00, run_end_date=2024-06-28 01:59:03.983867+00:00, run_duration=3.724416, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:58:00+00:00, data_interval_end=2024-06-28 01:59:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T01:59:04.000769916Z [2024-06-28T01:59:04.000+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:59:00+00:00, run_after=2024-06-28T02:00:00+00:00 2024-06-28T01:59:04.061312517Z [2024-06-28T01:59:04.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:58:00+00:00 exited with status success for try_number 1 2024-06-28T01:59:04.067877582Z [2024-06-28T01:59:04.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:58:00+00:00, map_index=-1, run_start_date=2024-06-28 01:59:02.157912+00:00, run_end_date=2024-06-28 01:59:03.558674+00:00, run_duration=1.400762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=917, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:59:00.315158+00:00, queued_by_job_id=2, pid=13378 2024-06-28T01:59:06.238628147Z [2024-06-28T01:59:06.238+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T01:59:06.239066648Z [2024-06-28T01:59:06.238+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:58:00+00:00, run_id=scheduled__2024-06-28T01:58:00+00:00, run_start_date=2024-06-28 01:59:00.260768+00:00, run_end_date=2024-06-28 01:59:06.238529+00:00, run_duration=5.977761, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:58:00+00:00, data_interval_end=2024-06-28 01:59:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T01:59:06.252556551Z [2024-06-28T01:59:06.252+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T01:59:00+00:00, run_after=2024-06-28T02:00:00+00:00 2024-06-28T01:59:06.315654819Z [2024-06-28T01:59:06.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:58:00+00:00 exited with status success for try_number 1 2024-06-28T01:59:06.323620589Z [2024-06-28T01:59:06.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:58:00+00:00, map_index=-1, run_start_date=2024-06-28 01:59:02.080470+00:00, run_end_date=2024-06-28 01:59:05.511867+00:00, run_duration=3.431397, state=success, executor_state=success, try_number=1, max_tries=1, job_id=916, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 01:59:00.315158+00:00, queued_by_job_id=2, pid=13377 2024-06-28T02:00:00.277342087Z [2024-06-28T02:00:00.276+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:00:00.299788476Z [2024-06-28T02:00:00.299+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:00:00+00:00, run_after=2024-06-28T02:05:00+00:00 2024-06-28T02:00:00.326589496Z [2024-06-28T02:00:00.326+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:00:00+00:00, run_after=2024-06-28T02:01:00+00:00 2024-06-28T02:00:00.335827205Z [2024-06-28T02:00:00.335+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:00:00.349582054Z [2024-06-28T02:00:00.349+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:00:00+00:00, run_after=2024-06-28T02:01:00+00:00 2024-06-28T02:00:00.463454743Z [2024-06-28T02:00:00.462+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-28T02:00:00.463500648Z 2024-06-28T02:00:00.463510536Z 2024-06-28T02:00:00.463527522Z 2024-06-28T02:00:00.463536931Z 2024-06-28T02:00:00.463545761Z 2024-06-28T02:00:00.463554729Z [2024-06-28T02:00:00.463+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:00:00.463579790Z [2024-06-28T02:00:00.463+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:00:00.463777455Z [2024-06-28T02:00:00.463+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:00:00.464059387Z [2024-06-28T02:00:00.463+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:00:00.464265998Z [2024-06-28T02:00:00.464+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:00:00.465077986Z [2024-06-28T02:00:00.464+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:00:00.465093218Z 2024-06-28T02:00:00.465098051Z 2024-06-28T02:00:00.465102921Z 2024-06-28T02:00:00.465106929Z 2024-06-28T02:00:00.465111021Z 2024-06-28T02:00:00.471317762Z [2024-06-28T02:00:00.471+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T02:00:00.471543445Z [2024-06-28T02:00:00.471+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:00:00.471837948Z [2024-06-28T02:00:00.471+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:00:00.472020713Z [2024-06-28T02:00:00.471+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:00:00.472301625Z [2024-06-28T02:00:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:00:00.472457841Z [2024-06-28T02:00:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:00:00.472731101Z [2024-06-28T02:00:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:00:00.472894811Z [2024-06-28T02:00:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:00:00.473174646Z [2024-06-28T02:00:00.473+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:00:00.473334870Z [2024-06-28T02:00:00.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:00:01.172166774Z [2024-06-28T02:00:01.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:55:00+00:00 exited with status queued for try_number 1 2024-06-28T02:00:01.172387383Z [2024-06-28T02:00:01.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:58:00+00:00 exited with status queued for try_number 1 2024-06-28T02:00:01.172537611Z [2024-06-28T02:00:01.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:59:00+00:00 exited with status queued for try_number 1 2024-06-28T02:00:01.172673245Z [2024-06-28T02:00:01.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:59:00+00:00 exited with status queued for try_number 1 2024-06-28T02:00:01.172801646Z [2024-06-28T02:00:01.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:59:00+00:00 exited with status queued for try_number 1 2024-06-28T02:00:01.192729624Z [2024-06-28T02:00:01.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d0ca656-88a9-4020-919b-a0dd33ee5b52 2024-06-28T02:00:01.192986219Z [2024-06-28T02:00:01.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87a250d2-633e-4172-8623-ef06aefed31d 2024-06-28T02:00:01.193237876Z [2024-06-28T02:00:01.193+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e314fd0-1c47-434e-827d-058954196989 2024-06-28T02:00:01.193504544Z [2024-06-28T02:00:01.193+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b2b800f-5e61-43f5-8674-c4d37e96a07d 2024-06-28T02:00:01.193722090Z [2024-06-28T02:00:01.193+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8350a6a5-e998-4bea-a848-c8ef87fffcba 2024-06-28T02:00:02.520307284Z [2024-06-28T02:00:02.519+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:00:02.520775773Z [2024-06-28T02:00:02.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 01:58:00+00:00, run_id=scheduled__2024-06-28T01:58:00+00:00, run_start_date=2024-06-28 02:00:00.363798+00:00, run_end_date=2024-06-28 02:00:02.520230+00:00, run_duration=2.156432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:58:00+00:00, data_interval_end=2024-06-28 02:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:00:02.528359296Z [2024-06-28T02:00:02.528+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:00:00+00:00, run_after=2024-06-28T02:02:00+00:00 2024-06-28T02:00:02.535653791Z [2024-06-28T02:00:02.535+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:00:02.536073481Z [2024-06-28T02:00:02.535+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 01:59:00+00:00, run_id=scheduled__2024-06-28T01:59:00+00:00, run_start_date=2024-06-28 02:00:00.365244+00:00, run_end_date=2024-06-28 02:00:02.535591+00:00, run_duration=2.170347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:59:00+00:00, data_interval_end=2024-06-28 02:00:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:00:02.546206554Z [2024-06-28T02:00:02.545+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:00:00+00:00, run_after=2024-06-28T02:01:00+00:00 2024-06-28T02:00:02.656627955Z [2024-06-28T02:00:02.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T01:58:00+00:00 exited with status success for try_number 1 2024-06-28T02:00:02.656722983Z [2024-06-28T02:00:02.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:59:00+00:00 exited with status success for try_number 1 2024-06-28T02:00:02.669008086Z [2024-06-28T02:00:02.668+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T01:58:00+00:00, map_index=-1, run_start_date=2024-06-28 02:00:01.483944+00:00, run_end_date=2024-06-28 02:00:01.914417+00:00, run_duration=0.430473, state=success, executor_state=success, try_number=1, max_tries=1, job_id=918, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:00:00.466860+00:00, queued_by_job_id=2, pid=13412 2024-06-28T02:00:02.669080377Z [2024-06-28T02:00:02.668+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:59:00+00:00, map_index=-1, run_start_date=2024-06-28 02:00:01.532047+00:00, run_end_date=2024-06-28 02:00:01.951943+00:00, run_duration=0.419896, state=success, executor_state=success, try_number=1, max_tries=1, job_id=919, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:00:00.466860+00:00, queued_by_job_id=2, pid=13413 2024-06-28T02:00:03.382937084Z [2024-06-28T02:00:03.382+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:00:03.382969197Z 2024-06-28T02:00:03.383311134Z [2024-06-28T02:00:03.382+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:00:03.384385084Z [2024-06-28T02:00:03.384+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:00:03.384415493Z 2024-06-28T02:00:03.387679276Z [2024-06-28T02:00:03.387+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T02:00:03.387813883Z [2024-06-28T02:00:03.387+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:00:03.440916048Z [2024-06-28T02:00:03.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:55:00+00:00 exited with status queued for try_number 1 2024-06-28T02:00:03.440963982Z [2024-06-28T02:00:03.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T01:55:00+00:00 exited with status success for try_number 1 2024-06-28T02:00:03.447980146Z [2024-06-28T02:00:03.447+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18aa292e-1049-473e-adb4-aa39d9317f54 2024-06-28T02:00:03.448160855Z [2024-06-28T02:00:03.447+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T01:55:00+00:00, map_index=-1, run_start_date=2024-06-28 02:00:02.771353+00:00, run_end_date=2024-06-28 02:00:03.149683+00:00, run_duration=0.37833, state=success, executor_state=success, try_number=1, max_tries=1, job_id=921, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:00:00.466860+00:00, queued_by_job_id=2, pid=13443 2024-06-28T02:00:04.684210477Z [2024-06-28T02:00:04.683+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:00:04.685178823Z [2024-06-28T02:00:04.684+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:59:00+00:00, run_id=scheduled__2024-06-28T01:59:00+00:00, run_start_date=2024-06-28 02:00:00.367696+00:00, run_end_date=2024-06-28 02:00:04.684126+00:00, run_duration=4.31643, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:59:00+00:00, data_interval_end=2024-06-28 02:00:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:00:04.699663400Z [2024-06-28T02:00:04.699+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:00:00+00:00, run_after=2024-06-28T02:01:00+00:00 2024-06-28T02:00:04.707021376Z [2024-06-28T02:00:04.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:00:04.707264607Z [2024-06-28T02:00:04.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:59:00+00:00, run_id=scheduled__2024-06-28T01:59:00+00:00, run_start_date=2024-06-28 02:00:00.366462+00:00, run_end_date=2024-06-28 02:00:04.706981+00:00, run_duration=4.340519, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:59:00+00:00, data_interval_end=2024-06-28 02:00:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:00:04.719147812Z [2024-06-28T02:00:04.718+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:00:00+00:00, run_after=2024-06-28T02:01:00+00:00 2024-06-28T02:00:04.793557877Z [2024-06-28T02:00:04.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:59:00+00:00 exited with status success for try_number 1 2024-06-28T02:00:04.793581781Z [2024-06-28T02:00:04.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T01:59:00+00:00 exited with status success for try_number 1 2024-06-28T02:00:04.802405960Z [2024-06-28T02:00:04.801+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:59:00+00:00, map_index=-1, run_start_date=2024-06-28 02:00:02.723240+00:00, run_end_date=2024-06-28 02:00:03.990472+00:00, run_duration=1.267232, state=success, executor_state=success, try_number=1, max_tries=1, job_id=920, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:00:00.466860+00:00, queued_by_job_id=2, pid=13442 2024-06-28T02:00:04.802910015Z [2024-06-28T02:00:04.802+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T01:59:00+00:00, map_index=-1, run_start_date=2024-06-28 02:00:02.860088+00:00, run_end_date=2024-06-28 02:00:04.545105+00:00, run_duration=1.685017, state=success, executor_state=success, try_number=1, max_tries=1, job_id=922, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:00:00.466860+00:00, queued_by_job_id=2, pid=13444 2024-06-28T02:00:05.866079954Z [2024-06-28T02:00:05.865+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:00:05.866105125Z 2024-06-28T02:00:05.866476098Z [2024-06-28T02:00:05.866+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:00:05.867916984Z [2024-06-28T02:00:05.867+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:00:05.867931717Z 2024-06-28T02:00:05.873038803Z [2024-06-28T02:00:05.872+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T01:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T02:00:05.873429497Z [2024-06-28T02:00:05.873+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T02:00:05.958284393Z [2024-06-28T02:00:05.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:55:00+00:00 exited with status queued for try_number 1 2024-06-28T02:00:05.961142942Z [2024-06-28T02:00:05.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T01:55:00+00:00 exited with status success for try_number 1 2024-06-28T02:00:05.969183651Z [2024-06-28T02:00:05.968+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1564e8a-76b9-48c5-a253-6076a69bdad9 2024-06-28T02:00:05.969417653Z [2024-06-28T02:00:05.969+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T01:55:00+00:00, map_index=-1, run_start_date=2024-06-28 02:00:05.200591+00:00, run_end_date=2024-06-28 02:00:05.493074+00:00, run_duration=0.292483, state=success, executor_state=success, try_number=1, max_tries=1, job_id=923, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:00:03.384844+00:00, queued_by_job_id=2, pid=13467 2024-06-28T02:00:09.061120215Z [2024-06-28T02:00:09.060+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:00:09.061147482Z 2024-06-28T02:00:09.061151239Z [2024-06-28T02:00:09.060+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:00:09.061621190Z [2024-06-28T02:00:09.061+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:00:09.061630773Z 2024-06-28T02:00:09.063697617Z [2024-06-28T02:00:09.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:00:09.063720033Z [2024-06-28T02:00:09.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:00:09.131073998Z [2024-06-28T02:00:09.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:55:00+00:00 exited with status queued for try_number 1 2024-06-28T02:00:09.133648415Z [2024-06-28T02:00:09.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T01:55:00+00:00 exited with status success for try_number 1 2024-06-28T02:00:09.143555885Z [2024-06-28T02:00:09.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22704ccb-a69d-4cda-8500-1ad5767b5f37 2024-06-28T02:00:09.143837357Z [2024-06-28T02:00:09.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T01:55:00+00:00, map_index=0, run_start_date=2024-06-28 02:00:07.569553+00:00, run_end_date=2024-06-28 02:00:07.952649+00:00, run_duration=0.383096, state=success, executor_state=success, try_number=1, max_tries=1, job_id=924, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:00:05.868749+00:00, queued_by_job_id=2, pid=13475 2024-06-28T02:00:11.440920234Z [2024-06-28T02:00:11.440+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:00:11.441234934Z [2024-06-28T02:00:11.440+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 01:55:00+00:00, run_id=scheduled__2024-06-28T01:55:00+00:00, run_start_date=2024-06-28 02:00:00.362037+00:00, run_end_date=2024-06-28 02:00:11.440797+00:00, run_duration=11.07876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 01:55:00+00:00, data_interval_end=2024-06-28 02:00:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T02:00:11.449279607Z [2024-06-28T02:00:11.448+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:00:00+00:00, run_after=2024-06-28T02:05:00+00:00 2024-06-28T02:00:11.486553484Z [2024-06-28T02:00:11.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T01:55:00+00:00 exited with status success for try_number 1 2024-06-28T02:00:11.492637311Z [2024-06-28T02:00:11.492+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T01:55:00+00:00, map_index=-1, run_start_date=2024-06-28 02:00:10.661741+00:00, run_end_date=2024-06-28 02:00:11.012825+00:00, run_duration=0.351084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=925, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:00:09.061865+00:00, queued_by_job_id=2, pid=13483 2024-06-28T02:01:00.946672839Z [2024-06-28T02:01:00.946+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:01:00.960987581Z [2024-06-28T02:01:00.960+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:01:00+00:00, run_after=2024-06-28T02:02:00+00:00 2024-06-28T02:01:00.975174200Z [2024-06-28T02:01:00.974+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:01:00+00:00, run_after=2024-06-28T02:02:00+00:00 2024-06-28T02:01:01.067693876Z [2024-06-28T02:01:01.067+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:01:01.067745285Z 2024-06-28T02:01:01.067753985Z 2024-06-28T02:01:01.067760421Z 2024-06-28T02:01:01.067994606Z [2024-06-28T02:01:01.067+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:01:01.068406162Z [2024-06-28T02:01:01.068+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:01:01.069032954Z [2024-06-28T02:01:01.068+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:01:01.070139466Z [2024-06-28T02:01:01.069+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:01:01.070182201Z 2024-06-28T02:01:01.070189486Z 2024-06-28T02:01:01.070195124Z 2024-06-28T02:01:01.075180099Z [2024-06-28T02:01:01.074+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:01:01.075708912Z [2024-06-28T02:01:01.075+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:01:01.076304613Z [2024-06-28T02:01:01.075+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:01:01.076654230Z [2024-06-28T02:01:01.076+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:01:01.077186027Z [2024-06-28T02:01:01.076+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:01:01.077555578Z [2024-06-28T02:01:01.077+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:01:01.325227727Z [2024-06-28T02:01:01.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:00:00+00:00 exited with status queued for try_number 1 2024-06-28T02:01:01.325425010Z [2024-06-28T02:01:01.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:00:00+00:00 exited with status queued for try_number 1 2024-06-28T02:01:01.325660892Z [2024-06-28T02:01:01.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:00:00+00:00 exited with status queued for try_number 1 2024-06-28T02:01:01.334118952Z [2024-06-28T02:01:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2decc7d0-3099-4cd0-b562-60b310c8d661 2024-06-28T02:01:01.334365801Z [2024-06-28T02:01:01.334+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73b2f1e1-6b51-4cfb-b741-fe68ada93aec 2024-06-28T02:01:01.334580845Z [2024-06-28T02:01:01.334+0000] {scheduler_job.py:635} INFO - Setting external_id for to a195a0cc-5557-4fc0-885c-19bca1947ca0 2024-06-28T02:01:02.518857457Z [2024-06-28T02:01:02.518+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:01:02.523325018Z [2024-06-28T02:01:02.522+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:00:00+00:00, run_id=scheduled__2024-06-28T02:00:00+00:00, run_start_date=2024-06-28 02:01:00.992723+00:00, run_end_date=2024-06-28 02:01:02.522833+00:00, run_duration=1.53011, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:00:00+00:00, data_interval_end=2024-06-28 02:01:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:01:02.536778786Z [2024-06-28T02:01:02.536+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:01:00+00:00, run_after=2024-06-28T02:02:00+00:00 2024-06-28T02:01:02.637049320Z [2024-06-28T02:01:02.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:00:00+00:00 exited with status success for try_number 1 2024-06-28T02:01:02.642152559Z [2024-06-28T02:01:02.641+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:00:00+00:00, map_index=-1, run_start_date=2024-06-28 02:01:01.849749+00:00, run_end_date=2024-06-28 02:01:02.272989+00:00, run_duration=0.42324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=926, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:01:01.071326+00:00, queued_by_job_id=2, pid=13504 2024-06-28T02:01:05.212651871Z [2024-06-28T02:01:05.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:01:05.213043245Z [2024-06-28T02:01:05.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:00:00+00:00, run_id=scheduled__2024-06-28T02:00:00+00:00, run_start_date=2024-06-28 02:01:00.994584+00:00, run_end_date=2024-06-28 02:01:05.212525+00:00, run_duration=4.217941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:00:00+00:00, data_interval_end=2024-06-28 02:01:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:01:05.233371155Z [2024-06-28T02:01:05.233+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:01:00+00:00, run_after=2024-06-28T02:02:00+00:00 2024-06-28T02:01:05.306113981Z [2024-06-28T02:01:05.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:00:00+00:00 exited with status success for try_number 1 2024-06-28T02:01:05.314452824Z [2024-06-28T02:01:05.314+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:00:00+00:00, map_index=-1, run_start_date=2024-06-28 02:01:02.812167+00:00, run_end_date=2024-06-28 02:01:04.430378+00:00, run_duration=1.618211, state=success, executor_state=success, try_number=1, max_tries=1, job_id=927, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:01:01.071326+00:00, queued_by_job_id=2, pid=13517 2024-06-28T02:01:06.380187437Z [2024-06-28T02:01:06.379+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:01:06.380338442Z [2024-06-28T02:01:06.380+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:00:00+00:00, run_id=scheduled__2024-06-28T02:00:00+00:00, run_start_date=2024-06-28 02:01:00.996777+00:00, run_end_date=2024-06-28 02:01:06.380052+00:00, run_duration=5.383275, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:00:00+00:00, data_interval_end=2024-06-28 02:01:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:01:06.404093001Z [2024-06-28T02:01:06.403+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:01:00+00:00, run_after=2024-06-28T02:02:00+00:00 2024-06-28T02:01:06.507049590Z [2024-06-28T02:01:06.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:00:00+00:00 exited with status success for try_number 1 2024-06-28T02:01:06.522868440Z [2024-06-28T02:01:06.519+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:00:00+00:00, map_index=-1, run_start_date=2024-06-28 02:01:03.106102+00:00, run_end_date=2024-06-28 02:01:05.343738+00:00, run_duration=2.237636, state=success, executor_state=success, try_number=1, max_tries=1, job_id=928, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:01:01.071326+00:00, queued_by_job_id=2, pid=13523 2024-06-28T02:01:47.104004024Z [2024-06-28T02:01:47.103+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T02:02:00.974178888Z [2024-06-28T02:02:00.973+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:02:00+00:00, run_after=2024-06-28T02:03:00+00:00 2024-06-28T02:02:00.982623366Z [2024-06-28T02:02:00.982+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:02:00.991557976Z [2024-06-28T02:02:00.991+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:02:01.007318485Z [2024-06-28T02:02:01.006+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:02:00+00:00, run_after=2024-06-28T02:03:00+00:00 2024-06-28T02:02:01.094574178Z [2024-06-28T02:02:01.094+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:02:01.094766630Z 2024-06-28T02:02:01.094781480Z 2024-06-28T02:02:01.094790375Z 2024-06-28T02:02:01.094798895Z 2024-06-28T02:02:01.094855712Z [2024-06-28T02:02:01.094+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:02:01.094866038Z [2024-06-28T02:02:01.094+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:02:01.094874658Z [2024-06-28T02:02:01.094+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:02:01.094891674Z [2024-06-28T02:02:01.094+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:02:01.096699354Z [2024-06-28T02:02:01.095+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:02:01.096722478Z 2024-06-28T02:02:01.096880251Z 2024-06-28T02:02:01.096896038Z 2024-06-28T02:02:01.096949028Z 2024-06-28T02:02:01.099682864Z [2024-06-28T02:02:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:02:01.099749653Z [2024-06-28T02:02:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:02:01.099903958Z [2024-06-28T02:02:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:02:01.099988814Z [2024-06-28T02:02:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:02:01.100298925Z [2024-06-28T02:02:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:02:01.100316658Z [2024-06-28T02:02:01.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:02:01.100389908Z [2024-06-28T02:02:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:02:01.100577349Z [2024-06-28T02:02:01.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:02:01.656074225Z [2024-06-28T02:02:01.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:00:00+00:00 exited with status queued for try_number 1 2024-06-28T02:02:01.656393181Z [2024-06-28T02:02:01.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:01:00+00:00 exited with status queued for try_number 1 2024-06-28T02:02:01.656598340Z [2024-06-28T02:02:01.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:01:00+00:00 exited with status queued for try_number 1 2024-06-28T02:02:01.656779849Z [2024-06-28T02:02:01.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:01:00+00:00 exited with status queued for try_number 1 2024-06-28T02:02:01.683917362Z [2024-06-28T02:02:01.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2983ec4-65ee-4034-a21b-97e0196f0682 2024-06-28T02:02:01.685559441Z [2024-06-28T02:02:01.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to 803dffa1-fbf7-441f-994c-782d78fe2d93 2024-06-28T02:02:01.685577984Z [2024-06-28T02:02:01.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6688988b-9e2f-4842-b06c-f5b890090972 2024-06-28T02:02:01.685581879Z [2024-06-28T02:02:01.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to 005d49cf-fb4d-4ec6-8ba8-b23305d86603 2024-06-28T02:02:02.932799315Z [2024-06-28T02:02:02.932+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:02:02.933165865Z [2024-06-28T02:02:02.932+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:00:00+00:00, run_id=scheduled__2024-06-28T02:00:00+00:00, run_start_date=2024-06-28 02:02:01.022123+00:00, run_end_date=2024-06-28 02:02:02.932789+00:00, run_duration=1.910666, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:00:00+00:00, data_interval_end=2024-06-28 02:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:02:02.940113938Z [2024-06-28T02:02:02.939+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:02:00+00:00, run_after=2024-06-28T02:04:00+00:00 2024-06-28T02:02:02.946640227Z [2024-06-28T02:02:02.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:02:02.970349569Z [2024-06-28T02:02:02.956+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:01:00+00:00, run_id=scheduled__2024-06-28T02:01:00+00:00, run_start_date=2024-06-28 02:02:01.025353+00:00, run_end_date=2024-06-28 02:02:02.946648+00:00, run_duration=1.921295, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:01:00+00:00, data_interval_end=2024-06-28 02:02:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:02:02.999501437Z [2024-06-28T02:02:02.995+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:02:00+00:00, run_after=2024-06-28T02:03:00+00:00 2024-06-28T02:02:03.053316942Z [2024-06-28T02:02:03.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:00:00+00:00 exited with status success for try_number 1 2024-06-28T02:02:03.053367131Z [2024-06-28T02:02:03.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:01:00+00:00 exited with status success for try_number 1 2024-06-28T02:02:03.065070486Z [2024-06-28T02:02:03.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:00:00+00:00, map_index=-1, run_start_date=2024-06-28 02:02:02.125147+00:00, run_end_date=2024-06-28 02:02:02.579509+00:00, run_duration=0.454362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=929, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:02:01.096835+00:00, queued_by_job_id=2, pid=13552 2024-06-28T02:02:03.065560181Z [2024-06-28T02:02:03.065+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:01:00+00:00, map_index=-1, run_start_date=2024-06-28 02:02:02.405549+00:00, run_end_date=2024-06-28 02:02:02.809527+00:00, run_duration=0.403978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=930, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:02:01.096835+00:00, queued_by_job_id=2, pid=13558 2024-06-28T02:02:06.138992630Z [2024-06-28T02:02:06.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:02:06.139149615Z [2024-06-28T02:02:06.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:01:00+00:00, run_id=scheduled__2024-06-28T02:01:00+00:00, run_start_date=2024-06-28 02:02:01.028890+00:00, run_end_date=2024-06-28 02:02:06.138882+00:00, run_duration=5.109992, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:01:00+00:00, data_interval_end=2024-06-28 02:02:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:02:06.154762974Z [2024-06-28T02:02:06.154+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:02:00+00:00, run_after=2024-06-28T02:03:00+00:00 2024-06-28T02:02:06.168360098Z [2024-06-28T02:02:06.167+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:02:06.169499297Z [2024-06-28T02:02:06.168+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:01:00+00:00, run_id=scheduled__2024-06-28T02:01:00+00:00, run_start_date=2024-06-28 02:02:01.031002+00:00, run_end_date=2024-06-28 02:02:06.168675+00:00, run_duration=5.137673, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:01:00+00:00, data_interval_end=2024-06-28 02:02:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:02:06.188269684Z [2024-06-28T02:02:06.187+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:02:00+00:00, run_after=2024-06-28T02:03:00+00:00 2024-06-28T02:02:06.236455200Z [2024-06-28T02:02:06.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:01:00+00:00 exited with status success for try_number 1 2024-06-28T02:02:06.236872203Z [2024-06-28T02:02:06.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:01:00+00:00 exited with status success for try_number 1 2024-06-28T02:02:06.245243884Z [2024-06-28T02:02:06.244+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:01:00+00:00, map_index=-1, run_start_date=2024-06-28 02:02:03.830216+00:00, run_end_date=2024-06-28 02:02:05.682064+00:00, run_duration=1.851848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=932, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:02:01.096835+00:00, queued_by_job_id=2, pid=13582 2024-06-28T02:02:06.245606699Z [2024-06-28T02:02:06.245+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:01:00+00:00, map_index=-1, run_start_date=2024-06-28 02:02:03.666655+00:00, run_end_date=2024-06-28 02:02:05.228939+00:00, run_duration=1.562284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=931, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:02:01.096835+00:00, queued_by_job_id=2, pid=13581 2024-06-28T02:03:00.477170470Z [2024-06-28T02:03:00.476+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:03:00+00:00, run_after=2024-06-28T02:04:00+00:00 2024-06-28T02:03:00.496762381Z [2024-06-28T02:03:00.495+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:03:00+00:00, run_after=2024-06-28T02:04:00+00:00 2024-06-28T02:03:00.513235725Z [2024-06-28T02:03:00.512+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:03:00.625578763Z [2024-06-28T02:03:00.624+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:03:00.625636977Z 2024-06-28T02:03:00.625688703Z 2024-06-28T02:03:00.625699463Z 2024-06-28T02:03:00.626417048Z [2024-06-28T02:03:00.625+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:03:00.627180991Z [2024-06-28T02:03:00.626+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:03:00.627849799Z [2024-06-28T02:03:00.627+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:03:00.629251701Z [2024-06-28T02:03:00.628+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:03:00.629336900Z 2024-06-28T02:03:00.629344472Z 2024-06-28T02:03:00.629350626Z 2024-06-28T02:03:00.636148390Z [2024-06-28T02:03:00.635+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:03:00.637010586Z [2024-06-28T02:03:00.636+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:03:00.637712303Z [2024-06-28T02:03:00.637+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:03:00.638291932Z [2024-06-28T02:03:00.637+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:03:00.639047456Z [2024-06-28T02:03:00.638+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:03:00.639353753Z [2024-06-28T02:03:00.639+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:03:00.918351278Z [2024-06-28T02:03:00.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:02:00+00:00 exited with status queued for try_number 1 2024-06-28T02:03:00.918454859Z [2024-06-28T02:03:00.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:02:00+00:00 exited with status queued for try_number 1 2024-06-28T02:03:00.918459478Z [2024-06-28T02:03:00.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:02:00+00:00 exited with status queued for try_number 1 2024-06-28T02:03:00.927542244Z [2024-06-28T02:03:00.926+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0eca1229-4d3f-4f00-bae9-84e6f4497a5c 2024-06-28T02:03:00.927609967Z [2024-06-28T02:03:00.927+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4514e600-9415-4bc5-b8a2-e9c19fe85768 2024-06-28T02:03:00.927713943Z [2024-06-28T02:03:00.927+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8ddfa43-9de2-4a80-8d5b-665e8ba34748 2024-06-28T02:03:02.094969806Z [2024-06-28T02:03:02.094+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:03:02.095178632Z [2024-06-28T02:03:02.094+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:02:00+00:00, run_id=scheduled__2024-06-28T02:02:00+00:00, run_start_date=2024-06-28 02:03:00.533533+00:00, run_end_date=2024-06-28 02:03:02.094734+00:00, run_duration=1.561201, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:02:00+00:00, data_interval_end=2024-06-28 02:03:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:03:02.104824096Z [2024-06-28T02:03:02.104+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:03:00+00:00, run_after=2024-06-28T02:04:00+00:00 2024-06-28T02:03:02.157536964Z [2024-06-28T02:03:02.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:02:00+00:00 exited with status success for try_number 1 2024-06-28T02:03:02.163381737Z [2024-06-28T02:03:02.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:02:00+00:00, map_index=-1, run_start_date=2024-06-28 02:03:01.476353+00:00, run_end_date=2024-06-28 02:03:01.896400+00:00, run_duration=0.420047, state=success, executor_state=success, try_number=1, max_tries=1, job_id=933, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:03:00.631128+00:00, queued_by_job_id=2, pid=13614 2024-06-28T02:03:04.359530018Z [2024-06-28T02:03:04.358+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:03:04.359847456Z [2024-06-28T02:03:04.359+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:02:00+00:00, run_id=scheduled__2024-06-28T02:02:00+00:00, run_start_date=2024-06-28 02:03:00.537098+00:00, run_end_date=2024-06-28 02:03:04.359426+00:00, run_duration=3.822328, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:02:00+00:00, data_interval_end=2024-06-28 02:03:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:03:04.381046601Z [2024-06-28T02:03:04.380+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:03:00+00:00, run_after=2024-06-28T02:04:00+00:00 2024-06-28T02:03:04.961609268Z [2024-06-28T02:03:04.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:03:04.962540872Z [2024-06-28T02:03:04.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:02:00+00:00, run_id=scheduled__2024-06-28T02:02:00+00:00, run_start_date=2024-06-28 02:03:00.539130+00:00, run_end_date=2024-06-28 02:03:04.961849+00:00, run_duration=4.422719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:02:00+00:00, data_interval_end=2024-06-28 02:03:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:03:04.980677162Z [2024-06-28T02:03:04.980+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:03:00+00:00, run_after=2024-06-28T02:04:00+00:00 2024-06-28T02:03:05.033900884Z [2024-06-28T02:03:05.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:02:00+00:00 exited with status success for try_number 1 2024-06-28T02:03:05.035211405Z [2024-06-28T02:03:05.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:02:00+00:00 exited with status success for try_number 1 2024-06-28T02:03:05.049185103Z [2024-06-28T02:03:05.048+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:02:00+00:00, map_index=-1, run_start_date=2024-06-28 02:03:02.574492+00:00, run_end_date=2024-06-28 02:03:04.706215+00:00, run_duration=2.131723, state=success, executor_state=success, try_number=1, max_tries=1, job_id=934, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:03:00.631128+00:00, queued_by_job_id=2, pid=13632 2024-06-28T02:03:05.049708555Z [2024-06-28T02:03:05.049+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:02:00+00:00, map_index=-1, run_start_date=2024-06-28 02:03:02.636080+00:00, run_end_date=2024-06-28 02:03:04.298222+00:00, run_duration=1.662142, state=success, executor_state=success, try_number=1, max_tries=1, job_id=935, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:03:00.631128+00:00, queued_by_job_id=2, pid=13633 2024-06-28T02:04:00.552893830Z [2024-06-28T02:04:00.552+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:04:00.573528585Z [2024-06-28T02:04:00.573+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:04:00+00:00, run_after=2024-06-28T02:05:00+00:00 2024-06-28T02:04:00.582899797Z [2024-06-28T02:04:00.582+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:04:00.599441531Z [2024-06-28T02:04:00.598+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:04:00+00:00, run_after=2024-06-28T02:05:00+00:00 2024-06-28T02:04:00.692092155Z [2024-06-28T02:04:00.691+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:04:00.692116437Z 2024-06-28T02:04:00.692120994Z 2024-06-28T02:04:00.692124416Z 2024-06-28T02:04:00.692128090Z 2024-06-28T02:04:00.692139165Z [2024-06-28T02:04:00.691+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:04:00.692214873Z [2024-06-28T02:04:00.692+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:04:00.692331545Z [2024-06-28T02:04:00.692+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:04:00.692362859Z [2024-06-28T02:04:00.692+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:04:00.693175225Z [2024-06-28T02:04:00.692+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:04:00.693182693Z 2024-06-28T02:04:00.693186131Z 2024-06-28T02:04:00.693189313Z 2024-06-28T02:04:00.693192420Z 2024-06-28T02:04:00.698014449Z [2024-06-28T02:04:00.697+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:04:00.698047447Z [2024-06-28T02:04:00.697+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:04:00.698279542Z [2024-06-28T02:04:00.698+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:04:00.698367114Z [2024-06-28T02:04:00.698+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:04:00.698650616Z [2024-06-28T02:04:00.698+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:04:00.698796191Z [2024-06-28T02:04:00.698+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:04:00.698983683Z [2024-06-28T02:04:00.698+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:04:00.699065962Z [2024-06-28T02:04:00.698+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:04:01.139770005Z [2024-06-28T02:04:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:02:00+00:00 exited with status queued for try_number 1 2024-06-28T02:04:01.139804861Z [2024-06-28T02:04:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:03:00+00:00 exited with status queued for try_number 1 2024-06-28T02:04:01.139815830Z [2024-06-28T02:04:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:03:00+00:00 exited with status queued for try_number 1 2024-06-28T02:04:01.140007339Z [2024-06-28T02:04:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:03:00+00:00 exited with status queued for try_number 1 2024-06-28T02:04:01.150861161Z [2024-06-28T02:04:01.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b786939-ae67-448b-b7f9-b3677d3ddce0 2024-06-28T02:04:01.150920441Z [2024-06-28T02:04:01.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfa866fe-7ef7-4085-981b-b410711f2836 2024-06-28T02:04:01.151026419Z [2024-06-28T02:04:01.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f7b1e1a-21d0-43cc-b149-16781e7bbb5b 2024-06-28T02:04:01.151103470Z [2024-06-28T02:04:01.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a402bd7-88a6-47e6-bb6e-0c1d621dee45 2024-06-28T02:04:02.973346465Z [2024-06-28T02:04:02.972+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:04:02.973578694Z [2024-06-28T02:04:02.973+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:03:00+00:00, run_id=scheduled__2024-06-28T02:03:00+00:00, run_start_date=2024-06-28 02:04:00.614176+00:00, run_end_date=2024-06-28 02:04:02.973230+00:00, run_duration=2.359054, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:03:00+00:00, data_interval_end=2024-06-28 02:04:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:04:02.985556683Z [2024-06-28T02:04:02.985+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:04:00+00:00, run_after=2024-06-28T02:05:00+00:00 2024-06-28T02:04:02.992903900Z [2024-06-28T02:04:02.992+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:04:02.993291804Z [2024-06-28T02:04:02.993+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:02:00+00:00, run_id=scheduled__2024-06-28T02:02:00+00:00, run_start_date=2024-06-28 02:04:00.612826+00:00, run_end_date=2024-06-28 02:04:02.992764+00:00, run_duration=2.379938, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:02:00+00:00, data_interval_end=2024-06-28 02:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:04:03.000796453Z [2024-06-28T02:04:03.000+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:04:00+00:00, run_after=2024-06-28T02:06:00+00:00 2024-06-28T02:04:03.050298919Z [2024-06-28T02:04:03.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:02:00+00:00 exited with status success for try_number 1 2024-06-28T02:04:03.050478294Z [2024-06-28T02:04:03.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:03:00+00:00 exited with status success for try_number 1 2024-06-28T02:04:03.056877687Z [2024-06-28T02:04:03.056+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:03:00+00:00, map_index=-1, run_start_date=2024-06-28 02:04:02.075403+00:00, run_end_date=2024-06-28 02:04:02.557502+00:00, run_duration=0.482099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=936, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:04:00.694860+00:00, queued_by_job_id=2, pid=13666 2024-06-28T02:04:03.057209262Z [2024-06-28T02:04:03.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:02:00+00:00, map_index=-1, run_start_date=2024-06-28 02:04:02.230663+00:00, run_end_date=2024-06-28 02:04:02.674384+00:00, run_duration=0.443721, state=success, executor_state=success, try_number=1, max_tries=1, job_id=937, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:04:00.694860+00:00, queued_by_job_id=2, pid=13667 2024-06-28T02:04:05.239584084Z [2024-06-28T02:04:05.239+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:04:05.240439526Z [2024-06-28T02:04:05.239+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:03:00+00:00, run_id=scheduled__2024-06-28T02:03:00+00:00, run_start_date=2024-06-28 02:04:00.615247+00:00, run_end_date=2024-06-28 02:04:05.239613+00:00, run_duration=4.624366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:03:00+00:00, data_interval_end=2024-06-28 02:04:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:04:05.249977447Z [2024-06-28T02:04:05.249+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:04:00+00:00, run_after=2024-06-28T02:05:00+00:00 2024-06-28T02:04:05.468907706Z [2024-06-28T02:04:05.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:03:00+00:00 exited with status success for try_number 1 2024-06-28T02:04:05.476155916Z [2024-06-28T02:04:05.475+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:03:00+00:00, map_index=-1, run_start_date=2024-06-28 02:04:03.274989+00:00, run_end_date=2024-06-28 02:04:05.199559+00:00, run_duration=1.92457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=938, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:04:00.694860+00:00, queued_by_job_id=2, pid=13690 2024-06-28T02:04:06.530807054Z [2024-06-28T02:04:06.523+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:04:06.530835790Z [2024-06-28T02:04:06.523+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:03:00+00:00, run_id=scheduled__2024-06-28T02:03:00+00:00, run_start_date=2024-06-28 02:04:00.616243+00:00, run_end_date=2024-06-28 02:04:06.523593+00:00, run_duration=5.90735, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:03:00+00:00, data_interval_end=2024-06-28 02:04:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:04:06.533129000Z [2024-06-28T02:04:06.532+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:04:00+00:00, run_after=2024-06-28T02:05:00+00:00 2024-06-28T02:04:06.595341378Z [2024-06-28T02:04:06.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:03:00+00:00 exited with status success for try_number 1 2024-06-28T02:04:06.599888248Z [2024-06-28T02:04:06.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:03:00+00:00, map_index=-1, run_start_date=2024-06-28 02:04:03.379809+00:00, run_end_date=2024-06-28 02:04:05.529238+00:00, run_duration=2.149429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=939, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:04:00.694860+00:00, queued_by_job_id=2, pid=13691 2024-06-28T02:05:00.641498251Z [2024-06-28T02:05:00.640+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:05:00+00:00, run_after=2024-06-28T02:10:00+00:00 2024-06-28T02:05:00.658815462Z [2024-06-28T02:05:00.658+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:05:00+00:00, run_after=2024-06-28T02:06:00+00:00 2024-06-28T02:05:00.674135425Z [2024-06-28T02:05:00.673+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:05:00+00:00, run_after=2024-06-28T02:06:00+00:00 2024-06-28T02:05:00.681592268Z [2024-06-28T02:05:00.681+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:05:00.773447758Z [2024-06-28T02:05:00.773+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:05:00.773471873Z 2024-06-28T02:05:00.773476999Z 2024-06-28T02:05:00.773480560Z 2024-06-28T02:05:00.773484020Z 2024-06-28T02:05:00.773780288Z [2024-06-28T02:05:00.773+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:05:00.774060577Z [2024-06-28T02:05:00.773+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:05:00.774390408Z [2024-06-28T02:05:00.774+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:05:00.774806322Z [2024-06-28T02:05:00.774+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:05:00.775594145Z [2024-06-28T02:05:00.775+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:05:00.775610371Z 2024-06-28T02:05:00.775615666Z 2024-06-28T02:05:00.775620434Z 2024-06-28T02:05:00.775625499Z 2024-06-28T02:05:00.780162728Z [2024-06-28T02:05:00.779+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T02:05:00.780544989Z [2024-06-28T02:05:00.780+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:05:00.780993871Z [2024-06-28T02:05:00.780+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:05:00.781296971Z [2024-06-28T02:05:00.781+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:05:00.781726971Z [2024-06-28T02:05:00.781+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:05:00.782069303Z [2024-06-28T02:05:00.781+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:05:00.782487828Z [2024-06-28T02:05:00.782+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:05:00.782784744Z [2024-06-28T02:05:00.782+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:05:01.208991922Z [2024-06-28T02:05:01.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:00:00+00:00 exited with status queued for try_number 1 2024-06-28T02:05:01.209305831Z [2024-06-28T02:05:01.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:04:00+00:00 exited with status queued for try_number 1 2024-06-28T02:05:01.209482953Z [2024-06-28T02:05:01.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:04:00+00:00 exited with status queued for try_number 1 2024-06-28T02:05:01.209697023Z [2024-06-28T02:05:01.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:04:00+00:00 exited with status queued for try_number 1 2024-06-28T02:05:01.220810140Z [2024-06-28T02:05:01.220+0000] {scheduler_job.py:635} INFO - Setting external_id for to f03d2607-435d-46e5-a837-a9205a464a24 2024-06-28T02:05:01.221126237Z [2024-06-28T02:05:01.220+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2baab84e-5273-4adf-854f-9a2e8ff5e885 2024-06-28T02:05:01.221349527Z [2024-06-28T02:05:01.221+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60108d9e-6487-4382-a0b0-eb6e71322aaf 2024-06-28T02:05:01.221560967Z [2024-06-28T02:05:01.221+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3effa94-b1e9-4042-82a8-ef4fd890f4da 2024-06-28T02:05:02.927436650Z [2024-06-28T02:05:02.926+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:05:02.927685652Z [2024-06-28T02:05:02.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:04:00+00:00, run_id=scheduled__2024-06-28T02:04:00+00:00, run_start_date=2024-06-28 02:05:00.695964+00:00, run_end_date=2024-06-28 02:05:02.927268+00:00, run_duration=2.231304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:04:00+00:00, data_interval_end=2024-06-28 02:05:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:05:02.940905008Z [2024-06-28T02:05:02.940+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:05:00+00:00, run_after=2024-06-28T02:06:00+00:00 2024-06-28T02:05:03.041017443Z [2024-06-28T02:05:03.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:04:00+00:00 exited with status success for try_number 1 2024-06-28T02:05:03.052359312Z [2024-06-28T02:05:03.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:04:00+00:00, map_index=-1, run_start_date=2024-06-28 02:05:02.125984+00:00, run_end_date=2024-06-28 02:05:02.640424+00:00, run_duration=0.51444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=940, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:05:00.776838+00:00, queued_by_job_id=2, pid=13724 2024-06-28T02:05:04.198769468Z [2024-06-28T02:05:04.198+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:05:04.198796123Z 2024-06-28T02:05:04.198810344Z [2024-06-28T02:05:04.198+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:05:04.199326075Z [2024-06-28T02:05:04.199+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:05:04.199340827Z 2024-06-28T02:05:04.201688277Z [2024-06-28T02:05:04.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T02:05:04.201773946Z [2024-06-28T02:05:04.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:05:04.300574021Z [2024-06-28T02:05:04.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:00:00+00:00 exited with status queued for try_number 1 2024-06-28T02:05:04.300798847Z [2024-06-28T02:05:04.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:00:00+00:00 exited with status success for try_number 1 2024-06-28T02:05:04.307159539Z [2024-06-28T02:05:04.306+0000] {scheduler_job.py:635} INFO - Setting external_id for to 596167c5-d0ae-4644-ae61-985d80e55db5 2024-06-28T02:05:04.307432964Z [2024-06-28T02:05:04.307+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T02:00:00+00:00, map_index=-1, run_start_date=2024-06-28 02:05:03.398489+00:00, run_end_date=2024-06-28 02:05:03.874764+00:00, run_duration=0.476275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=941, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:05:00.776838+00:00, queued_by_job_id=2, pid=13743 2024-06-28T02:05:05.909581834Z [2024-06-28T02:05:05.909+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:05:05.909980612Z [2024-06-28T02:05:05.909+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:04:00+00:00, run_id=scheduled__2024-06-28T02:04:00+00:00, run_start_date=2024-06-28 02:05:00.697079+00:00, run_end_date=2024-06-28 02:05:05.909674+00:00, run_duration=5.212595, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:04:00+00:00, data_interval_end=2024-06-28 02:05:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:05:05.920538469Z [2024-06-28T02:05:05.920+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:05:00+00:00, run_after=2024-06-28T02:06:00+00:00 2024-06-28T02:05:05.927813504Z [2024-06-28T02:05:05.927+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:05:05.928290912Z [2024-06-28T02:05:05.928+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:04:00+00:00, run_id=scheduled__2024-06-28T02:04:00+00:00, run_start_date=2024-06-28 02:05:00.698028+00:00, run_end_date=2024-06-28 02:05:05.927870+00:00, run_duration=5.229842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:04:00+00:00, data_interval_end=2024-06-28 02:05:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:05:05.938093757Z [2024-06-28T02:05:05.937+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:05:00+00:00, run_after=2024-06-28T02:06:00+00:00 2024-06-28T02:05:05.981883029Z [2024-06-28T02:05:05.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:04:00+00:00 exited with status success for try_number 1 2024-06-28T02:05:05.982012877Z [2024-06-28T02:05:05.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:04:00+00:00 exited with status success for try_number 1 2024-06-28T02:05:05.988062211Z [2024-06-28T02:05:05.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:04:00+00:00, map_index=-1, run_start_date=2024-06-28 02:05:04.011042+00:00, run_end_date=2024-06-28 02:05:05.474021+00:00, run_duration=1.462979, state=success, executor_state=success, try_number=1, max_tries=1, job_id=943, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:05:00.776838+00:00, queued_by_job_id=2, pid=13760 2024-06-28T02:05:05.988333110Z [2024-06-28T02:05:05.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:04:00+00:00, map_index=-1, run_start_date=2024-06-28 02:05:03.437940+00:00, run_end_date=2024-06-28 02:05:05.503806+00:00, run_duration=2.065866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=942, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:05:00.776838+00:00, queued_by_job_id=2, pid=13744 2024-06-28T02:05:07.086412498Z [2024-06-28T02:05:07.085+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:05:07.086441554Z 2024-06-28T02:05:07.086823854Z [2024-06-28T02:05:07.086+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:05:07.088528346Z [2024-06-28T02:05:07.088+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:05:07.088551268Z 2024-06-28T02:05:07.093726975Z [2024-06-28T02:05:07.093+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T02:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T02:05:07.094289039Z [2024-06-28T02:05:07.093+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T02:05:07.147585001Z [2024-06-28T02:05:07.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:00:00+00:00 exited with status queued for try_number 1 2024-06-28T02:05:07.149546802Z [2024-06-28T02:05:07.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:00:00+00:00 exited with status success for try_number 1 2024-06-28T02:05:07.163829228Z [2024-06-28T02:05:07.163+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e055b4a-b857-4857-85a1-c8379555d67e 2024-06-28T02:05:07.164020630Z [2024-06-28T02:05:07.163+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T02:00:00+00:00, map_index=-1, run_start_date=2024-06-28 02:05:06.228250+00:00, run_end_date=2024-06-28 02:05:06.545885+00:00, run_duration=0.317635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=944, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:05:04.199602+00:00, queued_by_job_id=2, pid=13773 2024-06-28T02:05:09.297269097Z [2024-06-28T02:05:09.296+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:05:09.297317551Z 2024-06-28T02:05:09.297769530Z [2024-06-28T02:05:09.296+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:05:09.302831521Z [2024-06-28T02:05:09.301+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:05:09.302872889Z 2024-06-28T02:05:09.310074775Z [2024-06-28T02:05:09.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:05:09.310201872Z [2024-06-28T02:05:09.309+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:05:09.419090062Z [2024-06-28T02:05:09.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:00:00+00:00 exited with status queued for try_number 1 2024-06-28T02:05:09.419168121Z [2024-06-28T02:05:09.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:00:00+00:00 exited with status success for try_number 1 2024-06-28T02:05:09.430452670Z [2024-06-28T02:05:09.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90de19b3-c575-491c-975d-143a7bbc50f5 2024-06-28T02:05:09.431018578Z [2024-06-28T02:05:09.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T02:00:00+00:00, map_index=0, run_start_date=2024-06-28 02:05:08.673863+00:00, run_end_date=2024-06-28 02:05:09.055025+00:00, run_duration=0.381162, state=success, executor_state=success, try_number=1, max_tries=1, job_id=945, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:05:07.089473+00:00, queued_by_job_id=2, pid=13781 2024-06-28T02:05:11.669548588Z [2024-06-28T02:05:11.669+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:05:11.670033786Z [2024-06-28T02:05:11.669+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:00:00+00:00, run_id=scheduled__2024-06-28T02:00:00+00:00, run_start_date=2024-06-28 02:05:00.694580+00:00, run_end_date=2024-06-28 02:05:11.669644+00:00, run_duration=10.975064, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:00:00+00:00, data_interval_end=2024-06-28 02:05:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T02:05:11.680317318Z [2024-06-28T02:05:11.679+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:05:00+00:00, run_after=2024-06-28T02:10:00+00:00 2024-06-28T02:05:11.721386974Z [2024-06-28T02:05:11.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:00:00+00:00 exited with status success for try_number 1 2024-06-28T02:05:11.731762111Z [2024-06-28T02:05:11.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T02:00:00+00:00, map_index=-1, run_start_date=2024-06-28 02:05:10.927414+00:00, run_end_date=2024-06-28 02:05:11.352008+00:00, run_duration=0.424594, state=success, executor_state=success, try_number=1, max_tries=1, job_id=946, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:05:09.305079+00:00, queued_by_job_id=2, pid=13789 2024-06-28T02:06:00.101539879Z [2024-06-28T02:06:00.101+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:06:00.122522080Z [2024-06-28T02:06:00.121+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:06:00+00:00, run_after=2024-06-28T02:07:00+00:00 2024-06-28T02:06:00.138097013Z [2024-06-28T02:06:00.137+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:06:00.167101266Z [2024-06-28T02:06:00.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:06:00+00:00, run_after=2024-06-28T02:07:00+00:00 2024-06-28T02:06:00.276999594Z [2024-06-28T02:06:00.276+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:06:00.277078322Z 2024-06-28T02:06:00.277091073Z 2024-06-28T02:06:00.277100492Z 2024-06-28T02:06:00.277109190Z 2024-06-28T02:06:00.277183638Z [2024-06-28T02:06:00.276+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:06:00.277196006Z [2024-06-28T02:06:00.277+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:06:00.277356291Z [2024-06-28T02:06:00.277+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:06:00.277499223Z [2024-06-28T02:06:00.277+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:06:00.278123689Z [2024-06-28T02:06:00.277+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:06:00.278133142Z 2024-06-28T02:06:00.278137838Z 2024-06-28T02:06:00.278161278Z 2024-06-28T02:06:00.278165811Z 2024-06-28T02:06:00.281628878Z [2024-06-28T02:06:00.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:06:00.281837706Z [2024-06-28T02:06:00.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:06:00.282156966Z [2024-06-28T02:06:00.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:06:00.282327845Z [2024-06-28T02:06:00.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:06:00.282603375Z [2024-06-28T02:06:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:06:00.282800235Z [2024-06-28T02:06:00.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:06:00.283146312Z [2024-06-28T02:06:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:06:00.283218485Z [2024-06-28T02:06:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:06:00.647853567Z [2024-06-28T02:06:00.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:04:00+00:00 exited with status queued for try_number 1 2024-06-28T02:06:00.650565816Z [2024-06-28T02:06:00.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:05:00+00:00 exited with status queued for try_number 1 2024-06-28T02:06:00.650904616Z [2024-06-28T02:06:00.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:05:00+00:00 exited with status queued for try_number 1 2024-06-28T02:06:00.651144714Z [2024-06-28T02:06:00.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:05:00+00:00 exited with status queued for try_number 1 2024-06-28T02:06:00.676490313Z [2024-06-28T02:06:00.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd94e68c-7441-411b-a9f8-9e686af25cec 2024-06-28T02:06:00.676849420Z [2024-06-28T02:06:00.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to 497996a0-719c-4b6a-8a1d-96c6121dcf55 2024-06-28T02:06:00.677109880Z [2024-06-28T02:06:00.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to d908e6e0-2eb6-4763-a659-e097b6c3d85c 2024-06-28T02:06:00.677341138Z [2024-06-28T02:06:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32e38605-619f-45b2-bb81-83b71c519a3c 2024-06-28T02:06:01.829918037Z [2024-06-28T02:06:01.829+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:06:01.830421380Z [2024-06-28T02:06:01.830+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:04:00+00:00, run_id=scheduled__2024-06-28T02:04:00+00:00, run_start_date=2024-06-28 02:06:00.187660+00:00, run_end_date=2024-06-28 02:06:01.830022+00:00, run_duration=1.642362, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:04:00+00:00, data_interval_end=2024-06-28 02:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:06:01.873021063Z [2024-06-28T02:06:01.872+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:06:00+00:00, run_after=2024-06-28T02:08:00+00:00 2024-06-28T02:06:01.974993978Z [2024-06-28T02:06:01.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:04:00+00:00 exited with status success for try_number 1 2024-06-28T02:06:01.981696478Z [2024-06-28T02:06:01.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:04:00+00:00, map_index=-1, run_start_date=2024-06-28 02:06:01.114445+00:00, run_end_date=2024-06-28 02:06:01.675033+00:00, run_duration=0.560588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=947, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:06:00.279018+00:00, queued_by_job_id=2, pid=13809 2024-06-28T02:06:03.026466897Z [2024-06-28T02:06:03.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:06:03.026730214Z [2024-06-28T02:06:03.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:05:00+00:00, run_id=scheduled__2024-06-28T02:05:00+00:00, run_start_date=2024-06-28 02:06:00.190915+00:00, run_end_date=2024-06-28 02:06:03.026374+00:00, run_duration=2.835459, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:05:00+00:00, data_interval_end=2024-06-28 02:06:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:06:03.038008632Z [2024-06-28T02:06:03.037+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:06:00+00:00, run_after=2024-06-28T02:07:00+00:00 2024-06-28T02:06:03.117219913Z [2024-06-28T02:06:03.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:05:00+00:00 exited with status success for try_number 1 2024-06-28T02:06:03.124102162Z [2024-06-28T02:06:03.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:05:00+00:00, map_index=-1, run_start_date=2024-06-28 02:06:01.443695+00:00, run_end_date=2024-06-28 02:06:02.081810+00:00, run_duration=0.638115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=948, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:06:00.279018+00:00, queued_by_job_id=2, pid=13813 2024-06-28T02:06:05.276511212Z [2024-06-28T02:06:05.276+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:06:05.277026968Z [2024-06-28T02:06:05.276+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:05:00+00:00, run_id=scheduled__2024-06-28T02:05:00+00:00, run_start_date=2024-06-28 02:06:00.197866+00:00, run_end_date=2024-06-28 02:06:05.276626+00:00, run_duration=5.07876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:05:00+00:00, data_interval_end=2024-06-28 02:06:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:06:05.291702077Z [2024-06-28T02:06:05.291+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:06:00+00:00, run_after=2024-06-28T02:07:00+00:00 2024-06-28T02:06:05.459270264Z [2024-06-28T02:06:05.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:05:00+00:00 exited with status success for try_number 1 2024-06-28T02:06:05.463875292Z [2024-06-28T02:06:05.463+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:05:00+00:00, map_index=-1, run_start_date=2024-06-28 02:06:02.770608+00:00, run_end_date=2024-06-28 02:06:05.231055+00:00, run_duration=2.460447, state=success, executor_state=success, try_number=1, max_tries=1, job_id=949, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:06:00.279018+00:00, queued_by_job_id=2, pid=13836 2024-06-28T02:06:07.584368302Z [2024-06-28T02:06:07.583+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:06:07.584551940Z [2024-06-28T02:06:07.584+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:05:00+00:00, run_id=scheduled__2024-06-28T02:05:00+00:00, run_start_date=2024-06-28 02:06:00.194804+00:00, run_end_date=2024-06-28 02:06:07.584287+00:00, run_duration=7.389483, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:05:00+00:00, data_interval_end=2024-06-28 02:06:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:06:07.599941468Z [2024-06-28T02:06:07.599+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:06:00+00:00, run_after=2024-06-28T02:07:00+00:00 2024-06-28T02:06:07.648864303Z [2024-06-28T02:06:07.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:05:00+00:00 exited with status success for try_number 1 2024-06-28T02:06:07.657414878Z [2024-06-28T02:06:07.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:05:00+00:00, map_index=-1, run_start_date=2024-06-28 02:06:02.887254+00:00, run_end_date=2024-06-28 02:06:06.751086+00:00, run_duration=3.863832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=950, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:06:00.279018+00:00, queued_by_job_id=2, pid=13837 2024-06-28T02:06:47.177758890Z [2024-06-28T02:06:47.176+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T02:07:00.083647020Z [2024-06-28T02:07:00.082+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:07:00.107326652Z [2024-06-28T02:07:00.106+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:07:00+00:00, run_after=2024-06-28T02:08:00+00:00 2024-06-28T02:07:00.124202774Z [2024-06-28T02:07:00.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:07:00+00:00, run_after=2024-06-28T02:08:00+00:00 2024-06-28T02:07:00.183901011Z [2024-06-28T02:07:00.183+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:07:00.183939398Z 2024-06-28T02:07:00.183949251Z 2024-06-28T02:07:00.183958134Z 2024-06-28T02:07:00.184460181Z [2024-06-28T02:07:00.184+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:07:00.184937269Z [2024-06-28T02:07:00.184+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:07:00.185374922Z [2024-06-28T02:07:00.185+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:07:00.186881305Z [2024-06-28T02:07:00.186+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:07:00.186904477Z 2024-06-28T02:07:00.186913619Z 2024-06-28T02:07:00.186922147Z 2024-06-28T02:07:00.195187091Z [2024-06-28T02:07:00.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:07:00.195527797Z [2024-06-28T02:07:00.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:07:00.195985183Z [2024-06-28T02:07:00.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:07:00.196487099Z [2024-06-28T02:07:00.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:07:00.196965225Z [2024-06-28T02:07:00.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:07:00.197318578Z [2024-06-28T02:07:00.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:07:00.448142022Z [2024-06-28T02:07:00.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:06:00+00:00 exited with status queued for try_number 1 2024-06-28T02:07:00.448184459Z [2024-06-28T02:07:00.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:06:00+00:00 exited with status queued for try_number 1 2024-06-28T02:07:00.448248101Z [2024-06-28T02:07:00.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:06:00+00:00 exited with status queued for try_number 1 2024-06-28T02:07:00.463225039Z [2024-06-28T02:07:00.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1461e962-7e71-4418-b976-b4b0a5b302fc 2024-06-28T02:07:00.463285893Z [2024-06-28T02:07:00.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b244546-d852-4ec5-bbb5-b33dd57c0780 2024-06-28T02:07:00.463398120Z [2024-06-28T02:07:00.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4ce37b3-e95f-46f9-a770-bfc7b9450157 2024-06-28T02:07:01.776642367Z [2024-06-28T02:07:01.776+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:07:01.776842378Z [2024-06-28T02:07:01.776+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:06:00+00:00, run_id=scheduled__2024-06-28T02:06:00+00:00, run_start_date=2024-06-28 02:07:00.134975+00:00, run_end_date=2024-06-28 02:07:01.776547+00:00, run_duration=1.641572, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:06:00+00:00, data_interval_end=2024-06-28 02:07:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:07:01.789160115Z [2024-06-28T02:07:01.788+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:07:00+00:00, run_after=2024-06-28T02:08:00+00:00 2024-06-28T02:07:01.834230596Z [2024-06-28T02:07:01.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:06:00+00:00 exited with status success for try_number 1 2024-06-28T02:07:01.846730790Z [2024-06-28T02:07:01.846+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:06:00+00:00, map_index=-1, run_start_date=2024-06-28 02:07:01.210000+00:00, run_end_date=2024-06-28 02:07:01.624531+00:00, run_duration=0.414531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=951, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:07:00.190363+00:00, queued_by_job_id=2, pid=13869 2024-06-28T02:07:04.006069073Z [2024-06-28T02:07:04.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:07:04.006471758Z [2024-06-28T02:07:04.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:06:00+00:00, run_id=scheduled__2024-06-28T02:06:00+00:00, run_start_date=2024-06-28 02:07:00.136095+00:00, run_end_date=2024-06-28 02:07:04.005889+00:00, run_duration=3.869794, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:06:00+00:00, data_interval_end=2024-06-28 02:07:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:07:04.015489482Z [2024-06-28T02:07:04.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:07:00+00:00, run_after=2024-06-28T02:08:00+00:00 2024-06-28T02:07:04.065468329Z [2024-06-28T02:07:04.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:06:00+00:00 exited with status success for try_number 1 2024-06-28T02:07:04.073873644Z [2024-06-28T02:07:04.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:06:00+00:00, map_index=-1, run_start_date=2024-06-28 02:07:02.213812+00:00, run_end_date=2024-06-28 02:07:03.751589+00:00, run_duration=1.537777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=952, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:07:00.190363+00:00, queued_by_job_id=2, pid=13887 2024-06-28T02:07:05.111478465Z [2024-06-28T02:07:05.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:07:05.111861884Z [2024-06-28T02:07:05.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:06:00+00:00, run_id=scheduled__2024-06-28T02:06:00+00:00, run_start_date=2024-06-28 02:07:00.137100+00:00, run_end_date=2024-06-28 02:07:05.111540+00:00, run_duration=4.97444, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:06:00+00:00, data_interval_end=2024-06-28 02:07:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:07:05.120514862Z [2024-06-28T02:07:05.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:07:00+00:00, run_after=2024-06-28T02:08:00+00:00 2024-06-28T02:07:05.165334141Z [2024-06-28T02:07:05.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:06:00+00:00 exited with status success for try_number 1 2024-06-28T02:07:05.173090164Z [2024-06-28T02:07:05.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:06:00+00:00, map_index=-1, run_start_date=2024-06-28 02:07:02.319468+00:00, run_end_date=2024-06-28 02:07:04.151798+00:00, run_duration=1.83233, state=success, executor_state=success, try_number=1, max_tries=1, job_id=953, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:07:00.190363+00:00, queued_by_job_id=2, pid=13888 2024-06-28T02:08:00.838676656Z [2024-06-28T02:08:00.838+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:08:00+00:00, run_after=2024-06-28T02:09:00+00:00 2024-06-28T02:08:00.855516691Z [2024-06-28T02:08:00.855+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:08:00.873326886Z [2024-06-28T02:08:00.872+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:08:00+00:00, run_after=2024-06-28T02:09:00+00:00 2024-06-28T02:08:00.884161680Z [2024-06-28T02:08:00.883+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:08:00.981110028Z [2024-06-28T02:08:00.980+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:08:00.981153871Z 2024-06-28T02:08:00.981160323Z 2024-06-28T02:08:00.981165317Z 2024-06-28T02:08:00.981169954Z 2024-06-28T02:08:00.981456521Z [2024-06-28T02:08:00.981+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:08:00.981699542Z [2024-06-28T02:08:00.981+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:08:00.981950726Z [2024-06-28T02:08:00.981+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:08:00.982176119Z [2024-06-28T02:08:00.982+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:08:00.983223255Z [2024-06-28T02:08:00.982+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:08:00.983257891Z 2024-06-28T02:08:00.983267952Z 2024-06-28T02:08:00.983277025Z 2024-06-28T02:08:00.983285991Z 2024-06-28T02:08:00.986587927Z [2024-06-28T02:08:00.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:08:00.986926160Z [2024-06-28T02:08:00.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:08:00.987332552Z [2024-06-28T02:08:00.987+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:08:00.987568250Z [2024-06-28T02:08:00.987+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:08:00.988053078Z [2024-06-28T02:08:00.987+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:08:00.988299088Z [2024-06-28T02:08:00.987+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:08:00.988630511Z [2024-06-28T02:08:00.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:08:00.988814867Z [2024-06-28T02:08:00.988+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:08:01.301997399Z [2024-06-28T02:08:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:06:00+00:00 exited with status queued for try_number 1 2024-06-28T02:08:01.302052374Z [2024-06-28T02:08:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:07:00+00:00 exited with status queued for try_number 1 2024-06-28T02:08:01.302089643Z [2024-06-28T02:08:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:07:00+00:00 exited with status queued for try_number 1 2024-06-28T02:08:01.302202935Z [2024-06-28T02:08:01.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:07:00+00:00 exited with status queued for try_number 1 2024-06-28T02:08:01.313321875Z [2024-06-28T02:08:01.312+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea8eac30-f73e-4cb2-a857-faa3fafe9aae 2024-06-28T02:08:01.313385643Z [2024-06-28T02:08:01.313+0000] {scheduler_job.py:635} INFO - Setting external_id for to 349db96c-6842-4e27-a892-358aa7ea48cf 2024-06-28T02:08:01.313487032Z [2024-06-28T02:08:01.313+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e274705-5104-4434-a461-b11226b3b646 2024-06-28T02:08:01.313586325Z [2024-06-28T02:08:01.313+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33862196-5ceb-4741-a5d0-288b78d670b7 2024-06-28T02:08:02.513644745Z [2024-06-28T02:08:02.513+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:08:02.515265391Z [2024-06-28T02:08:02.514+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:06:00+00:00, run_id=scheduled__2024-06-28T02:06:00+00:00, run_start_date=2024-06-28 02:08:00.900184+00:00, run_end_date=2024-06-28 02:08:02.514775+00:00, run_duration=1.614591, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:06:00+00:00, data_interval_end=2024-06-28 02:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:08:02.526053368Z [2024-06-28T02:08:02.525+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:08:00+00:00, run_after=2024-06-28T02:10:00+00:00 2024-06-28T02:08:02.544654337Z [2024-06-28T02:08:02.544+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:08:02.545458102Z [2024-06-28T02:08:02.545+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:07:00+00:00, run_id=scheduled__2024-06-28T02:07:00+00:00, run_start_date=2024-06-28 02:08:00.902166+00:00, run_end_date=2024-06-28 02:08:02.544564+00:00, run_duration=1.642398, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:07:00+00:00, data_interval_end=2024-06-28 02:08:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:08:02.565730557Z [2024-06-28T02:08:02.565+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:08:00+00:00, run_after=2024-06-28T02:09:00+00:00 2024-06-28T02:08:02.615511151Z [2024-06-28T02:08:02.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:06:00+00:00 exited with status success for try_number 1 2024-06-28T02:08:02.615576086Z [2024-06-28T02:08:02.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:07:00+00:00 exited with status success for try_number 1 2024-06-28T02:08:02.622142806Z [2024-06-28T02:08:02.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:06:00+00:00, map_index=-1, run_start_date=2024-06-28 02:08:01.800578+00:00, run_end_date=2024-06-28 02:08:02.172082+00:00, run_duration=0.371504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=954, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:08:00.983958+00:00, queued_by_job_id=2, pid=13921 2024-06-28T02:08:02.622217668Z [2024-06-28T02:08:02.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:07:00+00:00, map_index=-1, run_start_date=2024-06-28 02:08:01.943479+00:00, run_end_date=2024-06-28 02:08:02.372356+00:00, run_duration=0.428877, state=success, executor_state=success, try_number=1, max_tries=1, job_id=955, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:08:00.983958+00:00, queued_by_job_id=2, pid=13922 2024-06-28T02:08:04.800328398Z [2024-06-28T02:08:04.799+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:08:04.800583573Z [2024-06-28T02:08:04.800+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:07:00+00:00, run_id=scheduled__2024-06-28T02:07:00+00:00, run_start_date=2024-06-28 02:08:00.904992+00:00, run_end_date=2024-06-28 02:08:04.800212+00:00, run_duration=3.89522, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:07:00+00:00, data_interval_end=2024-06-28 02:08:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:08:04.810815148Z [2024-06-28T02:08:04.810+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:08:00+00:00, run_after=2024-06-28T02:09:00+00:00 2024-06-28T02:08:04.849893708Z [2024-06-28T02:08:04.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:07:00+00:00 exited with status success for try_number 1 2024-06-28T02:08:04.861844599Z [2024-06-28T02:08:04.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:07:00+00:00, map_index=-1, run_start_date=2024-06-28 02:08:02.948170+00:00, run_end_date=2024-06-28 02:08:04.475578+00:00, run_duration=1.527408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=956, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:08:00.983958+00:00, queued_by_job_id=2, pid=13945 2024-06-28T02:08:05.922092938Z [2024-06-28T02:08:05.921+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:08:05.922616368Z [2024-06-28T02:08:05.922+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:07:00+00:00, run_id=scheduled__2024-06-28T02:07:00+00:00, run_start_date=2024-06-28 02:08:00.906660+00:00, run_end_date=2024-06-28 02:08:05.922098+00:00, run_duration=5.015438, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:07:00+00:00, data_interval_end=2024-06-28 02:08:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:08:05.938055310Z [2024-06-28T02:08:05.937+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:08:00+00:00, run_after=2024-06-28T02:09:00+00:00 2024-06-28T02:08:05.975466607Z [2024-06-28T02:08:05.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:07:00+00:00 exited with status success for try_number 1 2024-06-28T02:08:05.980964597Z [2024-06-28T02:08:05.980+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:07:00+00:00, map_index=-1, run_start_date=2024-06-28 02:08:02.989878+00:00, run_end_date=2024-06-28 02:08:05.078937+00:00, run_duration=2.089059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=957, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:08:00.983958+00:00, queued_by_job_id=2, pid=13946 2024-06-28T02:09:01.169460900Z [2024-06-28T02:09:01.168+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:09:00+00:00, run_after=2024-06-28T02:10:00+00:00 2024-06-28T02:09:01.183289526Z [2024-06-28T02:09:01.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:09:00+00:00, run_after=2024-06-28T02:10:00+00:00 2024-06-28T02:09:01.191166638Z [2024-06-28T02:09:01.190+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:09:01.251637141Z [2024-06-28T02:09:01.250+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:09:01.251678692Z 2024-06-28T02:09:01.251688025Z 2024-06-28T02:09:01.251695756Z 2024-06-28T02:09:01.251857183Z [2024-06-28T02:09:01.251+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:09:01.252230024Z [2024-06-28T02:09:01.251+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:09:01.252793504Z [2024-06-28T02:09:01.252+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:09:01.254297265Z [2024-06-28T02:09:01.253+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:09:01.254323069Z 2024-06-28T02:09:01.254326860Z 2024-06-28T02:09:01.254329916Z 2024-06-28T02:09:01.261764006Z [2024-06-28T02:09:01.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:09:01.262121093Z [2024-06-28T02:09:01.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:09:01.262347504Z [2024-06-28T02:09:01.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:09:01.262549194Z [2024-06-28T02:09:01.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:09:01.262958326Z [2024-06-28T02:09:01.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:09:01.263133852Z [2024-06-28T02:09:01.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:09:01.469098485Z [2024-06-28T02:09:01.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:08:00+00:00 exited with status queued for try_number 1 2024-06-28T02:09:01.469128914Z [2024-06-28T02:09:01.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:08:00+00:00 exited with status queued for try_number 1 2024-06-28T02:09:01.469200135Z [2024-06-28T02:09:01.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:08:00+00:00 exited with status queued for try_number 1 2024-06-28T02:09:01.476974380Z [2024-06-28T02:09:01.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9b29517-4a3b-48d1-8b5d-a66522e063e2 2024-06-28T02:09:01.477031200Z [2024-06-28T02:09:01.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d8ce0fd-1f48-4e0e-b176-2aa0d7b2363c 2024-06-28T02:09:01.477140096Z [2024-06-28T02:09:01.477+0000] {scheduler_job.py:635} INFO - Setting external_id for to c29c41f4-4299-42c0-86d6-2ec0f462cbeb 2024-06-28T02:09:03.551066176Z [2024-06-28T02:09:03.550+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:09:03.551637552Z [2024-06-28T02:09:03.551+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:08:00+00:00, run_id=scheduled__2024-06-28T02:08:00+00:00, run_start_date=2024-06-28 02:09:01.200129+00:00, run_end_date=2024-06-28 02:09:03.550953+00:00, run_duration=2.350824, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:08:00+00:00, data_interval_end=2024-06-28 02:09:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:09:03.565702551Z [2024-06-28T02:09:03.565+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:09:00+00:00, run_after=2024-06-28T02:10:00+00:00 2024-06-28T02:09:03.639498176Z [2024-06-28T02:09:03.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:08:00+00:00 exited with status success for try_number 1 2024-06-28T02:09:03.648195606Z [2024-06-28T02:09:03.647+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:08:00+00:00, map_index=-1, run_start_date=2024-06-28 02:09:02.089870+00:00, run_end_date=2024-06-28 02:09:02.535385+00:00, run_duration=0.445515, state=success, executor_state=success, try_number=1, max_tries=1, job_id=958, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:09:01.255844+00:00, queued_by_job_id=2, pid=13978 2024-06-28T02:09:04.695566624Z [2024-06-28T02:09:04.695+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:09:04.695762204Z [2024-06-28T02:09:04.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:08:00+00:00, run_id=scheduled__2024-06-28T02:08:00+00:00, run_start_date=2024-06-28 02:09:01.201410+00:00, run_end_date=2024-06-28 02:09:04.695504+00:00, run_duration=3.494094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:08:00+00:00, data_interval_end=2024-06-28 02:09:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:09:04.706397287Z [2024-06-28T02:09:04.706+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:09:00+00:00, run_after=2024-06-28T02:10:00+00:00 2024-06-28T02:09:04.751849146Z [2024-06-28T02:09:04.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:08:00+00:00 exited with status success for try_number 1 2024-06-28T02:09:04.760917770Z [2024-06-28T02:09:04.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:08:00+00:00, map_index=-1, run_start_date=2024-06-28 02:09:02.993506+00:00, run_end_date=2024-06-28 02:09:04.518896+00:00, run_duration=1.52539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=959, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:09:01.255844+00:00, queued_by_job_id=2, pid=13996 2024-06-28T02:09:05.812155146Z [2024-06-28T02:09:05.811+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:09:05.812757954Z [2024-06-28T02:09:05.812+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:08:00+00:00, run_id=scheduled__2024-06-28T02:08:00+00:00, run_start_date=2024-06-28 02:09:01.202401+00:00, run_end_date=2024-06-28 02:09:05.812378+00:00, run_duration=4.609977, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:08:00+00:00, data_interval_end=2024-06-28 02:09:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:09:05.823073565Z [2024-06-28T02:09:05.822+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:09:00+00:00, run_after=2024-06-28T02:10:00+00:00 2024-06-28T02:09:05.854283882Z [2024-06-28T02:09:05.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:08:00+00:00 exited with status success for try_number 1 2024-06-28T02:09:05.859914392Z [2024-06-28T02:09:05.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:08:00+00:00, map_index=-1, run_start_date=2024-06-28 02:09:03.153198+00:00, run_end_date=2024-06-28 02:09:04.877213+00:00, run_duration=1.724015, state=success, executor_state=success, try_number=1, max_tries=1, job_id=960, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:09:01.255844+00:00, queued_by_job_id=2, pid=13997 2024-06-28T02:10:01.029869145Z [2024-06-28T02:10:01.029+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:10:00+00:00, run_after=2024-06-28T02:11:00+00:00 2024-06-28T02:10:01.049617763Z [2024-06-28T02:10:01.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:10:00+00:00, run_after=2024-06-28T02:15:00+00:00 2024-06-28T02:10:01.060405939Z [2024-06-28T02:10:01.059+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:10:01.071479633Z [2024-06-28T02:10:01.070+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:10:01.095459721Z [2024-06-28T02:10:01.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:10:00+00:00, run_after=2024-06-28T02:11:00+00:00 2024-06-28T02:10:01.216800214Z [2024-06-28T02:10:01.216+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-28T02:10:01.216869420Z 2024-06-28T02:10:01.216929047Z 2024-06-28T02:10:01.216940835Z 2024-06-28T02:10:01.216948099Z 2024-06-28T02:10:01.216955506Z 2024-06-28T02:10:01.217393945Z [2024-06-28T02:10:01.217+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:10:01.217991143Z [2024-06-28T02:10:01.217+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:10:01.218646736Z [2024-06-28T02:10:01.218+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:10:01.219088534Z [2024-06-28T02:10:01.218+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:10:01.219392320Z [2024-06-28T02:10:01.219+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:10:01.220678520Z [2024-06-28T02:10:01.220+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:10:01.220698104Z 2024-06-28T02:10:01.220708991Z 2024-06-28T02:10:01.220718226Z 2024-06-28T02:10:01.220726977Z 2024-06-28T02:10:01.220735757Z 2024-06-28T02:10:01.226797255Z [2024-06-28T02:10:01.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T02:10:01.226994223Z [2024-06-28T02:10:01.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:10:01.227426652Z [2024-06-28T02:10:01.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:10:01.227660244Z [2024-06-28T02:10:01.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:10:01.228045895Z [2024-06-28T02:10:01.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:10:01.228234390Z [2024-06-28T02:10:01.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:10:01.228713873Z [2024-06-28T02:10:01.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:10:01.228898756Z [2024-06-28T02:10:01.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:10:01.229247284Z [2024-06-28T02:10:01.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:10:01.229528002Z [2024-06-28T02:10:01.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:10:01.725222759Z [2024-06-28T02:10:01.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:05:00+00:00 exited with status queued for try_number 1 2024-06-28T02:10:01.725266173Z [2024-06-28T02:10:01.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:08:00+00:00 exited with status queued for try_number 1 2024-06-28T02:10:01.725304933Z [2024-06-28T02:10:01.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:09:00+00:00 exited with status queued for try_number 1 2024-06-28T02:10:01.725378458Z [2024-06-28T02:10:01.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:09:00+00:00 exited with status queued for try_number 1 2024-06-28T02:10:01.725434755Z [2024-06-28T02:10:01.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:09:00+00:00 exited with status queued for try_number 1 2024-06-28T02:10:01.740566630Z [2024-06-28T02:10:01.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55a4ce44-40f8-46c1-a21e-3c0efa2e080b 2024-06-28T02:10:01.740615198Z [2024-06-28T02:10:01.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b4fed23-89b0-49bb-8fb1-7dc7c65311d4 2024-06-28T02:10:01.740748531Z [2024-06-28T02:10:01.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab8670fe-3b1b-4730-9e7b-834c6af6c1ba 2024-06-28T02:10:01.740846778Z [2024-06-28T02:10:01.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9537e24-40ca-45b5-be3e-489eeb9c326e 2024-06-28T02:10:01.740946569Z [2024-06-28T02:10:01.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d772a3c-acec-4de6-be08-75986da59c13 2024-06-28T02:10:02.980800117Z [2024-06-28T02:10:02.980+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:10:02.981282707Z [2024-06-28T02:10:02.981+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:08:00+00:00, run_id=scheduled__2024-06-28T02:08:00+00:00, run_start_date=2024-06-28 02:10:01.109040+00:00, run_end_date=2024-06-28 02:10:02.980703+00:00, run_duration=1.871663, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:08:00+00:00, data_interval_end=2024-06-28 02:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:10:02.993544807Z [2024-06-28T02:10:02.993+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:10:00+00:00, run_after=2024-06-28T02:12:00+00:00 2024-06-28T02:10:03.004478466Z [2024-06-28T02:10:03.004+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:10:03.004904233Z [2024-06-28T02:10:03.004+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:09:00+00:00, run_id=scheduled__2024-06-28T02:09:00+00:00, run_start_date=2024-06-28 02:10:01.110153+00:00, run_end_date=2024-06-28 02:10:03.004404+00:00, run_duration=1.894251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:09:00+00:00, data_interval_end=2024-06-28 02:10:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:10:03.016804522Z [2024-06-28T02:10:03.016+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:10:00+00:00, run_after=2024-06-28T02:11:00+00:00 2024-06-28T02:10:03.066980292Z [2024-06-28T02:10:03.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:08:00+00:00 exited with status success for try_number 1 2024-06-28T02:10:03.067057653Z [2024-06-28T02:10:03.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:09:00+00:00 exited with status success for try_number 1 2024-06-28T02:10:03.079485876Z [2024-06-28T02:10:03.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:09:00+00:00, map_index=-1, run_start_date=2024-06-28 02:10:02.049744+00:00, run_end_date=2024-06-28 02:10:02.480566+00:00, run_duration=0.430822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=961, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:10:01.222406+00:00, queued_by_job_id=2, pid=14030 2024-06-28T02:10:03.079848480Z [2024-06-28T02:10:03.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:08:00+00:00, map_index=-1, run_start_date=2024-06-28 02:10:02.281515+00:00, run_end_date=2024-06-28 02:10:02.700334+00:00, run_duration=0.418819, state=success, executor_state=success, try_number=1, max_tries=1, job_id=962, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:10:01.222406+00:00, queued_by_job_id=2, pid=14031 2024-06-28T02:10:04.615689785Z [2024-06-28T02:10:04.608+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:10:04.615716335Z 2024-06-28T02:10:04.615720825Z [2024-06-28T02:10:04.608+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:10:04.615725215Z [2024-06-28T02:10:04.609+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:10:04.615729188Z 2024-06-28T02:10:04.619414337Z [2024-06-28T02:10:04.619+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T02:10:04.619712159Z [2024-06-28T02:10:04.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:10:04.696177976Z [2024-06-28T02:10:04.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:05:00+00:00 exited with status queued for try_number 1 2024-06-28T02:10:04.696475452Z [2024-06-28T02:10:04.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:05:00+00:00 exited with status success for try_number 1 2024-06-28T02:10:04.707883187Z [2024-06-28T02:10:04.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d2879d0-0115-4052-bc99-6f710dc61c40 2024-06-28T02:10:04.708521561Z [2024-06-28T02:10:04.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T02:05:00+00:00, map_index=-1, run_start_date=2024-06-28 02:10:03.487628+00:00, run_end_date=2024-06-28 02:10:03.898575+00:00, run_duration=0.410947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=963, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:10:01.222406+00:00, queued_by_job_id=2, pid=14060 2024-06-28T02:10:05.871900401Z [2024-06-28T02:10:05.871+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:10:05.872670054Z [2024-06-28T02:10:05.872+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:09:00+00:00, run_id=scheduled__2024-06-28T02:09:00+00:00, run_start_date=2024-06-28 02:10:01.111224+00:00, run_end_date=2024-06-28 02:10:05.872080+00:00, run_duration=4.760856, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:09:00+00:00, data_interval_end=2024-06-28 02:10:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:10:05.886433093Z [2024-06-28T02:10:05.885+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:10:00+00:00, run_after=2024-06-28T02:11:00+00:00 2024-06-28T02:10:05.895809915Z [2024-06-28T02:10:05.895+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:10:05.896446501Z [2024-06-28T02:10:05.896+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:09:00+00:00, run_id=scheduled__2024-06-28T02:09:00+00:00, run_start_date=2024-06-28 02:10:01.112178+00:00, run_end_date=2024-06-28 02:10:05.896010+00:00, run_duration=4.783832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:09:00+00:00, data_interval_end=2024-06-28 02:10:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:10:05.908387331Z [2024-06-28T02:10:05.908+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:10:00+00:00, run_after=2024-06-28T02:11:00+00:00 2024-06-28T02:10:05.978356041Z [2024-06-28T02:10:05.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:09:00+00:00 exited with status success for try_number 1 2024-06-28T02:10:05.978456153Z [2024-06-28T02:10:05.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:09:00+00:00 exited with status success for try_number 1 2024-06-28T02:10:05.985040865Z [2024-06-28T02:10:05.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:09:00+00:00, map_index=-1, run_start_date=2024-06-28 02:10:03.606562+00:00, run_end_date=2024-06-28 02:10:05.021564+00:00, run_duration=1.415002, state=success, executor_state=success, try_number=1, max_tries=1, job_id=965, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:10:01.222406+00:00, queued_by_job_id=2, pid=14062 2024-06-28T02:10:05.985241493Z [2024-06-28T02:10:05.985+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:09:00+00:00, map_index=-1, run_start_date=2024-06-28 02:10:03.561117+00:00, run_end_date=2024-06-28 02:10:05.442850+00:00, run_duration=1.881733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=964, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:10:01.222406+00:00, queued_by_job_id=2, pid=14061 2024-06-28T02:10:07.057785985Z [2024-06-28T02:10:07.057+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:10:07.057817355Z 2024-06-28T02:10:07.058037452Z [2024-06-28T02:10:07.057+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:10:07.059053754Z [2024-06-28T02:10:07.058+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:10:07.059099623Z 2024-06-28T02:10:07.062267386Z [2024-06-28T02:10:07.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T02:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T02:10:07.062604454Z [2024-06-28T02:10:07.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T02:10:07.112820035Z [2024-06-28T02:10:07.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:05:00+00:00 exited with status queued for try_number 1 2024-06-28T02:10:07.112844593Z [2024-06-28T02:10:07.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:05:00+00:00 exited with status success for try_number 1 2024-06-28T02:10:07.119377343Z [2024-06-28T02:10:07.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb189dc1-39b9-4e28-a62d-ff75dcb96679 2024-06-28T02:10:07.119611987Z [2024-06-28T02:10:07.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T02:05:00+00:00, map_index=-1, run_start_date=2024-06-28 02:10:06.498439+00:00, run_end_date=2024-06-28 02:10:06.815677+00:00, run_duration=0.317238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=966, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:10:04.611063+00:00, queued_by_job_id=2, pid=14085 2024-06-28T02:10:10.499214163Z [2024-06-28T02:10:10.498+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:10:10.499247262Z 2024-06-28T02:10:10.499548843Z [2024-06-28T02:10:10.499+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:10:10.500562418Z [2024-06-28T02:10:10.500+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:10:10.500606695Z 2024-06-28T02:10:10.504047270Z [2024-06-28T02:10:10.503+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:10:10.504395723Z [2024-06-28T02:10:10.504+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:10:10.583488109Z [2024-06-28T02:10:10.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:05:00+00:00 exited with status queued for try_number 1 2024-06-28T02:10:10.583815080Z [2024-06-28T02:10:10.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:05:00+00:00 exited with status success for try_number 1 2024-06-28T02:10:10.591952640Z [2024-06-28T02:10:10.591+0000] {scheduler_job.py:635} INFO - Setting external_id for to e88880ef-4156-4b73-842f-a9c3c5bba83b 2024-06-28T02:10:10.592271729Z [2024-06-28T02:10:10.591+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T02:05:00+00:00, map_index=0, run_start_date=2024-06-28 02:10:08.631592+00:00, run_end_date=2024-06-28 02:10:10.216339+00:00, run_duration=1.584747, state=success, executor_state=success, try_number=1, max_tries=1, job_id=967, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:10:07.059475+00:00, queued_by_job_id=2, pid=14093 2024-06-28T02:10:12.855855829Z [2024-06-28T02:10:12.854+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:10:12.855888588Z [2024-06-28T02:10:12.854+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:05:00+00:00, run_id=scheduled__2024-06-28T02:05:00+00:00, run_start_date=2024-06-28 02:10:01.107644+00:00, run_end_date=2024-06-28 02:10:12.854844+00:00, run_duration=11.7472, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:05:00+00:00, data_interval_end=2024-06-28 02:10:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T02:10:12.864751551Z [2024-06-28T02:10:12.864+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:10:00+00:00, run_after=2024-06-28T02:15:00+00:00 2024-06-28T02:10:12.912112864Z [2024-06-28T02:10:12.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:05:00+00:00 exited with status success for try_number 1 2024-06-28T02:10:12.919134922Z [2024-06-28T02:10:12.918+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T02:05:00+00:00, map_index=-1, run_start_date=2024-06-28 02:10:12.147011+00:00, run_end_date=2024-06-28 02:10:12.493031+00:00, run_duration=0.34602, state=success, executor_state=success, try_number=1, max_tries=1, job_id=968, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:10:10.501084+00:00, queued_by_job_id=2, pid=14106 2024-06-28T02:11:00.583614868Z [2024-06-28T02:11:00.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:11:00+00:00, run_after=2024-06-28T02:12:00+00:00 2024-06-28T02:11:00.601539821Z [2024-06-28T02:11:00.601+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:11:00+00:00, run_after=2024-06-28T02:12:00+00:00 2024-06-28T02:11:00.610487849Z [2024-06-28T02:11:00.610+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:11:00.698327387Z [2024-06-28T02:11:00.697+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:11:00.698369662Z 2024-06-28T02:11:00.698376178Z 2024-06-28T02:11:00.698381757Z 2024-06-28T02:11:00.698652420Z [2024-06-28T02:11:00.698+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:11:00.699023984Z [2024-06-28T02:11:00.698+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:11:00.699326624Z [2024-06-28T02:11:00.699+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:11:00.700459946Z [2024-06-28T02:11:00.700+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:11:00.700478417Z 2024-06-28T02:11:00.700485364Z 2024-06-28T02:11:00.700491295Z 2024-06-28T02:11:00.705853389Z [2024-06-28T02:11:00.705+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:11:00.705871541Z [2024-06-28T02:11:00.705+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:11:00.706216294Z [2024-06-28T02:11:00.706+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:11:00.706415991Z [2024-06-28T02:11:00.706+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:11:00.706718703Z [2024-06-28T02:11:00.706+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:11:00.706929977Z [2024-06-28T02:11:00.706+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:11:00.960735249Z [2024-06-28T02:11:00.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:10:00+00:00 exited with status queued for try_number 1 2024-06-28T02:11:00.960999967Z [2024-06-28T02:11:00.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:10:00+00:00 exited with status queued for try_number 1 2024-06-28T02:11:00.961191957Z [2024-06-28T02:11:00.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:10:00+00:00 exited with status queued for try_number 1 2024-06-28T02:11:00.969402454Z [2024-06-28T02:11:00.969+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86894c54-f25a-4457-9eb4-7b7d462def90 2024-06-28T02:11:00.969646278Z [2024-06-28T02:11:00.969+0000] {scheduler_job.py:635} INFO - Setting external_id for to d95d11ef-3d93-48a1-b4a9-e460a20fba7c 2024-06-28T02:11:00.969891331Z [2024-06-28T02:11:00.969+0000] {scheduler_job.py:635} INFO - Setting external_id for to 143d6b76-e289-4bc3-b740-fa1616267a2e 2024-06-28T02:11:02.139288429Z [2024-06-28T02:11:02.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:11:02.139695207Z [2024-06-28T02:11:02.139+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:10:00+00:00, run_id=scheduled__2024-06-28T02:10:00+00:00, run_start_date=2024-06-28 02:11:00.623555+00:00, run_end_date=2024-06-28 02:11:02.139174+00:00, run_duration=1.515619, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:10:00+00:00, data_interval_end=2024-06-28 02:11:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:11:02.155234334Z [2024-06-28T02:11:02.154+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:11:00+00:00, run_after=2024-06-28T02:12:00+00:00 2024-06-28T02:11:02.220505956Z [2024-06-28T02:11:02.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:10:00+00:00 exited with status success for try_number 1 2024-06-28T02:11:02.226117983Z [2024-06-28T02:11:02.225+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:10:00+00:00, map_index=-1, run_start_date=2024-06-28 02:11:01.554780+00:00, run_end_date=2024-06-28 02:11:02.010264+00:00, run_duration=0.455484, state=success, executor_state=success, try_number=1, max_tries=1, job_id=969, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:11:00.702937+00:00, queued_by_job_id=2, pid=14128 2024-06-28T02:11:04.590343783Z [2024-06-28T02:11:04.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:11:04.590796226Z [2024-06-28T02:11:04.590+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:10:00+00:00, run_id=scheduled__2024-06-28T02:10:00+00:00, run_start_date=2024-06-28 02:11:00.625207+00:00, run_end_date=2024-06-28 02:11:04.590178+00:00, run_duration=3.964971, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:10:00+00:00, data_interval_end=2024-06-28 02:11:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:11:04.599612582Z [2024-06-28T02:11:04.599+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:11:00+00:00, run_after=2024-06-28T02:12:00+00:00 2024-06-28T02:11:04.663380397Z [2024-06-28T02:11:04.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:10:00+00:00 exited with status success for try_number 1 2024-06-28T02:11:04.667782273Z [2024-06-28T02:11:04.667+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:10:00+00:00, map_index=-1, run_start_date=2024-06-28 02:11:02.624506+00:00, run_end_date=2024-06-28 02:11:04.441082+00:00, run_duration=1.816576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=971, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:11:00.702937+00:00, queued_by_job_id=2, pid=14147 2024-06-28T02:11:05.732425397Z [2024-06-28T02:11:05.731+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:11:05.732713427Z [2024-06-28T02:11:05.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:10:00+00:00, run_id=scheduled__2024-06-28T02:10:00+00:00, run_start_date=2024-06-28 02:11:00.626448+00:00, run_end_date=2024-06-28 02:11:05.732190+00:00, run_duration=5.105742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:10:00+00:00, data_interval_end=2024-06-28 02:11:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:11:05.745884125Z [2024-06-28T02:11:05.745+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:11:00+00:00, run_after=2024-06-28T02:12:00+00:00 2024-06-28T02:11:05.795839957Z [2024-06-28T02:11:05.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:10:00+00:00 exited with status success for try_number 1 2024-06-28T02:11:05.801979113Z [2024-06-28T02:11:05.801+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:10:00+00:00, map_index=-1, run_start_date=2024-06-28 02:11:02.435876+00:00, run_end_date=2024-06-28 02:11:04.789300+00:00, run_duration=2.353424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=970, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:11:00.702937+00:00, queued_by_job_id=2, pid=14146 2024-06-28T02:11:47.249218837Z [2024-06-28T02:11:47.248+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T02:12:00.125605025Z [2024-06-28T02:12:00.125+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:12:00+00:00, run_after=2024-06-28T02:13:00+00:00 2024-06-28T02:12:00.141334026Z [2024-06-28T02:12:00.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:12:00+00:00, run_after=2024-06-28T02:13:00+00:00 2024-06-28T02:12:00.148800588Z [2024-06-28T02:12:00.148+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:12:00.157585369Z [2024-06-28T02:12:00.156+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:12:00.244449917Z [2024-06-28T02:12:00.243+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:12:00.244544191Z 2024-06-28T02:12:00.244551685Z 2024-06-28T02:12:00.244590156Z 2024-06-28T02:12:00.244595933Z 2024-06-28T02:12:00.244617323Z [2024-06-28T02:12:00.244+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:12:00.244760501Z [2024-06-28T02:12:00.244+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:12:00.244927734Z [2024-06-28T02:12:00.244+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:12:00.245088099Z [2024-06-28T02:12:00.244+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:12:00.245861166Z [2024-06-28T02:12:00.245+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:12:00.245883827Z 2024-06-28T02:12:00.245903700Z 2024-06-28T02:12:00.245913384Z 2024-06-28T02:12:00.245921620Z 2024-06-28T02:12:00.251335323Z [2024-06-28T02:12:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:12:00.251393102Z [2024-06-28T02:12:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:12:00.251701600Z [2024-06-28T02:12:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:12:00.251774370Z [2024-06-28T02:12:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:12:00.252072178Z [2024-06-28T02:12:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:12:00.252203992Z [2024-06-28T02:12:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:12:00.252477522Z [2024-06-28T02:12:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:12:00.252613951Z [2024-06-28T02:12:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:12:00.735311430Z [2024-06-28T02:12:00.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:10:00+00:00 exited with status queued for try_number 1 2024-06-28T02:12:00.735601667Z [2024-06-28T02:12:00.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:11:00+00:00 exited with status queued for try_number 1 2024-06-28T02:12:00.735845814Z [2024-06-28T02:12:00.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:11:00+00:00 exited with status queued for try_number 1 2024-06-28T02:12:00.736121598Z [2024-06-28T02:12:00.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:11:00+00:00 exited with status queued for try_number 1 2024-06-28T02:12:00.753537452Z [2024-06-28T02:12:00.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a4cb178-36a2-41a0-91d6-5abcce27fc6d 2024-06-28T02:12:00.753802745Z [2024-06-28T02:12:00.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to 258b5b23-4e46-458e-8a33-2392ecc000d6 2024-06-28T02:12:00.754044913Z [2024-06-28T02:12:00.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4253346f-8d31-4f5f-a324-e733e3e2b577 2024-06-28T02:12:00.754280127Z [2024-06-28T02:12:00.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to 544e4d35-0040-44bd-a179-39d77b6fd199 2024-06-28T02:12:01.933388481Z [2024-06-28T02:12:01.932+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:12:01.933868109Z [2024-06-28T02:12:01.933+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:10:00+00:00, run_id=scheduled__2024-06-28T02:10:00+00:00, run_start_date=2024-06-28 02:12:00.168698+00:00, run_end_date=2024-06-28 02:12:01.933487+00:00, run_duration=1.764789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:10:00+00:00, data_interval_end=2024-06-28 02:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:12:01.943558656Z [2024-06-28T02:12:01.943+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:12:00+00:00, run_after=2024-06-28T02:14:00+00:00 2024-06-28T02:12:01.954575022Z [2024-06-28T02:12:01.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:12:01.955245167Z [2024-06-28T02:12:01.954+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:11:00+00:00, run_id=scheduled__2024-06-28T02:11:00+00:00, run_start_date=2024-06-28 02:12:00.170188+00:00, run_end_date=2024-06-28 02:12:01.954736+00:00, run_duration=1.784548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:11:00+00:00, data_interval_end=2024-06-28 02:12:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:12:01.973657781Z [2024-06-28T02:12:01.973+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:12:00+00:00, run_after=2024-06-28T02:13:00+00:00 2024-06-28T02:12:02.033737645Z [2024-06-28T02:12:02.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:10:00+00:00 exited with status success for try_number 1 2024-06-28T02:12:02.034027423Z [2024-06-28T02:12:02.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:11:00+00:00 exited with status success for try_number 1 2024-06-28T02:12:02.042795689Z [2024-06-28T02:12:02.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:10:00+00:00, map_index=-1, run_start_date=2024-06-28 02:12:00.965914+00:00, run_end_date=2024-06-28 02:12:01.330613+00:00, run_duration=0.364699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=972, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:12:00.246925+00:00, queued_by_job_id=2, pid=14176 2024-06-28T02:12:02.043530718Z [2024-06-28T02:12:02.043+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:11:00+00:00, map_index=-1, run_start_date=2024-06-28 02:12:01.223056+00:00, run_end_date=2024-06-28 02:12:01.617212+00:00, run_duration=0.394156, state=success, executor_state=success, try_number=1, max_tries=1, job_id=973, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:12:00.246925+00:00, queued_by_job_id=2, pid=14184 2024-06-28T02:12:04.234477633Z [2024-06-28T02:12:04.233+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:12:04.234817491Z [2024-06-28T02:12:04.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:11:00+00:00, run_id=scheduled__2024-06-28T02:11:00+00:00, run_start_date=2024-06-28 02:12:00.171566+00:00, run_end_date=2024-06-28 02:12:04.234372+00:00, run_duration=4.062806, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:11:00+00:00, data_interval_end=2024-06-28 02:12:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:12:04.250029018Z [2024-06-28T02:12:04.249+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:12:00+00:00, run_after=2024-06-28T02:13:00+00:00 2024-06-28T02:12:04.294579983Z [2024-06-28T02:12:04.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:11:00+00:00 exited with status success for try_number 1 2024-06-28T02:12:04.306199244Z [2024-06-28T02:12:04.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:11:00+00:00, map_index=-1, run_start_date=2024-06-28 02:12:02.372271+00:00, run_end_date=2024-06-28 02:12:03.819930+00:00, run_duration=1.447659, state=success, executor_state=success, try_number=1, max_tries=1, job_id=975, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:12:00.246925+00:00, queued_by_job_id=2, pid=14206 2024-06-28T02:12:05.832657275Z [2024-06-28T02:12:05.831+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:12:05.833376383Z [2024-06-28T02:12:05.832+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:11:00+00:00, run_id=scheduled__2024-06-28T02:11:00+00:00, run_start_date=2024-06-28 02:12:00.172784+00:00, run_end_date=2024-06-28 02:12:05.832616+00:00, run_duration=5.659832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:11:00+00:00, data_interval_end=2024-06-28 02:12:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:12:05.855025054Z [2024-06-28T02:12:05.854+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:12:00+00:00, run_after=2024-06-28T02:13:00+00:00 2024-06-28T02:12:05.895181618Z [2024-06-28T02:12:05.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:11:00+00:00 exited with status success for try_number 1 2024-06-28T02:12:05.900482989Z [2024-06-28T02:12:05.900+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:11:00+00:00, map_index=-1, run_start_date=2024-06-28 02:12:02.287321+00:00, run_end_date=2024-06-28 02:12:05.542402+00:00, run_duration=3.255081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=974, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:12:00.246925+00:00, queued_by_job_id=2, pid=14205 2024-06-28T02:13:00.534251584Z [2024-06-28T02:13:00.533+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:13:00+00:00, run_after=2024-06-28T02:14:00+00:00 2024-06-28T02:13:00.541636330Z [2024-06-28T02:13:00.541+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:13:00.555323712Z [2024-06-28T02:13:00.554+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:13:00+00:00, run_after=2024-06-28T02:14:00+00:00 2024-06-28T02:13:00.641964119Z [2024-06-28T02:13:00.641+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:13:00.641992656Z 2024-06-28T02:13:00.641998054Z 2024-06-28T02:13:00.642002818Z 2024-06-28T02:13:00.642154752Z [2024-06-28T02:13:00.641+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:13:00.642353047Z [2024-06-28T02:13:00.642+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:13:00.642541077Z [2024-06-28T02:13:00.642+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:13:00.643358156Z [2024-06-28T02:13:00.643+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:13:00.643374648Z 2024-06-28T02:13:00.643379868Z 2024-06-28T02:13:00.643384724Z 2024-06-28T02:13:00.649335017Z [2024-06-28T02:13:00.649+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:13:00.649875977Z [2024-06-28T02:13:00.649+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:13:00.650291385Z [2024-06-28T02:13:00.650+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:13:00.650464822Z [2024-06-28T02:13:00.650+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:13:00.650879629Z [2024-06-28T02:13:00.650+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:13:00.651108620Z [2024-06-28T02:13:00.650+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:13:00.986478502Z [2024-06-28T02:13:00.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:12:00+00:00 exited with status queued for try_number 1 2024-06-28T02:13:00.986557182Z [2024-06-28T02:13:00.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:12:00+00:00 exited with status queued for try_number 1 2024-06-28T02:13:00.986565114Z [2024-06-28T02:13:00.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:12:00+00:00 exited with status queued for try_number 1 2024-06-28T02:13:00.997066302Z [2024-06-28T02:13:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee26dd41-bfbc-4ce6-a39e-f93c1ed55044 2024-06-28T02:13:00.997160033Z [2024-06-28T02:13:00.997+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8da58649-675b-4421-9290-8cb84d9b5777 2024-06-28T02:13:00.997297337Z [2024-06-28T02:13:00.997+0000] {scheduler_job.py:635} INFO - Setting external_id for to bea02166-53d1-4c54-8dc8-87932db4c0ee 2024-06-28T02:13:02.978139005Z [2024-06-28T02:13:02.977+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:13:02.978662097Z [2024-06-28T02:13:02.978+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:12:00+00:00, run_id=scheduled__2024-06-28T02:12:00+00:00, run_start_date=2024-06-28 02:13:00.570083+00:00, run_end_date=2024-06-28 02:13:02.978287+00:00, run_duration=2.408204, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:12:00+00:00, data_interval_end=2024-06-28 02:13:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:13:02.999202595Z [2024-06-28T02:13:02.998+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:13:00+00:00, run_after=2024-06-28T02:14:00+00:00 2024-06-28T02:13:03.069964720Z [2024-06-28T02:13:03.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:12:00+00:00 exited with status success for try_number 1 2024-06-28T02:13:03.077070126Z [2024-06-28T02:13:03.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:12:00+00:00, map_index=-1, run_start_date=2024-06-28 02:13:01.527811+00:00, run_end_date=2024-06-28 02:13:01.959459+00:00, run_duration=0.431648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=976, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:13:00.644641+00:00, queued_by_job_id=2, pid=14238 2024-06-28T02:13:04.159988085Z [2024-06-28T02:13:04.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:13:04.160487193Z [2024-06-28T02:13:04.160+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:12:00+00:00, run_id=scheduled__2024-06-28T02:12:00+00:00, run_start_date=2024-06-28 02:13:00.571474+00:00, run_end_date=2024-06-28 02:13:04.160135+00:00, run_duration=3.588661, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:12:00+00:00, data_interval_end=2024-06-28 02:13:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:13:04.171333478Z [2024-06-28T02:13:04.170+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:13:00+00:00, run_after=2024-06-28T02:14:00+00:00 2024-06-28T02:13:05.411677756Z [2024-06-28T02:13:05.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:12:00+00:00 exited with status success for try_number 1 2024-06-28T02:13:05.420609058Z [2024-06-28T02:13:05.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:12:00+00:00, map_index=-1, run_start_date=2024-06-28 02:13:02.533843+00:00, run_end_date=2024-06-28 02:13:04.121398+00:00, run_duration=1.587555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=977, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:13:00.644641+00:00, queued_by_job_id=2, pid=14251 2024-06-28T02:13:06.477627888Z [2024-06-28T02:13:06.477+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:13:06.478153737Z [2024-06-28T02:13:06.477+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:12:00+00:00, run_id=scheduled__2024-06-28T02:12:00+00:00, run_start_date=2024-06-28 02:13:00.572599+00:00, run_end_date=2024-06-28 02:13:06.477833+00:00, run_duration=5.905234, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:12:00+00:00, data_interval_end=2024-06-28 02:13:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:13:06.491969449Z [2024-06-28T02:13:06.491+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:13:00+00:00, run_after=2024-06-28T02:14:00+00:00 2024-06-28T02:13:06.535119024Z [2024-06-28T02:13:06.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:12:00+00:00 exited with status success for try_number 1 2024-06-28T02:13:06.542062568Z [2024-06-28T02:13:06.541+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:12:00+00:00, map_index=-1, run_start_date=2024-06-28 02:13:02.765018+00:00, run_end_date=2024-06-28 02:13:05.334218+00:00, run_duration=2.5692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=978, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:13:00.644641+00:00, queued_by_job_id=2, pid=14257 2024-06-28T02:14:00.961874354Z [2024-06-28T02:14:00.961+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:14:00.991144995Z [2024-06-28T02:14:00.990+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:14:00+00:00, run_after=2024-06-28T02:15:00+00:00 2024-06-28T02:14:01.020521295Z [2024-06-28T02:14:01.020+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:14:01.037690895Z [2024-06-28T02:14:01.037+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:14:00+00:00, run_after=2024-06-28T02:15:00+00:00 2024-06-28T02:14:01.143791193Z [2024-06-28T02:14:01.143+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:14:01.143830280Z 2024-06-28T02:14:01.143839854Z 2024-06-28T02:14:01.143846704Z 2024-06-28T02:14:01.143853367Z 2024-06-28T02:14:01.143873060Z [2024-06-28T02:14:01.143+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:14:01.144001993Z [2024-06-28T02:14:01.143+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:14:01.144150180Z [2024-06-28T02:14:01.143+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:14:01.144285339Z [2024-06-28T02:14:01.144+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:14:01.145570762Z [2024-06-28T02:14:01.145+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:14:01.145584573Z 2024-06-28T02:14:01.145591729Z 2024-06-28T02:14:01.145598567Z 2024-06-28T02:14:01.145605712Z 2024-06-28T02:14:01.153010929Z [2024-06-28T02:14:01.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:14:01.153063964Z [2024-06-28T02:14:01.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:14:01.153272559Z [2024-06-28T02:14:01.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:14:01.153297737Z [2024-06-28T02:14:01.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:14:01.153633175Z [2024-06-28T02:14:01.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:14:01.153658286Z [2024-06-28T02:14:01.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:14:01.153903347Z [2024-06-28T02:14:01.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:14:01.153928663Z [2024-06-28T02:14:01.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:14:01.674226962Z [2024-06-28T02:14:01.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:12:00+00:00 exited with status queued for try_number 1 2024-06-28T02:14:01.674312591Z [2024-06-28T02:14:01.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:13:00+00:00 exited with status queued for try_number 1 2024-06-28T02:14:01.674321188Z [2024-06-28T02:14:01.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:13:00+00:00 exited with status queued for try_number 1 2024-06-28T02:14:01.674380118Z [2024-06-28T02:14:01.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:13:00+00:00 exited with status queued for try_number 1 2024-06-28T02:14:01.699272068Z [2024-06-28T02:14:01.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f7026f8-5a27-43ec-82f7-bdff42b06445 2024-06-28T02:14:01.699341366Z [2024-06-28T02:14:01.699+0000] {scheduler_job.py:635} INFO - Setting external_id for to 356b8cf8-89ef-470d-929f-f6b524edc6a9 2024-06-28T02:14:01.699441268Z [2024-06-28T02:14:01.699+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9cc7264-d84d-4551-89ea-c98456290a9a 2024-06-28T02:14:01.699536504Z [2024-06-28T02:14:01.699+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96e1ca54-78b6-4748-858f-8b29bc12f15b 2024-06-28T02:14:02.874948793Z [2024-06-28T02:14:02.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:14:02.875193911Z [2024-06-28T02:14:02.875+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:12:00+00:00, run_id=scheduled__2024-06-28T02:12:00+00:00, run_start_date=2024-06-28 02:14:01.049969+00:00, run_end_date=2024-06-28 02:14:02.874874+00:00, run_duration=1.824905, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:12:00+00:00, data_interval_end=2024-06-28 02:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:14:02.884534762Z [2024-06-28T02:14:02.884+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:14:00+00:00, run_after=2024-06-28T02:16:00+00:00 2024-06-28T02:14:02.891476764Z [2024-06-28T02:14:02.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:14:02.891633311Z [2024-06-28T02:14:02.891+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:13:00+00:00, run_id=scheduled__2024-06-28T02:13:00+00:00, run_start_date=2024-06-28 02:14:01.051199+00:00, run_end_date=2024-06-28 02:14:02.891389+00:00, run_duration=1.84019, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:13:00+00:00, data_interval_end=2024-06-28 02:14:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:14:02.901282571Z [2024-06-28T02:14:02.900+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:14:00+00:00, run_after=2024-06-28T02:15:00+00:00 2024-06-28T02:14:02.972576225Z [2024-06-28T02:14:02.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:12:00+00:00 exited with status success for try_number 1 2024-06-28T02:14:02.972729684Z [2024-06-28T02:14:02.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:13:00+00:00 exited with status success for try_number 1 2024-06-28T02:14:02.982471946Z [2024-06-28T02:14:02.982+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:12:00+00:00, map_index=-1, run_start_date=2024-06-28 02:14:02.190747+00:00, run_end_date=2024-06-28 02:14:02.724272+00:00, run_duration=0.533525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=979, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:14:01.146967+00:00, queued_by_job_id=2, pid=14290 2024-06-28T02:14:02.982652937Z [2024-06-28T02:14:02.982+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:13:00+00:00, map_index=-1, run_start_date=2024-06-28 02:14:02.252159+00:00, run_end_date=2024-06-28 02:14:02.673384+00:00, run_duration=0.421225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=980, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:14:01.146967+00:00, queued_by_job_id=2, pid=14291 2024-06-28T02:14:06.314248797Z [2024-06-28T02:14:06.313+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:14:06.314558932Z [2024-06-28T02:14:06.314+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:13:00+00:00, run_id=scheduled__2024-06-28T02:13:00+00:00, run_start_date=2024-06-28 02:14:01.053268+00:00, run_end_date=2024-06-28 02:14:06.314100+00:00, run_duration=5.260832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:13:00+00:00, data_interval_end=2024-06-28 02:14:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:14:06.332853142Z [2024-06-28T02:14:06.332+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:14:00+00:00, run_after=2024-06-28T02:15:00+00:00 2024-06-28T02:14:06.344873338Z [2024-06-28T02:14:06.344+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:14:06.345136996Z [2024-06-28T02:14:06.344+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:13:00+00:00, run_id=scheduled__2024-06-28T02:13:00+00:00, run_start_date=2024-06-28 02:14:01.055297+00:00, run_end_date=2024-06-28 02:14:06.344770+00:00, run_duration=5.289473, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:13:00+00:00, data_interval_end=2024-06-28 02:14:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:14:06.354850570Z [2024-06-28T02:14:06.354+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:14:00+00:00, run_after=2024-06-28T02:15:00+00:00 2024-06-28T02:14:06.394764879Z [2024-06-28T02:14:06.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:13:00+00:00 exited with status success for try_number 1 2024-06-28T02:14:06.394780800Z [2024-06-28T02:14:06.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:13:00+00:00 exited with status success for try_number 1 2024-06-28T02:14:06.410805801Z [2024-06-28T02:14:06.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:13:00+00:00, map_index=-1, run_start_date=2024-06-28 02:14:03.446076+00:00, run_end_date=2024-06-28 02:14:05.409305+00:00, run_duration=1.963229, state=success, executor_state=success, try_number=1, max_tries=1, job_id=981, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:14:01.146967+00:00, queued_by_job_id=2, pid=14314 2024-06-28T02:14:06.410840473Z [2024-06-28T02:14:06.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:13:00+00:00, map_index=-1, run_start_date=2024-06-28 02:14:03.601430+00:00, run_end_date=2024-06-28 02:14:05.801684+00:00, run_duration=2.200254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=982, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:14:01.146967+00:00, queued_by_job_id=2, pid=14315 2024-06-28T02:15:00.303584937Z [2024-06-28T02:15:00.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:15:00+00:00, run_after=2024-06-28T02:20:00+00:00 2024-06-28T02:15:00.315811480Z [2024-06-28T02:15:00.315+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:15:00+00:00, run_after=2024-06-28T02:16:00+00:00 2024-06-28T02:15:00.322562441Z [2024-06-28T02:15:00.322+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:15:00.334386246Z [2024-06-28T02:15:00.334+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:15:00+00:00, run_after=2024-06-28T02:16:00+00:00 2024-06-28T02:15:00.462898892Z [2024-06-28T02:15:00.462+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:15:00.462961599Z 2024-06-28T02:15:00.462976983Z 2024-06-28T02:15:00.462992581Z 2024-06-28T02:15:00.463007999Z 2024-06-28T02:15:00.463688537Z [2024-06-28T02:15:00.463+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:15:00.464175274Z [2024-06-28T02:15:00.463+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:15:00.464881100Z [2024-06-28T02:15:00.464+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:15:00.465490610Z [2024-06-28T02:15:00.465+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:15:00.467135581Z [2024-06-28T02:15:00.466+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:15:00.467181975Z 2024-06-28T02:15:00.467190290Z 2024-06-28T02:15:00.467196920Z 2024-06-28T02:15:00.467228923Z 2024-06-28T02:15:00.473742172Z [2024-06-28T02:15:00.473+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T02:15:00.474069126Z [2024-06-28T02:15:00.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:15:00.474569959Z [2024-06-28T02:15:00.474+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:15:00.474908238Z [2024-06-28T02:15:00.474+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:15:00.475342703Z [2024-06-28T02:15:00.475+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:15:00.475583153Z [2024-06-28T02:15:00.475+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:15:00.476053583Z [2024-06-28T02:15:00.475+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:15:00.476189841Z [2024-06-28T02:15:00.475+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:15:00.774342119Z [2024-06-28T02:15:00.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:10:00+00:00 exited with status queued for try_number 1 2024-06-28T02:15:00.775216786Z [2024-06-28T02:15:00.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:14:00+00:00 exited with status queued for try_number 1 2024-06-28T02:15:00.775347605Z [2024-06-28T02:15:00.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:14:00+00:00 exited with status queued for try_number 1 2024-06-28T02:15:00.775609475Z [2024-06-28T02:15:00.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:14:00+00:00 exited with status queued for try_number 1 2024-06-28T02:15:00.784791292Z [2024-06-28T02:15:00.784+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8246c6d6-1abd-44d3-9b10-d7baa738ee5c 2024-06-28T02:15:00.785118797Z [2024-06-28T02:15:00.784+0000] {scheduler_job.py:635} INFO - Setting external_id for to 821a2fb5-c335-438c-bb64-63e9a5b7f161 2024-06-28T02:15:00.785341712Z [2024-06-28T02:15:00.785+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5a448cd-182d-4f65-b12a-783e656496db 2024-06-28T02:15:00.785570108Z [2024-06-28T02:15:00.785+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2ce3043-83e3-4b99-9cf4-8bc50e28fd84 2024-06-28T02:15:03.212766927Z [2024-06-28T02:15:03.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:15:03.213078199Z [2024-06-28T02:15:03.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:14:00+00:00, run_id=scheduled__2024-06-28T02:14:00+00:00, run_start_date=2024-06-28 02:15:00.350999+00:00, run_end_date=2024-06-28 02:15:03.212599+00:00, run_duration=2.8616, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:14:00+00:00, data_interval_end=2024-06-28 02:15:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:15:03.224180788Z [2024-06-28T02:15:03.223+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:15:00+00:00, run_after=2024-06-28T02:16:00+00:00 2024-06-28T02:15:03.306294844Z [2024-06-28T02:15:03.305+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:15:03.306342584Z 2024-06-28T02:15:03.306480841Z [2024-06-28T02:15:03.306+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:15:03.307196932Z [2024-06-28T02:15:03.306+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:15:03.307223939Z 2024-06-28T02:15:03.309996827Z [2024-06-28T02:15:03.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T02:15:03.310299187Z [2024-06-28T02:15:03.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:15:03.387565052Z [2024-06-28T02:15:03.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:10:00+00:00 exited with status queued for try_number 1 2024-06-28T02:15:03.387814024Z [2024-06-28T02:15:03.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:10:00+00:00 exited with status success for try_number 1 2024-06-28T02:15:03.388026028Z [2024-06-28T02:15:03.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:14:00+00:00 exited with status success for try_number 1 2024-06-28T02:15:03.397419911Z [2024-06-28T02:15:03.397+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T02:10:00+00:00, map_index=-1, run_start_date=2024-06-28 02:15:02.688737+00:00, run_end_date=2024-06-28 02:15:02.991133+00:00, run_duration=0.302396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=986, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:15:00.468713+00:00, queued_by_job_id=2, pid=14374 2024-06-28T02:15:03.397776802Z [2024-06-28T02:15:03.397+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70b2b17f-95b9-45a0-b75e-0578e68553dc 2024-06-28T02:15:03.398048880Z [2024-06-28T02:15:03.397+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:14:00+00:00, map_index=-1, run_start_date=2024-06-28 02:15:01.707804+00:00, run_end_date=2024-06-28 02:15:02.206409+00:00, run_duration=0.498605, state=success, executor_state=success, try_number=1, max_tries=1, job_id=983, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:15:00.468713+00:00, queued_by_job_id=2, pid=14350 2024-06-28T02:15:05.168896343Z [2024-06-28T02:15:05.168+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:15:05.169299744Z [2024-06-28T02:15:05.169+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:14:00+00:00, run_id=scheduled__2024-06-28T02:14:00+00:00, run_start_date=2024-06-28 02:15:00.352420+00:00, run_end_date=2024-06-28 02:15:05.168822+00:00, run_duration=4.816402, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:14:00+00:00, data_interval_end=2024-06-28 02:15:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:15:05.180441687Z [2024-06-28T02:15:05.180+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:15:00+00:00, run_after=2024-06-28T02:16:00+00:00 2024-06-28T02:15:05.252614902Z [2024-06-28T02:15:05.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:14:00+00:00 exited with status success for try_number 1 2024-06-28T02:15:05.252660688Z [2024-06-28T02:15:05.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:14:00+00:00 exited with status success for try_number 1 2024-06-28T02:15:05.259535554Z [2024-06-28T02:15:05.259+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:14:00+00:00, map_index=-1, run_start_date=2024-06-28 02:15:02.660694+00:00, run_end_date=2024-06-28 02:15:04.316802+00:00, run_duration=1.656108, state=success, executor_state=success, try_number=1, max_tries=1, job_id=985, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:15:00.468713+00:00, queued_by_job_id=2, pid=14373 2024-06-28T02:15:05.259646372Z [2024-06-28T02:15:05.259+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:14:00+00:00, map_index=-1, run_start_date=2024-06-28 02:15:02.628067+00:00, run_end_date=2024-06-28 02:15:05.013802+00:00, run_duration=2.385735, state=success, executor_state=success, try_number=1, max_tries=1, job_id=984, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:15:00.468713+00:00, queued_by_job_id=2, pid=14372 2024-06-28T02:15:06.311977934Z [2024-06-28T02:15:06.311+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:15:06.312671429Z [2024-06-28T02:15:06.312+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:14:00+00:00, run_id=scheduled__2024-06-28T02:14:00+00:00, run_start_date=2024-06-28 02:15:00.353976+00:00, run_end_date=2024-06-28 02:15:06.311885+00:00, run_duration=5.957909, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:14:00+00:00, data_interval_end=2024-06-28 02:15:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:15:06.322160340Z [2024-06-28T02:15:06.321+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:15:00+00:00, run_after=2024-06-28T02:16:00+00:00 2024-06-28T02:15:06.361086287Z [2024-06-28T02:15:06.360+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:15:06.361109675Z 2024-06-28T02:15:06.361397250Z [2024-06-28T02:15:06.361+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:15:06.362091546Z [2024-06-28T02:15:06.361+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:15:06.362103203Z 2024-06-28T02:15:06.365123003Z [2024-06-28T02:15:06.364+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T02:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T02:15:06.365400013Z [2024-06-28T02:15:06.365+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T02:15:06.470661532Z [2024-06-28T02:15:06.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:10:00+00:00 exited with status queued for try_number 1 2024-06-28T02:15:06.470939126Z [2024-06-28T02:15:06.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:10:00+00:00 exited with status success for try_number 1 2024-06-28T02:15:06.489229733Z [2024-06-28T02:15:06.488+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7028d024-77c1-4d61-9377-3b97f966e94e 2024-06-28T02:15:06.489678197Z [2024-06-28T02:15:06.489+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T02:10:00+00:00, map_index=-1, run_start_date=2024-06-28 02:15:05.360201+00:00, run_end_date=2024-06-28 02:15:05.827848+00:00, run_duration=0.467647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=987, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:15:03.307587+00:00, queued_by_job_id=2, pid=14397 2024-06-28T02:15:10.360857374Z [2024-06-28T02:15:10.360+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:15:10.360914278Z 2024-06-28T02:15:10.361157359Z [2024-06-28T02:15:10.360+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:15:10.361998040Z [2024-06-28T02:15:10.361+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:15:10.362042619Z 2024-06-28T02:15:10.365229928Z [2024-06-28T02:15:10.364+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:15:10.365555790Z [2024-06-28T02:15:10.365+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:15:10.447137523Z [2024-06-28T02:15:10.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:10:00+00:00 exited with status queued for try_number 1 2024-06-28T02:15:10.447238897Z [2024-06-28T02:15:10.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:10:00+00:00 exited with status success for try_number 1 2024-06-28T02:15:10.454025184Z [2024-06-28T02:15:10.453+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2feac86-1374-4e4f-9714-e9a1d48a718a 2024-06-28T02:15:10.454495302Z [2024-06-28T02:15:10.454+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T02:10:00+00:00, map_index=0, run_start_date=2024-06-28 02:15:08.090521+00:00, run_end_date=2024-06-28 02:15:09.504296+00:00, run_duration=1.413775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=988, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:15:06.362620+00:00, queued_by_job_id=2, pid=14405 2024-06-28T02:15:13.003409833Z [2024-06-28T02:15:13.002+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:15:13.003863629Z [2024-06-28T02:15:13.003+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:10:00+00:00, run_id=scheduled__2024-06-28T02:10:00+00:00, run_start_date=2024-06-28 02:15:00.349012+00:00, run_end_date=2024-06-28 02:15:13.003227+00:00, run_duration=12.654215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:10:00+00:00, data_interval_end=2024-06-28 02:15:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T02:15:13.012167434Z [2024-06-28T02:15:13.011+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:15:00+00:00, run_after=2024-06-28T02:20:00+00:00 2024-06-28T02:15:13.059861254Z [2024-06-28T02:15:13.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:10:00+00:00 exited with status success for try_number 1 2024-06-28T02:15:13.065344644Z [2024-06-28T02:15:13.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T02:10:00+00:00, map_index=-1, run_start_date=2024-06-28 02:15:12.058044+00:00, run_end_date=2024-06-28 02:15:12.462036+00:00, run_duration=0.403992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=989, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:15:10.362493+00:00, queued_by_job_id=2, pid=14418 2024-06-28T02:16:00.169745237Z [2024-06-28T02:16:00.169+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:16:00+00:00, run_after=2024-06-28T02:17:00+00:00 2024-06-28T02:16:00.184423832Z [2024-06-28T02:16:00.183+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:16:00+00:00, run_after=2024-06-28T02:17:00+00:00 2024-06-28T02:16:00.192475758Z [2024-06-28T02:16:00.192+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:16:00.206582732Z [2024-06-28T02:16:00.206+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:16:00.274170824Z [2024-06-28T02:16:00.273+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:16:00.274216270Z 2024-06-28T02:16:00.274227495Z 2024-06-28T02:16:00.274236354Z 2024-06-28T02:16:00.274244891Z 2024-06-28T02:16:00.274832895Z [2024-06-28T02:16:00.274+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:16:00.275106187Z [2024-06-28T02:16:00.274+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:16:00.275474849Z [2024-06-28T02:16:00.275+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:16:00.275897722Z [2024-06-28T02:16:00.275+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:16:00.277410698Z [2024-06-28T02:16:00.276+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:16:00.277442845Z 2024-06-28T02:16:00.277457227Z 2024-06-28T02:16:00.277470828Z 2024-06-28T02:16:00.277490107Z 2024-06-28T02:16:00.286022183Z [2024-06-28T02:16:00.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:16:00.286538786Z [2024-06-28T02:16:00.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:16:00.287165029Z [2024-06-28T02:16:00.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:16:00.287468492Z [2024-06-28T02:16:00.287+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:16:00.287997095Z [2024-06-28T02:16:00.287+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:16:00.288299709Z [2024-06-28T02:16:00.287+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:16:00.288803783Z [2024-06-28T02:16:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:16:00.289168490Z [2024-06-28T02:16:00.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:16:00.710753862Z [2024-06-28T02:16:00.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:14:00+00:00 exited with status queued for try_number 1 2024-06-28T02:16:00.710793313Z [2024-06-28T02:16:00.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:15:00+00:00 exited with status queued for try_number 1 2024-06-28T02:16:00.710971995Z [2024-06-28T02:16:00.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:15:00+00:00 exited with status queued for try_number 1 2024-06-28T02:16:00.711113911Z [2024-06-28T02:16:00.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:15:00+00:00 exited with status queued for try_number 1 2024-06-28T02:16:00.732261336Z [2024-06-28T02:16:00.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to acca9ac5-aa26-4dba-ad12-6ec05fe1431b 2024-06-28T02:16:00.732534945Z [2024-06-28T02:16:00.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97614d41-dee9-46ed-bfab-ff4fa5821a12 2024-06-28T02:16:00.732738321Z [2024-06-28T02:16:00.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1423699-88f9-433c-b260-7a2095248c29 2024-06-28T02:16:00.732915126Z [2024-06-28T02:16:00.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6664ad1f-446e-4c68-ad4f-5c1593cc3413 2024-06-28T02:16:02.368200198Z [2024-06-28T02:16:02.367+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:16:02.368459424Z [2024-06-28T02:16:02.368+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:14:00+00:00, run_id=scheduled__2024-06-28T02:14:00+00:00, run_start_date=2024-06-28 02:16:00.217574+00:00, run_end_date=2024-06-28 02:16:02.368135+00:00, run_duration=2.150561, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:14:00+00:00, data_interval_end=2024-06-28 02:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:16:02.375276971Z [2024-06-28T02:16:02.375+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:16:00+00:00, run_after=2024-06-28T02:18:00+00:00 2024-06-28T02:16:02.381297743Z [2024-06-28T02:16:02.381+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:16:02.381468937Z [2024-06-28T02:16:02.381+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:15:00+00:00, run_id=scheduled__2024-06-28T02:15:00+00:00, run_start_date=2024-06-28 02:16:00.218735+00:00, run_end_date=2024-06-28 02:16:02.381240+00:00, run_duration=2.162505, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:15:00+00:00, data_interval_end=2024-06-28 02:16:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:16:02.390131516Z [2024-06-28T02:16:02.389+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:16:00+00:00, run_after=2024-06-28T02:17:00+00:00 2024-06-28T02:16:02.431698335Z [2024-06-28T02:16:02.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:14:00+00:00 exited with status success for try_number 1 2024-06-28T02:16:02.431750811Z [2024-06-28T02:16:02.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:15:00+00:00 exited with status success for try_number 1 2024-06-28T02:16:02.444351843Z [2024-06-28T02:16:02.444+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:14:00+00:00, map_index=-1, run_start_date=2024-06-28 02:16:01.079755+00:00, run_end_date=2024-06-28 02:16:01.513330+00:00, run_duration=0.433575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=990, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:16:00.281084+00:00, queued_by_job_id=2, pid=14441 2024-06-28T02:16:02.444640338Z [2024-06-28T02:16:02.444+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:15:00+00:00, map_index=-1, run_start_date=2024-06-28 02:16:01.173658+00:00, run_end_date=2024-06-28 02:16:01.632728+00:00, run_duration=0.45907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=991, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:16:00.281084+00:00, queued_by_job_id=2, pid=14442 2024-06-28T02:16:04.596104188Z [2024-06-28T02:16:04.595+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:16:04.596506363Z [2024-06-28T02:16:04.596+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:15:00+00:00, run_id=scheduled__2024-06-28T02:15:00+00:00, run_start_date=2024-06-28 02:16:00.220471+00:00, run_end_date=2024-06-28 02:16:04.596172+00:00, run_duration=4.375701, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:15:00+00:00, data_interval_end=2024-06-28 02:16:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:16:04.608305011Z [2024-06-28T02:16:04.607+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:16:00+00:00, run_after=2024-06-28T02:17:00+00:00 2024-06-28T02:16:04.617157323Z [2024-06-28T02:16:04.616+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:16:04.617513640Z [2024-06-28T02:16:04.617+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:15:00+00:00, run_id=scheduled__2024-06-28T02:15:00+00:00, run_start_date=2024-06-28 02:16:00.219625+00:00, run_end_date=2024-06-28 02:16:04.617069+00:00, run_duration=4.397444, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:15:00+00:00, data_interval_end=2024-06-28 02:16:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:16:04.628410384Z [2024-06-28T02:16:04.628+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:16:00+00:00, run_after=2024-06-28T02:17:00+00:00 2024-06-28T02:16:04.684315342Z [2024-06-28T02:16:04.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:15:00+00:00 exited with status success for try_number 1 2024-06-28T02:16:04.685268424Z [2024-06-28T02:16:04.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:15:00+00:00 exited with status success for try_number 1 2024-06-28T02:16:04.703122502Z [2024-06-28T02:16:04.702+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:15:00+00:00, map_index=-1, run_start_date=2024-06-28 02:16:02.362029+00:00, run_end_date=2024-06-28 02:16:03.669754+00:00, run_duration=1.307725, state=success, executor_state=success, try_number=1, max_tries=1, job_id=992, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:16:00.281084+00:00, queued_by_job_id=2, pid=14465 2024-06-28T02:16:04.703436890Z [2024-06-28T02:16:04.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:15:00+00:00, map_index=-1, run_start_date=2024-06-28 02:16:02.401179+00:00, run_end_date=2024-06-28 02:16:04.104069+00:00, run_duration=1.70289, state=success, executor_state=success, try_number=1, max_tries=1, job_id=993, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:16:00.281084+00:00, queued_by_job_id=2, pid=14466 2024-06-28T02:16:47.336892152Z [2024-06-28T02:16:47.336+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T02:17:00.489445707Z [2024-06-28T02:17:00.488+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:17:00.520849590Z [2024-06-28T02:17:00.520+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:17:00+00:00, run_after=2024-06-28T02:18:00+00:00 2024-06-28T02:17:00.534974506Z [2024-06-28T02:17:00.534+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:17:00+00:00, run_after=2024-06-28T02:18:00+00:00 2024-06-28T02:17:00.596342394Z [2024-06-28T02:17:00.595+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:17:00.596375482Z 2024-06-28T02:17:00.596379929Z 2024-06-28T02:17:00.596383365Z 2024-06-28T02:17:00.596556805Z [2024-06-28T02:17:00.596+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:17:00.596904127Z [2024-06-28T02:17:00.596+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:17:00.597296213Z [2024-06-28T02:17:00.596+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:17:00.601822250Z [2024-06-28T02:17:00.601+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:17:00.601855295Z 2024-06-28T02:17:00.601860230Z 2024-06-28T02:17:00.601864569Z 2024-06-28T02:17:00.610230154Z [2024-06-28T02:17:00.607+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:17:00.610343436Z [2024-06-28T02:17:00.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:17:00.610857208Z [2024-06-28T02:17:00.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:17:00.611019558Z [2024-06-28T02:17:00.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:17:00.611290416Z [2024-06-28T02:17:00.611+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:17:00.611366996Z [2024-06-28T02:17:00.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:17:00.933239466Z [2024-06-28T02:17:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:16:00+00:00 exited with status queued for try_number 1 2024-06-28T02:17:00.933473051Z [2024-06-28T02:17:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:16:00+00:00 exited with status queued for try_number 1 2024-06-28T02:17:00.933719583Z [2024-06-28T02:17:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:16:00+00:00 exited with status queued for try_number 1 2024-06-28T02:17:00.946980591Z [2024-06-28T02:17:00.946+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58bb3064-4ab0-439c-8dad-83a74c98e0fe 2024-06-28T02:17:00.947300434Z [2024-06-28T02:17:00.947+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f7af763-da4d-4a71-9608-7e56f968c9b1 2024-06-28T02:17:00.947507419Z [2024-06-28T02:17:00.947+0000] {scheduler_job.py:635} INFO - Setting external_id for to b613be55-32aa-4d53-b068-64eaa252ccdb 2024-06-28T02:17:02.839240013Z [2024-06-28T02:17:02.838+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:17:02.839443614Z [2024-06-28T02:17:02.839+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:16:00+00:00, run_id=scheduled__2024-06-28T02:16:00+00:00, run_start_date=2024-06-28 02:17:00.545736+00:00, run_end_date=2024-06-28 02:17:02.839104+00:00, run_duration=2.293368, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:16:00+00:00, data_interval_end=2024-06-28 02:17:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:17:02.849680860Z [2024-06-28T02:17:02.849+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:17:00+00:00, run_after=2024-06-28T02:18:00+00:00 2024-06-28T02:17:02.906916655Z [2024-06-28T02:17:02.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:16:00+00:00 exited with status success for try_number 1 2024-06-28T02:17:02.912823759Z [2024-06-28T02:17:02.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:16:00+00:00, map_index=-1, run_start_date=2024-06-28 02:17:01.491948+00:00, run_end_date=2024-06-28 02:17:01.974021+00:00, run_duration=0.482073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=994, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:17:00.603571+00:00, queued_by_job_id=2, pid=14498 2024-06-28T02:17:05.087391963Z [2024-06-28T02:17:05.084+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:17:05.087446269Z [2024-06-28T02:17:05.085+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:16:00+00:00, run_id=scheduled__2024-06-28T02:16:00+00:00, run_start_date=2024-06-28 02:17:00.547442+00:00, run_end_date=2024-06-28 02:17:05.085094+00:00, run_duration=4.537652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:16:00+00:00, data_interval_end=2024-06-28 02:17:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:17:05.101375865Z [2024-06-28T02:17:05.100+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:17:00+00:00, run_after=2024-06-28T02:18:00+00:00 2024-06-28T02:17:05.152645374Z [2024-06-28T02:17:05.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:16:00+00:00 exited with status success for try_number 1 2024-06-28T02:17:05.162622503Z [2024-06-28T02:17:05.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:16:00+00:00, map_index=-1, run_start_date=2024-06-28 02:17:02.560531+00:00, run_end_date=2024-06-28 02:17:04.349442+00:00, run_duration=1.788911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=995, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:17:00.603571+00:00, queued_by_job_id=2, pid=14516 2024-06-28T02:17:06.229369128Z [2024-06-28T02:17:06.228+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:17:06.229623383Z [2024-06-28T02:17:06.229+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:16:00+00:00, run_id=scheduled__2024-06-28T02:16:00+00:00, run_start_date=2024-06-28 02:17:00.548401+00:00, run_end_date=2024-06-28 02:17:06.229264+00:00, run_duration=5.680863, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:16:00+00:00, data_interval_end=2024-06-28 02:17:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:17:06.241059433Z [2024-06-28T02:17:06.240+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:17:00+00:00, run_after=2024-06-28T02:18:00+00:00 2024-06-28T02:17:06.275726497Z [2024-06-28T02:17:06.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:16:00+00:00 exited with status success for try_number 1 2024-06-28T02:17:06.281591977Z [2024-06-28T02:17:06.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:16:00+00:00, map_index=-1, run_start_date=2024-06-28 02:17:02.742403+00:00, run_end_date=2024-06-28 02:17:05.291499+00:00, run_duration=2.549096, state=success, executor_state=success, try_number=1, max_tries=1, job_id=996, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:17:00.603571+00:00, queued_by_job_id=2, pid=14517 2024-06-28T02:18:00.586196416Z [2024-06-28T02:18:00.585+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:18:00+00:00, run_after=2024-06-28T02:19:00+00:00 2024-06-28T02:18:00.605932530Z [2024-06-28T02:18:00.605+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:18:00.629631135Z [2024-06-28T02:18:00.629+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:18:00+00:00, run_after=2024-06-28T02:19:00+00:00 2024-06-28T02:18:00.641081186Z [2024-06-28T02:18:00.640+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:18:00.754336790Z [2024-06-28T02:18:00.753+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:18:00.754412326Z 2024-06-28T02:18:00.754420583Z 2024-06-28T02:18:00.754426520Z 2024-06-28T02:18:00.754432404Z 2024-06-28T02:18:00.754452755Z [2024-06-28T02:18:00.754+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:18:00.754601261Z [2024-06-28T02:18:00.754+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:18:00.754742485Z [2024-06-28T02:18:00.754+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:18:00.754958612Z [2024-06-28T02:18:00.754+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:18:00.755874992Z [2024-06-28T02:18:00.755+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:18:00.755885669Z 2024-06-28T02:18:00.755891553Z 2024-06-28T02:18:00.755897008Z 2024-06-28T02:18:00.755902627Z 2024-06-28T02:18:00.762845495Z [2024-06-28T02:18:00.762+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:18:00.762910535Z [2024-06-28T02:18:00.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:18:00.763156898Z [2024-06-28T02:18:00.762+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:18:00.763306683Z [2024-06-28T02:18:00.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:18:00.763555882Z [2024-06-28T02:18:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:18:00.763581819Z [2024-06-28T02:18:00.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:18:00.763845573Z [2024-06-28T02:18:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:18:00.763906749Z [2024-06-28T02:18:00.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:18:01.125102984Z [2024-06-28T02:18:01.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:16:00+00:00 exited with status queued for try_number 1 2024-06-28T02:18:01.125181001Z [2024-06-28T02:18:01.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:17:00+00:00 exited with status queued for try_number 1 2024-06-28T02:18:01.125186231Z [2024-06-28T02:18:01.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:17:00+00:00 exited with status queued for try_number 1 2024-06-28T02:18:01.125267934Z [2024-06-28T02:18:01.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:17:00+00:00 exited with status queued for try_number 1 2024-06-28T02:18:01.144434955Z [2024-06-28T02:18:01.144+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7eb24e5c-f8d5-4395-9e95-0e2577586061 2024-06-28T02:18:01.144513370Z [2024-06-28T02:18:01.144+0000] {scheduler_job.py:635} INFO - Setting external_id for to de4cd67b-4911-4c7d-8b01-8265474d3368 2024-06-28T02:18:01.144656465Z [2024-06-28T02:18:01.144+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffd0c297-2a4b-4b21-903e-65166c3618c5 2024-06-28T02:18:01.144758545Z [2024-06-28T02:18:01.144+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7678e1ba-cc0d-4409-9fbb-1ee890b91c3c 2024-06-28T02:18:02.285382371Z [2024-06-28T02:18:02.284+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:18:02.285844249Z [2024-06-28T02:18:02.285+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:16:00+00:00, run_id=scheduled__2024-06-28T02:16:00+00:00, run_start_date=2024-06-28 02:18:00.654029+00:00, run_end_date=2024-06-28 02:18:02.285255+00:00, run_duration=1.631226, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:16:00+00:00, data_interval_end=2024-06-28 02:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:18:02.302518671Z [2024-06-28T02:18:02.302+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:18:00+00:00, run_after=2024-06-28T02:20:00+00:00 2024-06-28T02:18:02.312103675Z [2024-06-28T02:18:02.311+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:18:02.312518058Z [2024-06-28T02:18:02.312+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:17:00+00:00, run_id=scheduled__2024-06-28T02:17:00+00:00, run_start_date=2024-06-28 02:18:00.655436+00:00, run_end_date=2024-06-28 02:18:02.312154+00:00, run_duration=1.656718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:17:00+00:00, data_interval_end=2024-06-28 02:18:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:18:02.323754529Z [2024-06-28T02:18:02.323+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:18:00+00:00, run_after=2024-06-28T02:19:00+00:00 2024-06-28T02:18:02.380230964Z [2024-06-28T02:18:02.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:16:00+00:00 exited with status success for try_number 1 2024-06-28T02:18:02.380355303Z [2024-06-28T02:18:02.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:17:00+00:00 exited with status success for try_number 1 2024-06-28T02:18:02.391040085Z [2024-06-28T02:18:02.390+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:16:00+00:00, map_index=-1, run_start_date=2024-06-28 02:18:01.662993+00:00, run_end_date=2024-06-28 02:18:02.030668+00:00, run_duration=0.367675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=997, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:18:00.757254+00:00, queued_by_job_id=2, pid=14550 2024-06-28T02:18:02.391551747Z [2024-06-28T02:18:02.391+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:17:00+00:00, map_index=-1, run_start_date=2024-06-28 02:18:01.758770+00:00, run_end_date=2024-06-28 02:18:02.167708+00:00, run_duration=0.408938, state=success, executor_state=success, try_number=1, max_tries=1, job_id=998, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:18:00.757254+00:00, queued_by_job_id=2, pid=14551 2024-06-28T02:18:05.758080133Z [2024-06-28T02:18:05.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:18:05.758440954Z [2024-06-28T02:18:05.758+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:17:00+00:00, run_id=scheduled__2024-06-28T02:17:00+00:00, run_start_date=2024-06-28 02:18:00.656553+00:00, run_end_date=2024-06-28 02:18:05.757983+00:00, run_duration=5.10143, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:17:00+00:00, data_interval_end=2024-06-28 02:18:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:18:05.768324120Z [2024-06-28T02:18:05.768+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:18:00+00:00, run_after=2024-06-28T02:19:00+00:00 2024-06-28T02:18:05.777000395Z [2024-06-28T02:18:05.776+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:18:05.777296611Z [2024-06-28T02:18:05.776+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:17:00+00:00, run_id=scheduled__2024-06-28T02:17:00+00:00, run_start_date=2024-06-28 02:18:00.657737+00:00, run_end_date=2024-06-28 02:18:05.776867+00:00, run_duration=5.11913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:17:00+00:00, data_interval_end=2024-06-28 02:18:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:18:05.789202443Z [2024-06-28T02:18:05.788+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:18:00+00:00, run_after=2024-06-28T02:19:00+00:00 2024-06-28T02:18:05.818865902Z [2024-06-28T02:18:05.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:17:00+00:00 exited with status success for try_number 1 2024-06-28T02:18:05.818982262Z [2024-06-28T02:18:05.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:17:00+00:00 exited with status success for try_number 1 2024-06-28T02:18:05.825822857Z [2024-06-28T02:18:05.825+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:17:00+00:00, map_index=-1, run_start_date=2024-06-28 02:18:02.828093+00:00, run_end_date=2024-06-28 02:18:04.943200+00:00, run_duration=2.115107, state=success, executor_state=success, try_number=1, max_tries=1, job_id=999, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:18:00.757254+00:00, queued_by_job_id=2, pid=14574 2024-06-28T02:18:05.825938957Z [2024-06-28T02:18:05.825+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:17:00+00:00, map_index=-1, run_start_date=2024-06-28 02:18:02.906585+00:00, run_end_date=2024-06-28 02:18:04.566215+00:00, run_duration=1.65963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1000, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:18:00.757254+00:00, queued_by_job_id=2, pid=14575 2024-06-28T02:19:00.659943839Z [2024-06-28T02:19:00.659+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:19:00+00:00, run_after=2024-06-28T02:20:00+00:00 2024-06-28T02:19:00.680261881Z [2024-06-28T02:19:00.679+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:19:00+00:00, run_after=2024-06-28T02:20:00+00:00 2024-06-28T02:19:00.693669539Z [2024-06-28T02:19:00.693+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:19:00.782737331Z [2024-06-28T02:19:00.782+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:19:00.782787019Z 2024-06-28T02:19:00.782791646Z 2024-06-28T02:19:00.782795808Z 2024-06-28T02:19:00.782983758Z [2024-06-28T02:19:00.782+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:19:00.783201752Z [2024-06-28T02:19:00.783+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:19:00.783423103Z [2024-06-28T02:19:00.783+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:19:00.784213632Z [2024-06-28T02:19:00.783+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:19:00.784229153Z 2024-06-28T02:19:00.784233390Z 2024-06-28T02:19:00.784237415Z 2024-06-28T02:19:00.788258693Z [2024-06-28T02:19:00.787+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:19:00.788536894Z [2024-06-28T02:19:00.788+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:19:00.788900488Z [2024-06-28T02:19:00.788+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:19:00.789057181Z [2024-06-28T02:19:00.788+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:19:00.789391413Z [2024-06-28T02:19:00.789+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:19:00.789547887Z [2024-06-28T02:19:00.789+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:19:01.020578340Z [2024-06-28T02:19:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:18:00+00:00 exited with status queued for try_number 1 2024-06-28T02:19:01.020633773Z [2024-06-28T02:19:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:18:00+00:00 exited with status queued for try_number 1 2024-06-28T02:19:01.020862698Z [2024-06-28T02:19:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:18:00+00:00 exited with status queued for try_number 1 2024-06-28T02:19:01.028930518Z [2024-06-28T02:19:01.028+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91b48f27-a44e-4f1e-8846-5ee8ee642551 2024-06-28T02:19:01.029043805Z [2024-06-28T02:19:01.028+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3406dbd-2ccd-4d6f-96f7-85333429bc5f 2024-06-28T02:19:01.029282007Z [2024-06-28T02:19:01.029+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea6c56bf-8b6f-4b8c-856a-fe4595e04bf0 2024-06-28T02:19:02.177123558Z [2024-06-28T02:19:02.175+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:19:02.177152345Z [2024-06-28T02:19:02.176+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:18:00+00:00, run_id=scheduled__2024-06-28T02:18:00+00:00, run_start_date=2024-06-28 02:19:00.711583+00:00, run_end_date=2024-06-28 02:19:02.176079+00:00, run_duration=1.464496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:18:00+00:00, data_interval_end=2024-06-28 02:19:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:19:02.185596999Z [2024-06-28T02:19:02.185+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:19:00+00:00, run_after=2024-06-28T02:20:00+00:00 2024-06-28T02:19:02.234728367Z [2024-06-28T02:19:02.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:18:00+00:00 exited with status success for try_number 1 2024-06-28T02:19:02.240314405Z [2024-06-28T02:19:02.239+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:18:00+00:00, map_index=-1, run_start_date=2024-06-28 02:19:01.624625+00:00, run_end_date=2024-06-28 02:19:02.021251+00:00, run_duration=0.396626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1001, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:19:00.785236+00:00, queued_by_job_id=2, pid=14607 2024-06-28T02:19:04.457595394Z [2024-06-28T02:19:04.457+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:19:04.457953016Z [2024-06-28T02:19:04.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:18:00+00:00, run_id=scheduled__2024-06-28T02:18:00+00:00, run_start_date=2024-06-28 02:19:00.713496+00:00, run_end_date=2024-06-28 02:19:04.457540+00:00, run_duration=3.744044, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:18:00+00:00, data_interval_end=2024-06-28 02:19:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:19:04.484447202Z [2024-06-28T02:19:04.484+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:19:00+00:00, run_after=2024-06-28T02:20:00+00:00 2024-06-28T02:19:05.640795416Z [2024-06-28T02:19:05.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:19:05.641104360Z [2024-06-28T02:19:05.640+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:18:00+00:00, run_id=scheduled__2024-06-28T02:18:00+00:00, run_start_date=2024-06-28 02:19:00.716856+00:00, run_end_date=2024-06-28 02:19:05.640710+00:00, run_duration=4.923854, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:18:00+00:00, data_interval_end=2024-06-28 02:19:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:19:05.652283439Z [2024-06-28T02:19:05.651+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:19:00+00:00, run_after=2024-06-28T02:20:00+00:00 2024-06-28T02:19:05.689673084Z [2024-06-28T02:19:05.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:18:00+00:00 exited with status success for try_number 1 2024-06-28T02:19:05.689731439Z [2024-06-28T02:19:05.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:18:00+00:00 exited with status success for try_number 1 2024-06-28T02:19:05.700297537Z [2024-06-28T02:19:05.699+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:18:00+00:00, map_index=-1, run_start_date=2024-06-28 02:19:02.590833+00:00, run_end_date=2024-06-28 02:19:04.421623+00:00, run_duration=1.83079, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1002, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:19:00.785236+00:00, queued_by_job_id=2, pid=14625 2024-06-28T02:19:05.700484673Z [2024-06-28T02:19:05.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:18:00+00:00, map_index=-1, run_start_date=2024-06-28 02:19:02.648391+00:00, run_end_date=2024-06-28 02:19:04.411010+00:00, run_duration=1.762619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1003, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:19:00.785236+00:00, queued_by_job_id=2, pid=14626 2024-06-28T02:20:00.742423207Z [2024-06-28T02:20:00.741+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:20:00+00:00, run_after=2024-06-28T02:25:00+00:00 2024-06-28T02:20:00.757441265Z [2024-06-28T02:20:00.757+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:20:00+00:00, run_after=2024-06-28T02:21:00+00:00 2024-06-28T02:20:00.763691499Z [2024-06-28T02:20:00.763+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:20:00.769381372Z [2024-06-28T02:20:00.769+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:20:00.779608294Z [2024-06-28T02:20:00.779+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:20:00+00:00, run_after=2024-06-28T02:21:00+00:00 2024-06-28T02:20:00.913769955Z [2024-06-28T02:20:00.913+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-28T02:20:00.913816654Z 2024-06-28T02:20:00.913823840Z 2024-06-28T02:20:00.913831445Z 2024-06-28T02:20:00.913838602Z 2024-06-28T02:20:00.913844792Z 2024-06-28T02:20:00.914291904Z [2024-06-28T02:20:00.913+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:20:00.914796706Z [2024-06-28T02:20:00.914+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:20:00.915333151Z [2024-06-28T02:20:00.914+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:20:00.915946481Z [2024-06-28T02:20:00.915+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:20:00.916531904Z [2024-06-28T02:20:00.916+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:20:00.917986972Z [2024-06-28T02:20:00.917+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:20:00.918031552Z 2024-06-28T02:20:00.918042370Z 2024-06-28T02:20:00.918052513Z 2024-06-28T02:20:00.918061732Z 2024-06-28T02:20:00.918070223Z 2024-06-28T02:20:00.924949123Z [2024-06-28T02:20:00.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T02:20:00.925329586Z [2024-06-28T02:20:00.924+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:20:00.926338538Z [2024-06-28T02:20:00.925+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:20:00.926612075Z [2024-06-28T02:20:00.926+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:20:00.929286766Z [2024-06-28T02:20:00.926+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:20:00.930495018Z [2024-06-28T02:20:00.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:20:00.931624695Z [2024-06-28T02:20:00.931+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:20:00.932314869Z [2024-06-28T02:20:00.931+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:20:00.939045200Z [2024-06-28T02:20:00.932+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:20:00.939475695Z [2024-06-28T02:20:00.938+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:20:01.668168285Z [2024-06-28T02:20:01.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:15:00+00:00 exited with status queued for try_number 1 2024-06-28T02:20:01.668206243Z [2024-06-28T02:20:01.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:18:00+00:00 exited with status queued for try_number 1 2024-06-28T02:20:01.670348814Z [2024-06-28T02:20:01.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:19:00+00:00 exited with status queued for try_number 1 2024-06-28T02:20:01.670398417Z [2024-06-28T02:20:01.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:19:00+00:00 exited with status queued for try_number 1 2024-06-28T02:20:01.670542164Z [2024-06-28T02:20:01.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:19:00+00:00 exited with status queued for try_number 1 2024-06-28T02:20:01.692477566Z [2024-06-28T02:20:01.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25ba098b-50e9-416f-91f3-8fd66654500c 2024-06-28T02:20:01.692707571Z [2024-06-28T02:20:01.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03e1f880-6ccb-4a38-83f7-0d4f0dfedb11 2024-06-28T02:20:01.692855475Z [2024-06-28T02:20:01.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to a40f8eae-7b98-4b25-8876-24a69544d30f 2024-06-28T02:20:01.692981066Z [2024-06-28T02:20:01.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41ce8981-7e04-4368-89e0-4a79fedbcb06 2024-06-28T02:20:01.693143517Z [2024-06-28T02:20:01.693+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ffc7085-0f9d-4c21-acd7-e5f063d8767d 2024-06-28T02:20:02.976208036Z [2024-06-28T02:20:02.975+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:20:02.976411767Z [2024-06-28T02:20:02.976+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:18:00+00:00, run_id=scheduled__2024-06-28T02:18:00+00:00, run_start_date=2024-06-28 02:20:00.789704+00:00, run_end_date=2024-06-28 02:20:02.976073+00:00, run_duration=2.186369, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:18:00+00:00, data_interval_end=2024-06-28 02:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:20:02.984459816Z [2024-06-28T02:20:02.984+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:20:00+00:00, run_after=2024-06-28T02:22:00+00:00 2024-06-28T02:20:03.004061733Z [2024-06-28T02:20:03.003+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:20:03.004189597Z [2024-06-28T02:20:03.004+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:19:00+00:00, run_id=scheduled__2024-06-28T02:19:00+00:00, run_start_date=2024-06-28 02:20:00.790686+00:00, run_end_date=2024-06-28 02:20:03.003929+00:00, run_duration=2.213243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:19:00+00:00, data_interval_end=2024-06-28 02:20:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:20:03.018308243Z [2024-06-28T02:20:03.017+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:20:00+00:00, run_after=2024-06-28T02:21:00+00:00 2024-06-28T02:20:03.068869128Z [2024-06-28T02:20:03.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:18:00+00:00 exited with status success for try_number 1 2024-06-28T02:20:03.068934437Z [2024-06-28T02:20:03.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:19:00+00:00 exited with status success for try_number 1 2024-06-28T02:20:03.075873859Z [2024-06-28T02:20:03.075+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:18:00+00:00, map_index=-1, run_start_date=2024-06-28 02:20:01.905616+00:00, run_end_date=2024-06-28 02:20:02.261902+00:00, run_duration=0.356286, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1004, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:20:00.919578+00:00, queued_by_job_id=2, pid=14660 2024-06-28T02:20:03.075997716Z [2024-06-28T02:20:03.075+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:19:00+00:00, map_index=-1, run_start_date=2024-06-28 02:20:02.141394+00:00, run_end_date=2024-06-28 02:20:02.548635+00:00, run_duration=0.407241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1005, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:20:00.919578+00:00, queued_by_job_id=2, pid=14664 2024-06-28T02:20:04.232208901Z [2024-06-28T02:20:04.231+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:20:04.232246626Z 2024-06-28T02:20:04.232268244Z [2024-06-28T02:20:04.232+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:20:04.234091848Z [2024-06-28T02:20:04.232+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:20:04.234122720Z 2024-06-28T02:20:04.237417751Z [2024-06-28T02:20:04.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T02:20:04.237572763Z [2024-06-28T02:20:04.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:20:04.307271104Z [2024-06-28T02:20:04.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:15:00+00:00 exited with status queued for try_number 1 2024-06-28T02:20:04.307458650Z [2024-06-28T02:20:04.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:15:00+00:00 exited with status success for try_number 1 2024-06-28T02:20:04.318106437Z [2024-06-28T02:20:04.316+0000] {scheduler_job.py:635} INFO - Setting external_id for to 293522b5-8cec-442c-8630-65b7361d0805 2024-06-28T02:20:04.318282212Z [2024-06-28T02:20:04.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T02:15:00+00:00, map_index=-1, run_start_date=2024-06-28 02:20:03.116484+00:00, run_end_date=2024-06-28 02:20:03.543966+00:00, run_duration=0.427482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1007, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:20:00.919578+00:00, queued_by_job_id=2, pid=14691 2024-06-28T02:20:05.485942768Z [2024-06-28T02:20:05.485+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:20:05.486476312Z [2024-06-28T02:20:05.486+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:19:00+00:00, run_id=scheduled__2024-06-28T02:19:00+00:00, run_start_date=2024-06-28 02:20:00.792513+00:00, run_end_date=2024-06-28 02:20:05.486153+00:00, run_duration=4.69364, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:19:00+00:00, data_interval_end=2024-06-28 02:20:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:20:05.496552346Z [2024-06-28T02:20:05.496+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:20:00+00:00, run_after=2024-06-28T02:21:00+00:00 2024-06-28T02:20:05.508938801Z [2024-06-28T02:20:05.506+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:20:05.508962662Z [2024-06-28T02:20:05.506+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:19:00+00:00, run_id=scheduled__2024-06-28T02:19:00+00:00, run_start_date=2024-06-28 02:20:00.791626+00:00, run_end_date=2024-06-28 02:20:05.506664+00:00, run_duration=4.715038, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:19:00+00:00, data_interval_end=2024-06-28 02:20:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:20:05.522813003Z [2024-06-28T02:20:05.518+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:20:00+00:00, run_after=2024-06-28T02:21:00+00:00 2024-06-28T02:20:05.595641958Z [2024-06-28T02:20:05.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:19:00+00:00 exited with status success for try_number 1 2024-06-28T02:20:05.595823551Z [2024-06-28T02:20:05.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:19:00+00:00 exited with status success for try_number 1 2024-06-28T02:20:05.603214779Z [2024-06-28T02:20:05.602+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:19:00+00:00, map_index=-1, run_start_date=2024-06-28 02:20:03.051039+00:00, run_end_date=2024-06-28 02:20:05.358024+00:00, run_duration=2.306985, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1006, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:20:00.919578+00:00, queued_by_job_id=2, pid=14690 2024-06-28T02:20:05.603485989Z [2024-06-28T02:20:05.603+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:19:00+00:00, map_index=-1, run_start_date=2024-06-28 02:20:03.310061+00:00, run_end_date=2024-06-28 02:20:04.788207+00:00, run_duration=1.478146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1008, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:20:00.919578+00:00, queued_by_job_id=2, pid=14692 2024-06-28T02:20:06.722144648Z [2024-06-28T02:20:06.718+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:20:06.722182786Z 2024-06-28T02:20:06.722582731Z [2024-06-28T02:20:06.722+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:20:06.723771737Z [2024-06-28T02:20:06.723+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:20:06.723791516Z 2024-06-28T02:20:06.727495925Z [2024-06-28T02:20:06.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T02:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T02:20:06.727967705Z [2024-06-28T02:20:06.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T02:20:06.798334094Z [2024-06-28T02:20:06.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:15:00+00:00 exited with status queued for try_number 1 2024-06-28T02:20:06.798863132Z [2024-06-28T02:20:06.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:15:00+00:00 exited with status success for try_number 1 2024-06-28T02:20:06.806548918Z [2024-06-28T02:20:06.806+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26c51b1e-1a9d-4dc4-875b-d3e8e70e340d 2024-06-28T02:20:06.807142299Z [2024-06-28T02:20:06.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T02:15:00+00:00, map_index=-1, run_start_date=2024-06-28 02:20:06.125578+00:00, run_end_date=2024-06-28 02:20:06.509867+00:00, run_duration=0.384289, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1009, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:20:04.234513+00:00, queued_by_job_id=2, pid=14715 2024-06-28T02:20:10.562063526Z [2024-06-28T02:20:10.561+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:20:10.562105754Z 2024-06-28T02:20:10.562224036Z [2024-06-28T02:20:10.561+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:20:10.563283807Z [2024-06-28T02:20:10.562+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:20:10.563300141Z 2024-06-28T02:20:10.567814636Z [2024-06-28T02:20:10.567+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:20:10.567957994Z [2024-06-28T02:20:10.567+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:20:10.639564043Z [2024-06-28T02:20:10.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:15:00+00:00 exited with status queued for try_number 1 2024-06-28T02:20:10.640644473Z [2024-06-28T02:20:10.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:15:00+00:00 exited with status success for try_number 1 2024-06-28T02:20:10.647916535Z [2024-06-28T02:20:10.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65b14623-4433-4e44-8b96-bdcac71fd675 2024-06-28T02:20:10.648269775Z [2024-06-28T02:20:10.648+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T02:15:00+00:00, map_index=0, run_start_date=2024-06-28 02:20:08.398552+00:00, run_end_date=2024-06-28 02:20:09.770768+00:00, run_duration=1.372216, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1010, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:20:06.724589+00:00, queued_by_job_id=2, pid=14723 2024-06-28T02:20:13.336476866Z [2024-06-28T02:20:13.335+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:20:13.336619576Z [2024-06-28T02:20:13.336+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:15:00+00:00, run_id=scheduled__2024-06-28T02:15:00+00:00, run_start_date=2024-06-28 02:20:00.788587+00:00, run_end_date=2024-06-28 02:20:13.336221+00:00, run_duration=12.547634, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:15:00+00:00, data_interval_end=2024-06-28 02:20:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T02:20:13.343796310Z [2024-06-28T02:20:13.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:20:00+00:00, run_after=2024-06-28T02:25:00+00:00 2024-06-28T02:20:13.387148041Z [2024-06-28T02:20:13.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:15:00+00:00 exited with status success for try_number 1 2024-06-28T02:20:13.394678787Z [2024-06-28T02:20:13.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T02:15:00+00:00, map_index=-1, run_start_date=2024-06-28 02:20:12.189961+00:00, run_end_date=2024-06-28 02:20:12.634945+00:00, run_duration=0.444984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1011, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:20:10.563868+00:00, queued_by_job_id=2, pid=14736 2024-06-28T02:21:00.202369560Z [2024-06-28T02:21:00.201+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:21:00.226635858Z [2024-06-28T02:21:00.226+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:21:00+00:00, run_after=2024-06-28T02:22:00+00:00 2024-06-28T02:21:00.243903156Z [2024-06-28T02:21:00.243+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:21:00+00:00, run_after=2024-06-28T02:22:00+00:00 2024-06-28T02:21:00.338814963Z [2024-06-28T02:21:00.338+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:21:00.338842958Z 2024-06-28T02:21:00.338846926Z 2024-06-28T02:21:00.338850363Z 2024-06-28T02:21:00.339115363Z [2024-06-28T02:21:00.338+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:21:00.339333807Z [2024-06-28T02:21:00.339+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:21:00.339530643Z [2024-06-28T02:21:00.339+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:21:00.340193557Z [2024-06-28T02:21:00.340+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:21:00.340205671Z 2024-06-28T02:21:00.340209474Z 2024-06-28T02:21:00.340212559Z 2024-06-28T02:21:00.343265766Z [2024-06-28T02:21:00.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:21:00.343508105Z [2024-06-28T02:21:00.343+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:21:00.343810384Z [2024-06-28T02:21:00.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:21:00.344048267Z [2024-06-28T02:21:00.343+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:21:00.344308861Z [2024-06-28T02:21:00.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:21:00.344523556Z [2024-06-28T02:21:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:21:00.542734099Z [2024-06-28T02:21:00.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:20:00+00:00 exited with status queued for try_number 1 2024-06-28T02:21:00.542862199Z [2024-06-28T02:21:00.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:20:00+00:00 exited with status queued for try_number 1 2024-06-28T02:21:00.542980477Z [2024-06-28T02:21:00.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:20:00+00:00 exited with status queued for try_number 1 2024-06-28T02:21:00.550180093Z [2024-06-28T02:21:00.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce1a32a7-5d0e-477c-aef3-851e7f0764f5 2024-06-28T02:21:00.550413671Z [2024-06-28T02:21:00.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd743bb8-d160-40e7-86ad-eee20357de77 2024-06-28T02:21:00.550540539Z [2024-06-28T02:21:00.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ad34322-09ff-4e2b-bdad-67e68271ad04 2024-06-28T02:21:01.714711695Z [2024-06-28T02:21:01.714+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:21:01.715041989Z [2024-06-28T02:21:01.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:20:00+00:00, run_id=scheduled__2024-06-28T02:20:00+00:00, run_start_date=2024-06-28 02:21:00.255066+00:00, run_end_date=2024-06-28 02:21:01.714608+00:00, run_duration=1.459542, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:20:00+00:00, data_interval_end=2024-06-28 02:21:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:21:01.725836980Z [2024-06-28T02:21:01.725+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:21:00+00:00, run_after=2024-06-28T02:22:00+00:00 2024-06-28T02:21:01.782570470Z [2024-06-28T02:21:01.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:20:00+00:00 exited with status success for try_number 1 2024-06-28T02:21:01.792686282Z [2024-06-28T02:21:01.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:20:00+00:00, map_index=-1, run_start_date=2024-06-28 02:21:01.069817+00:00, run_end_date=2024-06-28 02:21:01.502551+00:00, run_duration=0.432734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1012, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:21:00.340981+00:00, queued_by_job_id=2, pid=14758 2024-06-28T02:21:03.790497148Z [2024-06-28T02:21:03.788+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:21:03.790524974Z [2024-06-28T02:21:03.788+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:20:00+00:00, run_id=scheduled__2024-06-28T02:20:00+00:00, run_start_date=2024-06-28 02:21:00.256235+00:00, run_end_date=2024-06-28 02:21:03.788694+00:00, run_duration=3.532459, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:20:00+00:00, data_interval_end=2024-06-28 02:21:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:21:03.814769095Z [2024-06-28T02:21:03.808+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:21:00+00:00, run_after=2024-06-28T02:22:00+00:00 2024-06-28T02:21:04.910176505Z [2024-06-28T02:21:04.909+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:21:04.910577204Z [2024-06-28T02:21:04.910+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:20:00+00:00, run_id=scheduled__2024-06-28T02:20:00+00:00, run_start_date=2024-06-28 02:21:00.257277+00:00, run_end_date=2024-06-28 02:21:04.910207+00:00, run_duration=4.65293, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:20:00+00:00, data_interval_end=2024-06-28 02:21:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:21:04.928020831Z [2024-06-28T02:21:04.927+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:21:00+00:00, run_after=2024-06-28T02:22:00+00:00 2024-06-28T02:21:04.961755885Z [2024-06-28T02:21:04.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:20:00+00:00 exited with status success for try_number 1 2024-06-28T02:21:04.961778583Z [2024-06-28T02:21:04.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:20:00+00:00 exited with status success for try_number 1 2024-06-28T02:21:04.964869819Z [2024-06-28T02:21:04.964+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:20:00+00:00, map_index=-1, run_start_date=2024-06-28 02:21:02.235692+00:00, run_end_date=2024-06-28 02:21:03.729807+00:00, run_duration=1.494115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1014, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:21:00.340981+00:00, queued_by_job_id=2, pid=14777 2024-06-28T02:21:04.965218041Z [2024-06-28T02:21:04.965+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:20:00+00:00, map_index=-1, run_start_date=2024-06-28 02:21:02.012192+00:00, run_end_date=2024-06-28 02:21:03.951363+00:00, run_duration=1.939171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1013, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:21:00.340981+00:00, queued_by_job_id=2, pid=14776 2024-06-28T02:21:47.378083507Z [2024-06-28T02:21:47.377+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T02:22:00.877647334Z [2024-06-28T02:22:00.877+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:22:00+00:00, run_after=2024-06-28T02:23:00+00:00 2024-06-28T02:22:00.890480175Z [2024-06-28T02:22:00.890+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:22:00.911646694Z [2024-06-28T02:22:00.911+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:22:00+00:00, run_after=2024-06-28T02:23:00+00:00 2024-06-28T02:22:00.923112990Z [2024-06-28T02:22:00.922+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:22:01.025753905Z [2024-06-28T02:22:01.025+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:22:01.025780327Z 2024-06-28T02:22:01.025784924Z 2024-06-28T02:22:01.025788927Z 2024-06-28T02:22:01.025792597Z 2024-06-28T02:22:01.025979435Z [2024-06-28T02:22:01.025+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:22:01.026166332Z [2024-06-28T02:22:01.025+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:22:01.026332881Z [2024-06-28T02:22:01.026+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:22:01.026500581Z [2024-06-28T02:22:01.026+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:22:01.027328143Z [2024-06-28T02:22:01.027+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:22:01.027337962Z 2024-06-28T02:22:01.027360272Z 2024-06-28T02:22:01.027363988Z 2024-06-28T02:22:01.027367520Z 2024-06-28T02:22:01.032691462Z [2024-06-28T02:22:01.032+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:22:01.032838783Z [2024-06-28T02:22:01.032+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:22:01.033148141Z [2024-06-28T02:22:01.032+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:22:01.033310950Z [2024-06-28T02:22:01.033+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:22:01.033616262Z [2024-06-28T02:22:01.033+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:22:01.033802890Z [2024-06-28T02:22:01.033+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:22:01.034087739Z [2024-06-28T02:22:01.033+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:22:01.034231507Z [2024-06-28T02:22:01.034+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:22:01.410834363Z [2024-06-28T02:22:01.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:20:00+00:00 exited with status queued for try_number 1 2024-06-28T02:22:01.410873657Z [2024-06-28T02:22:01.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:21:00+00:00 exited with status queued for try_number 1 2024-06-28T02:22:01.410877741Z [2024-06-28T02:22:01.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:21:00+00:00 exited with status queued for try_number 1 2024-06-28T02:22:01.410893793Z [2024-06-28T02:22:01.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:21:00+00:00 exited with status queued for try_number 1 2024-06-28T02:22:01.430992684Z [2024-06-28T02:22:01.430+0000] {scheduler_job.py:635} INFO - Setting external_id for to c15970cf-531f-472f-a684-0639d9050402 2024-06-28T02:22:01.431244363Z [2024-06-28T02:22:01.431+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb3dc61d-1c42-4c4e-82ab-e74686dadf94 2024-06-28T02:22:01.431572122Z [2024-06-28T02:22:01.431+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7976bd87-7cc8-4a4b-b132-578b033a39bb 2024-06-28T02:22:01.431820803Z [2024-06-28T02:22:01.431+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24684725-8912-4e90-9ae2-5cf3ebff45d1 2024-06-28T02:22:02.741911565Z [2024-06-28T02:22:02.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:22:02.742588217Z [2024-06-28T02:22:02.742+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:20:00+00:00, run_id=scheduled__2024-06-28T02:20:00+00:00, run_start_date=2024-06-28 02:22:00.939679+00:00, run_end_date=2024-06-28 02:22:02.742017+00:00, run_duration=1.802338, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:20:00+00:00, data_interval_end=2024-06-28 02:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:22:02.753261650Z [2024-06-28T02:22:02.752+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:22:00+00:00, run_after=2024-06-28T02:24:00+00:00 2024-06-28T02:22:02.764819892Z [2024-06-28T02:22:02.764+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:22:02.765136813Z [2024-06-28T02:22:02.764+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:21:00+00:00, run_id=scheduled__2024-06-28T02:21:00+00:00, run_start_date=2024-06-28 02:22:00.942639+00:00, run_end_date=2024-06-28 02:22:02.764743+00:00, run_duration=1.822104, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:21:00+00:00, data_interval_end=2024-06-28 02:22:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:22:02.782036696Z [2024-06-28T02:22:02.781+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:22:00+00:00, run_after=2024-06-28T02:23:00+00:00 2024-06-28T02:22:02.842441021Z [2024-06-28T02:22:02.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:20:00+00:00 exited with status success for try_number 1 2024-06-28T02:22:02.842715571Z [2024-06-28T02:22:02.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:21:00+00:00 exited with status success for try_number 1 2024-06-28T02:22:02.855858563Z [2024-06-28T02:22:02.855+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:21:00+00:00, map_index=-1, run_start_date=2024-06-28 02:22:01.960992+00:00, run_end_date=2024-06-28 02:22:02.432580+00:00, run_duration=0.471588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1016, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:22:01.028377+00:00, queued_by_job_id=2, pid=14811 2024-06-28T02:22:02.856105864Z [2024-06-28T02:22:02.855+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:20:00+00:00, map_index=-1, run_start_date=2024-06-28 02:22:01.896563+00:00, run_end_date=2024-06-28 02:22:02.348864+00:00, run_duration=0.452301, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1015, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:22:01.028377+00:00, queued_by_job_id=2, pid=14810 2024-06-28T02:22:05.484196420Z [2024-06-28T02:22:05.483+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:22:05.485377899Z [2024-06-28T02:22:05.485+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:21:00+00:00, run_id=scheduled__2024-06-28T02:21:00+00:00, run_start_date=2024-06-28 02:22:00.945373+00:00, run_end_date=2024-06-28 02:22:05.484073+00:00, run_duration=4.5387, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:21:00+00:00, data_interval_end=2024-06-28 02:22:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:22:05.520793916Z [2024-06-28T02:22:05.517+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:22:00+00:00, run_after=2024-06-28T02:23:00+00:00 2024-06-28T02:22:05.594608827Z [2024-06-28T02:22:05.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:21:00+00:00 exited with status success for try_number 1 2024-06-28T02:22:05.618513402Z [2024-06-28T02:22:05.612+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:21:00+00:00, map_index=-1, run_start_date=2024-06-28 02:22:02.891403+00:00, run_end_date=2024-06-28 02:22:04.334749+00:00, run_duration=1.443346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1017, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:22:01.028377+00:00, queued_by_job_id=2, pid=14834 2024-06-28T02:22:06.679066645Z [2024-06-28T02:22:06.678+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:22:06.679274790Z [2024-06-28T02:22:06.679+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:21:00+00:00, run_id=scheduled__2024-06-28T02:21:00+00:00, run_start_date=2024-06-28 02:22:00.947803+00:00, run_end_date=2024-06-28 02:22:06.678927+00:00, run_duration=5.731124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:21:00+00:00, data_interval_end=2024-06-28 02:22:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:22:06.691359701Z [2024-06-28T02:22:06.691+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:22:00+00:00, run_after=2024-06-28T02:23:00+00:00 2024-06-28T02:22:06.721905852Z [2024-06-28T02:22:06.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:21:00+00:00 exited with status success for try_number 1 2024-06-28T02:22:06.727803398Z [2024-06-28T02:22:06.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:21:00+00:00, map_index=-1, run_start_date=2024-06-28 02:22:03.019998+00:00, run_end_date=2024-06-28 02:22:05.627116+00:00, run_duration=2.607118, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1018, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:22:01.028377+00:00, queued_by_job_id=2, pid=14835 2024-06-28T02:23:00.943745700Z [2024-06-28T02:23:00.943+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:23:00.967758497Z [2024-06-28T02:23:00.967+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:23:00+00:00, run_after=2024-06-28T02:24:00+00:00 2024-06-28T02:23:00.989155294Z [2024-06-28T02:23:00.988+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:23:00+00:00, run_after=2024-06-28T02:24:00+00:00 2024-06-28T02:23:01.102932330Z [2024-06-28T02:23:01.102+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:23:01.102977897Z 2024-06-28T02:23:01.102985318Z 2024-06-28T02:23:01.102991486Z 2024-06-28T02:23:01.103058595Z [2024-06-28T02:23:01.102+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:23:01.103266172Z [2024-06-28T02:23:01.103+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:23:01.103475732Z [2024-06-28T02:23:01.103+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:23:01.104450510Z [2024-06-28T02:23:01.104+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:23:01.104465475Z 2024-06-28T02:23:01.104472071Z 2024-06-28T02:23:01.104477858Z 2024-06-28T02:23:01.108298909Z [2024-06-28T02:23:01.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:23:01.108495447Z [2024-06-28T02:23:01.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:23:01.108846392Z [2024-06-28T02:23:01.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:23:01.109048824Z [2024-06-28T02:23:01.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:23:01.109418406Z [2024-06-28T02:23:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:23:01.109591879Z [2024-06-28T02:23:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:23:01.479335262Z [2024-06-28T02:23:01.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:22:00+00:00 exited with status queued for try_number 1 2024-06-28T02:23:01.479545074Z [2024-06-28T02:23:01.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:22:00+00:00 exited with status queued for try_number 1 2024-06-28T02:23:01.479695388Z [2024-06-28T02:23:01.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:22:00+00:00 exited with status queued for try_number 1 2024-06-28T02:23:01.492565862Z [2024-06-28T02:23:01.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1a862d5-3c81-4416-bf6f-24a6a44218e1 2024-06-28T02:23:01.492823912Z [2024-06-28T02:23:01.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96020b7a-7a54-49cd-bd88-e556b01da55b 2024-06-28T02:23:01.493126940Z [2024-06-28T02:23:01.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0667110-3a08-4af5-854a-c1372321233a 2024-06-28T02:23:02.598148671Z [2024-06-28T02:23:02.597+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:23:02.598466660Z [2024-06-28T02:23:02.598+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:22:00+00:00, run_id=scheduled__2024-06-28T02:22:00+00:00, run_start_date=2024-06-28 02:23:01.009332+00:00, run_end_date=2024-06-28 02:23:02.598117+00:00, run_duration=1.588785, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:22:00+00:00, data_interval_end=2024-06-28 02:23:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:23:02.610571295Z [2024-06-28T02:23:02.610+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:23:00+00:00, run_after=2024-06-28T02:24:00+00:00 2024-06-28T02:23:02.658563212Z [2024-06-28T02:23:02.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:22:00+00:00 exited with status success for try_number 1 2024-06-28T02:23:02.666237338Z [2024-06-28T02:23:02.665+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:22:00+00:00, map_index=-1, run_start_date=2024-06-28 02:23:01.888593+00:00, run_end_date=2024-06-28 02:23:02.262529+00:00, run_duration=0.373936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1019, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:23:01.105071+00:00, queued_by_job_id=2, pid=14867 2024-06-28T02:23:04.841619797Z [2024-06-28T02:23:04.841+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:23:04.841953613Z [2024-06-28T02:23:04.841+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:22:00+00:00, run_id=scheduled__2024-06-28T02:22:00+00:00, run_start_date=2024-06-28 02:23:01.014312+00:00, run_end_date=2024-06-28 02:23:04.841527+00:00, run_duration=3.827215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:22:00+00:00, data_interval_end=2024-06-28 02:23:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:23:04.864887199Z [2024-06-28T02:23:04.864+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:23:00+00:00, run_after=2024-06-28T02:24:00+00:00 2024-06-28T02:23:04.923179811Z [2024-06-28T02:23:04.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:22:00+00:00 exited with status success for try_number 1 2024-06-28T02:23:04.929224443Z [2024-06-28T02:23:04.928+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:22:00+00:00, map_index=-1, run_start_date=2024-06-28 02:23:02.920475+00:00, run_end_date=2024-06-28 02:23:04.537192+00:00, run_duration=1.616717, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1020, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:23:01.105071+00:00, queued_by_job_id=2, pid=14880 2024-06-28T02:23:05.985737426Z [2024-06-28T02:23:05.985+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:23:05.986333072Z [2024-06-28T02:23:05.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:22:00+00:00, run_id=scheduled__2024-06-28T02:22:00+00:00, run_start_date=2024-06-28 02:23:01.012313+00:00, run_end_date=2024-06-28 02:23:05.985686+00:00, run_duration=4.973373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:22:00+00:00, data_interval_end=2024-06-28 02:23:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:23:05.996768088Z [2024-06-28T02:23:05.996+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:23:00+00:00, run_after=2024-06-28T02:24:00+00:00 2024-06-28T02:23:06.047626147Z [2024-06-28T02:23:06.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:22:00+00:00 exited with status success for try_number 1 2024-06-28T02:23:06.057566784Z [2024-06-28T02:23:06.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:22:00+00:00, map_index=-1, run_start_date=2024-06-28 02:23:03.440812+00:00, run_end_date=2024-06-28 02:23:04.878485+00:00, run_duration=1.437673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1021, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:23:01.105071+00:00, queued_by_job_id=2, pid=14891 2024-06-28T02:24:01.006800309Z [2024-06-28T02:24:01.006+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:24:01.015069781Z [2024-06-28T02:24:01.014+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:24:01.030388760Z [2024-06-28T02:24:01.030+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:24:00+00:00, run_after=2024-06-28T02:25:00+00:00 2024-06-28T02:24:01.058859169Z [2024-06-28T02:24:01.058+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:24:00+00:00, run_after=2024-06-28T02:25:00+00:00 2024-06-28T02:24:01.130093738Z [2024-06-28T02:24:01.129+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:24:01.130117641Z 2024-06-28T02:24:01.130124343Z 2024-06-28T02:24:01.130127826Z 2024-06-28T02:24:01.130131277Z 2024-06-28T02:24:01.130136053Z [2024-06-28T02:24:01.129+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:24:01.130306598Z [2024-06-28T02:24:01.130+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:24:01.130371435Z [2024-06-28T02:24:01.130+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:24:01.130477448Z [2024-06-28T02:24:01.130+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:24:01.131072947Z [2024-06-28T02:24:01.130+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:24:01.131086348Z 2024-06-28T02:24:01.131090631Z 2024-06-28T02:24:01.131093972Z 2024-06-28T02:24:01.131097119Z 2024-06-28T02:24:01.134538968Z [2024-06-28T02:24:01.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:24:01.134639477Z [2024-06-28T02:24:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:24:01.134896387Z [2024-06-28T02:24:01.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:24:01.135015830Z [2024-06-28T02:24:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:24:01.135210840Z [2024-06-28T02:24:01.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:24:01.135367041Z [2024-06-28T02:24:01.135+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:24:01.135590921Z [2024-06-28T02:24:01.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:24:01.135684181Z [2024-06-28T02:24:01.135+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:24:01.679847923Z [2024-06-28T02:24:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:22:00+00:00 exited with status queued for try_number 1 2024-06-28T02:24:01.679959352Z [2024-06-28T02:24:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:23:00+00:00 exited with status queued for try_number 1 2024-06-28T02:24:01.680127013Z [2024-06-28T02:24:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:23:00+00:00 exited with status queued for try_number 1 2024-06-28T02:24:01.680284050Z [2024-06-28T02:24:01.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:23:00+00:00 exited with status queued for try_number 1 2024-06-28T02:24:01.695940408Z [2024-06-28T02:24:01.694+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1683e71f-fcbe-4996-a497-4bb22739ffa4 2024-06-28T02:24:01.696249020Z [2024-06-28T02:24:01.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to 272fd405-81ee-4b62-93be-838ba3068ba8 2024-06-28T02:24:01.697676617Z [2024-06-28T02:24:01.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53dc80e3-70c7-41eb-a7f6-daad5238d5e8 2024-06-28T02:24:01.697887344Z [2024-06-28T02:24:01.697+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9cb24f00-883f-495d-a063-01226aba3411 2024-06-28T02:24:02.905788788Z [2024-06-28T02:24:02.905+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:24:02.906394121Z [2024-06-28T02:24:02.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:22:00+00:00, run_id=scheduled__2024-06-28T02:22:00+00:00, run_start_date=2024-06-28 02:24:01.073776+00:00, run_end_date=2024-06-28 02:24:02.906016+00:00, run_duration=1.83224, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:22:00+00:00, data_interval_end=2024-06-28 02:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:24:02.913903573Z [2024-06-28T02:24:02.913+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:24:00+00:00, run_after=2024-06-28T02:26:00+00:00 2024-06-28T02:24:02.921016164Z [2024-06-28T02:24:02.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:24:02.921489832Z [2024-06-28T02:24:02.921+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:23:00+00:00, run_id=scheduled__2024-06-28T02:23:00+00:00, run_start_date=2024-06-28 02:24:01.075078+00:00, run_end_date=2024-06-28 02:24:02.921177+00:00, run_duration=1.846099, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:23:00+00:00, data_interval_end=2024-06-28 02:24:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:24:02.931246117Z [2024-06-28T02:24:02.930+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:24:00+00:00, run_after=2024-06-28T02:25:00+00:00 2024-06-28T02:24:02.991483174Z [2024-06-28T02:24:02.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:22:00+00:00 exited with status success for try_number 1 2024-06-28T02:24:02.991658653Z [2024-06-28T02:24:02.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:23:00+00:00 exited with status success for try_number 1 2024-06-28T02:24:02.998530267Z [2024-06-28T02:24:02.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:23:00+00:00, map_index=-1, run_start_date=2024-06-28 02:24:02.228873+00:00, run_end_date=2024-06-28 02:24:02.619059+00:00, run_duration=0.390186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1023, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:24:01.131855+00:00, queued_by_job_id=2, pid=14921 2024-06-28T02:24:02.998779107Z [2024-06-28T02:24:02.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:22:00+00:00, map_index=-1, run_start_date=2024-06-28 02:24:02.190773+00:00, run_end_date=2024-06-28 02:24:02.725368+00:00, run_duration=0.534595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1022, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:24:01.131855+00:00, queued_by_job_id=2, pid=14920 2024-06-28T02:24:06.474472361Z [2024-06-28T02:24:06.474+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:24:06.474629056Z [2024-06-28T02:24:06.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:23:00+00:00, run_id=scheduled__2024-06-28T02:23:00+00:00, run_start_date=2024-06-28 02:24:01.076512+00:00, run_end_date=2024-06-28 02:24:06.474390+00:00, run_duration=5.397878, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:23:00+00:00, data_interval_end=2024-06-28 02:24:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:24:06.482858367Z [2024-06-28T02:24:06.482+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:24:00+00:00, run_after=2024-06-28T02:25:00+00:00 2024-06-28T02:24:06.504671086Z [2024-06-28T02:24:06.504+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:24:06.505532895Z [2024-06-28T02:24:06.505+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:23:00+00:00, run_id=scheduled__2024-06-28T02:23:00+00:00, run_start_date=2024-06-28 02:24:01.077498+00:00, run_end_date=2024-06-28 02:24:06.504934+00:00, run_duration=5.427436, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:23:00+00:00, data_interval_end=2024-06-28 02:24:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:24:06.534766660Z [2024-06-28T02:24:06.526+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:24:00+00:00, run_after=2024-06-28T02:25:00+00:00 2024-06-28T02:24:06.589213074Z [2024-06-28T02:24:06.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:23:00+00:00 exited with status success for try_number 1 2024-06-28T02:24:06.589517994Z [2024-06-28T02:24:06.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:23:00+00:00 exited with status success for try_number 1 2024-06-28T02:24:06.595658346Z [2024-06-28T02:24:06.595+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:23:00+00:00, map_index=-1, run_start_date=2024-06-28 02:24:03.705337+00:00, run_end_date=2024-06-28 02:24:05.291637+00:00, run_duration=1.5863, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1025, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:24:01.131855+00:00, queued_by_job_id=2, pid=14945 2024-06-28T02:24:06.595965476Z [2024-06-28T02:24:06.595+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:23:00+00:00, map_index=-1, run_start_date=2024-06-28 02:24:03.510381+00:00, run_end_date=2024-06-28 02:24:05.471786+00:00, run_duration=1.961405, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1024, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:24:01.131855+00:00, queued_by_job_id=2, pid=14944 2024-06-28T02:25:01.082248341Z [2024-06-28T02:25:01.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:25:00+00:00, run_after=2024-06-28T02:26:00+00:00 2024-06-28T02:25:01.104915748Z [2024-06-28T02:25:01.104+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:25:00+00:00, run_after=2024-06-28T02:30:00+00:00 2024-06-28T02:25:01.115461959Z [2024-06-28T02:25:01.115+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:25:01.132438458Z [2024-06-28T02:25:01.132+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:25:00+00:00, run_after=2024-06-28T02:26:00+00:00 2024-06-28T02:25:01.242651806Z [2024-06-28T02:25:01.241+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:25:01.242729796Z 2024-06-28T02:25:01.242739227Z 2024-06-28T02:25:01.242745187Z 2024-06-28T02:25:01.242751822Z 2024-06-28T02:25:01.243253003Z [2024-06-28T02:25:01.242+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:25:01.246171614Z [2024-06-28T02:25:01.245+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:25:01.246621291Z [2024-06-28T02:25:01.246+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:25:01.247692390Z [2024-06-28T02:25:01.247+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:25:01.249251217Z [2024-06-28T02:25:01.248+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:25:01.249270948Z 2024-06-28T02:25:01.249277185Z 2024-06-28T02:25:01.249282577Z 2024-06-28T02:25:01.249288065Z 2024-06-28T02:25:01.257340457Z [2024-06-28T02:25:01.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T02:25:01.257802696Z [2024-06-28T02:25:01.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:25:01.258347254Z [2024-06-28T02:25:01.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:25:01.258564404Z [2024-06-28T02:25:01.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:25:01.259148035Z [2024-06-28T02:25:01.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:25:01.259431713Z [2024-06-28T02:25:01.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:25:01.260521346Z [2024-06-28T02:25:01.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:25:01.260722321Z [2024-06-28T02:25:01.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:25:01.754541554Z [2024-06-28T02:25:01.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:20:00+00:00 exited with status queued for try_number 1 2024-06-28T02:25:01.754623075Z [2024-06-28T02:25:01.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:24:00+00:00 exited with status queued for try_number 1 2024-06-28T02:25:01.754914700Z [2024-06-28T02:25:01.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:24:00+00:00 exited with status queued for try_number 1 2024-06-28T02:25:01.755087920Z [2024-06-28T02:25:01.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:24:00+00:00 exited with status queued for try_number 1 2024-06-28T02:25:01.772276459Z [2024-06-28T02:25:01.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38edc904-cbb4-403f-8eb6-4a2821d0a332 2024-06-28T02:25:01.772369363Z [2024-06-28T02:25:01.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ae5be6e-58d6-44f6-be99-53c539baa52b 2024-06-28T02:25:01.772555259Z [2024-06-28T02:25:01.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f595ac9-ed73-4129-b882-f2f03ff95c43 2024-06-28T02:25:01.772698008Z [2024-06-28T02:25:01.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0dda846f-f7be-4ea7-b0a1-a3be3b9fcf17 2024-06-28T02:25:04.052082549Z [2024-06-28T02:25:04.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:25:04.052692909Z [2024-06-28T02:25:04.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:24:00+00:00, run_id=scheduled__2024-06-28T02:24:00+00:00, run_start_date=2024-06-28 02:25:01.147823+00:00, run_end_date=2024-06-28 02:25:04.051992+00:00, run_duration=2.904169, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:24:00+00:00, data_interval_end=2024-06-28 02:25:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:25:04.073558151Z [2024-06-28T02:25:04.073+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:25:00+00:00, run_after=2024-06-28T02:26:00+00:00 2024-06-28T02:25:04.236267662Z [2024-06-28T02:25:04.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:24:00+00:00 exited with status success for try_number 1 2024-06-28T02:25:04.250207048Z [2024-06-28T02:25:04.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:24:00+00:00, map_index=-1, run_start_date=2024-06-28 02:25:02.359505+00:00, run_end_date=2024-06-28 02:25:02.985767+00:00, run_duration=0.626262, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1026, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:25:01.251166+00:00, queued_by_job_id=2, pid=14979 2024-06-28T02:25:04.681278407Z [2024-06-28T02:25:04.680+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:25:04.681304692Z 2024-06-28T02:25:04.681745225Z [2024-06-28T02:25:04.681+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:25:04.682527290Z [2024-06-28T02:25:04.682+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:25:04.682539209Z 2024-06-28T02:25:04.685178413Z [2024-06-28T02:25:04.684+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T02:25:04.685470471Z [2024-06-28T02:25:04.685+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:25:04.742682234Z [2024-06-28T02:25:04.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:20:00+00:00 exited with status queued for try_number 1 2024-06-28T02:25:04.743031498Z [2024-06-28T02:25:04.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:20:00+00:00 exited with status success for try_number 1 2024-06-28T02:25:04.748857183Z [2024-06-28T02:25:04.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to 592bde92-f4ba-45ca-ae3b-2dc79749ee2e 2024-06-28T02:25:04.749287138Z [2024-06-28T02:25:04.749+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T02:20:00+00:00, map_index=-1, run_start_date=2024-06-28 02:25:03.729077+00:00, run_end_date=2024-06-28 02:25:04.331860+00:00, run_duration=0.602783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1029, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:25:01.251166+00:00, queued_by_job_id=2, pid=15014 2024-06-28T02:25:05.903887994Z [2024-06-28T02:25:05.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:25:05.904274542Z [2024-06-28T02:25:05.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:24:00+00:00, run_id=scheduled__2024-06-28T02:24:00+00:00, run_start_date=2024-06-28 02:25:01.148985+00:00, run_end_date=2024-06-28 02:25:05.903980+00:00, run_duration=4.754995, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:24:00+00:00, data_interval_end=2024-06-28 02:25:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:25:05.913398452Z [2024-06-28T02:25:05.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:25:00+00:00, run_after=2024-06-28T02:26:00+00:00 2024-06-28T02:25:05.920156078Z [2024-06-28T02:25:05.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:25:05.920534220Z [2024-06-28T02:25:05.920+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:24:00+00:00, run_id=scheduled__2024-06-28T02:24:00+00:00, run_start_date=2024-06-28 02:25:01.150120+00:00, run_end_date=2024-06-28 02:25:05.920259+00:00, run_duration=4.770139, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:24:00+00:00, data_interval_end=2024-06-28 02:25:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:25:05.929073128Z [2024-06-28T02:25:05.928+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:25:00+00:00, run_after=2024-06-28T02:26:00+00:00 2024-06-28T02:25:06.008651105Z [2024-06-28T02:25:06.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:24:00+00:00 exited with status success for try_number 1 2024-06-28T02:25:06.008730367Z [2024-06-28T02:25:06.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:24:00+00:00 exited with status success for try_number 1 2024-06-28T02:25:06.019624640Z [2024-06-28T02:25:06.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:24:00+00:00, map_index=-1, run_start_date=2024-06-28 02:25:03.377285+00:00, run_end_date=2024-06-28 02:25:05.204442+00:00, run_duration=1.827157, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1028, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:25:01.251166+00:00, queued_by_job_id=2, pid=15003 2024-06-28T02:25:06.019854158Z [2024-06-28T02:25:06.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:24:00+00:00, map_index=-1, run_start_date=2024-06-28 02:25:03.118944+00:00, run_end_date=2024-06-28 02:25:05.369433+00:00, run_duration=2.250489, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1027, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:25:01.251166+00:00, queued_by_job_id=2, pid=14992 2024-06-28T02:25:08.177196742Z [2024-06-28T02:25:08.176+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:25:08.177246631Z 2024-06-28T02:25:08.177736463Z [2024-06-28T02:25:08.177+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:25:08.179496289Z [2024-06-28T02:25:08.178+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:25:08.179551146Z 2024-06-28T02:25:08.184241870Z [2024-06-28T02:25:08.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T02:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T02:25:08.184642957Z [2024-06-28T02:25:08.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T02:25:08.238962061Z [2024-06-28T02:25:08.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:20:00+00:00 exited with status queued for try_number 1 2024-06-28T02:25:08.239220895Z [2024-06-28T02:25:08.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:20:00+00:00 exited with status success for try_number 1 2024-06-28T02:25:08.245922612Z [2024-06-28T02:25:08.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0290e687-8176-4853-ae87-18ce18d7161b 2024-06-28T02:25:08.246207569Z [2024-06-28T02:25:08.245+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T02:20:00+00:00, map_index=-1, run_start_date=2024-06-28 02:25:06.958468+00:00, run_end_date=2024-06-28 02:25:07.323218+00:00, run_duration=0.36475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1030, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:25:04.683296+00:00, queued_by_job_id=2, pid=15027 2024-06-28T02:25:12.027235697Z [2024-06-28T02:25:12.026+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:25:12.027285760Z 2024-06-28T02:25:12.027463796Z [2024-06-28T02:25:12.027+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:25:12.028271091Z [2024-06-28T02:25:12.028+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:25:12.028284859Z 2024-06-28T02:25:12.031565958Z [2024-06-28T02:25:12.031+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:25:12.031756961Z [2024-06-28T02:25:12.031+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:25:12.100891251Z [2024-06-28T02:25:12.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:20:00+00:00 exited with status queued for try_number 1 2024-06-28T02:25:12.101086090Z [2024-06-28T02:25:12.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:20:00+00:00 exited with status success for try_number 1 2024-06-28T02:25:12.108271074Z [2024-06-28T02:25:12.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to 840ba20f-014b-4356-aafd-24de7002f9e8 2024-06-28T02:25:12.108516786Z [2024-06-28T02:25:12.108+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T02:20:00+00:00, map_index=0, run_start_date=2024-06-28 02:25:10.101252+00:00, run_end_date=2024-06-28 02:25:11.511312+00:00, run_duration=1.41006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1031, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:25:08.180402+00:00, queued_by_job_id=2, pid=15035 2024-06-28T02:25:14.629683333Z [2024-06-28T02:25:14.629+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:25:14.629820508Z [2024-06-28T02:25:14.629+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:20:00+00:00, run_id=scheduled__2024-06-28T02:20:00+00:00, run_start_date=2024-06-28 02:25:01.146421+00:00, run_end_date=2024-06-28 02:25:14.629414+00:00, run_duration=13.482993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:20:00+00:00, data_interval_end=2024-06-28 02:25:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T02:25:14.640459444Z [2024-06-28T02:25:14.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:25:00+00:00, run_after=2024-06-28T02:30:00+00:00 2024-06-28T02:25:14.696329894Z [2024-06-28T02:25:14.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:20:00+00:00 exited with status success for try_number 1 2024-06-28T02:25:14.705747735Z [2024-06-28T02:25:14.705+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T02:20:00+00:00, map_index=-1, run_start_date=2024-06-28 02:25:13.824417+00:00, run_end_date=2024-06-28 02:25:14.264548+00:00, run_duration=0.440131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1032, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:25:12.028803+00:00, queued_by_job_id=2, pid=15048 2024-06-28T02:26:00.053608116Z [2024-06-28T02:26:00.052+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:26:00.069254450Z [2024-06-28T02:26:00.068+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:26:00+00:00, run_after=2024-06-28T02:27:00+00:00 2024-06-28T02:26:00.076726724Z [2024-06-28T02:26:00.076+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:26:00.093557673Z [2024-06-28T02:26:00.093+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:26:00+00:00, run_after=2024-06-28T02:27:00+00:00 2024-06-28T02:26:00.207658704Z [2024-06-28T02:26:00.207+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:26:00.207711117Z 2024-06-28T02:26:00.207716867Z 2024-06-28T02:26:00.207721419Z 2024-06-28T02:26:00.207725842Z 2024-06-28T02:26:00.207978819Z [2024-06-28T02:26:00.207+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:26:00.208213767Z [2024-06-28T02:26:00.207+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:26:00.208419188Z [2024-06-28T02:26:00.208+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:26:00.208579631Z [2024-06-28T02:26:00.208+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:26:00.209346916Z [2024-06-28T02:26:00.209+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:26:00.209361718Z 2024-06-28T02:26:00.209369036Z 2024-06-28T02:26:00.209374087Z 2024-06-28T02:26:00.209379173Z 2024-06-28T02:26:00.213347412Z [2024-06-28T02:26:00.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:26:00.213578597Z [2024-06-28T02:26:00.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:26:00.213981416Z [2024-06-28T02:26:00.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:26:00.213989759Z [2024-06-28T02:26:00.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:26:00.214353191Z [2024-06-28T02:26:00.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:26:00.214636816Z [2024-06-28T02:26:00.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:26:00.214978531Z [2024-06-28T02:26:00.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:26:00.215241617Z [2024-06-28T02:26:00.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:26:00.604482201Z [2024-06-28T02:26:00.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:24:00+00:00 exited with status queued for try_number 1 2024-06-28T02:26:00.604516530Z [2024-06-28T02:26:00.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:25:00+00:00 exited with status queued for try_number 1 2024-06-28T02:26:00.604555837Z [2024-06-28T02:26:00.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:25:00+00:00 exited with status queued for try_number 1 2024-06-28T02:26:00.604600933Z [2024-06-28T02:26:00.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:25:00+00:00 exited with status queued for try_number 1 2024-06-28T02:26:00.615049190Z [2024-06-28T02:26:00.614+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8fd9b6f-3e78-46cb-8957-d982e6109e3c 2024-06-28T02:26:00.615111495Z [2024-06-28T02:26:00.614+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc21383d-96d2-4ec9-84bb-f1ceb617d2f3 2024-06-28T02:26:00.615218891Z [2024-06-28T02:26:00.615+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21ca52ba-a63c-4761-9645-8a702c2436d6 2024-06-28T02:26:00.615319654Z [2024-06-28T02:26:00.615+0000] {scheduler_job.py:635} INFO - Setting external_id for to a967ecf7-4210-49f1-aaa9-e0dbfc172318 2024-06-28T02:26:01.992484036Z [2024-06-28T02:26:01.992+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:26:01.992958291Z [2024-06-28T02:26:01.992+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:24:00+00:00, run_id=scheduled__2024-06-28T02:24:00+00:00, run_start_date=2024-06-28 02:26:00.111767+00:00, run_end_date=2024-06-28 02:26:01.992368+00:00, run_duration=1.880601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:24:00+00:00, data_interval_end=2024-06-28 02:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:26:02.012037847Z [2024-06-28T02:26:02.011+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:26:00+00:00, run_after=2024-06-28T02:28:00+00:00 2024-06-28T02:26:02.021674396Z [2024-06-28T02:26:02.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:26:02.021978447Z [2024-06-28T02:26:02.021+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:25:00+00:00, run_id=scheduled__2024-06-28T02:25:00+00:00, run_start_date=2024-06-28 02:26:00.115450+00:00, run_end_date=2024-06-28 02:26:02.021685+00:00, run_duration=1.906235, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:25:00+00:00, data_interval_end=2024-06-28 02:26:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:26:02.038137948Z [2024-06-28T02:26:02.037+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:26:00+00:00, run_after=2024-06-28T02:27:00+00:00 2024-06-28T02:26:02.098300871Z [2024-06-28T02:26:02.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:24:00+00:00 exited with status success for try_number 1 2024-06-28T02:26:02.098509710Z [2024-06-28T02:26:02.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:25:00+00:00 exited with status success for try_number 1 2024-06-28T02:26:02.105601544Z [2024-06-28T02:26:02.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:24:00+00:00, map_index=-1, run_start_date=2024-06-28 02:26:01.090681+00:00, run_end_date=2024-06-28 02:26:01.476208+00:00, run_duration=0.385527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1033, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:26:00.210310+00:00, queued_by_job_id=2, pid=15071 2024-06-28T02:26:02.106145472Z [2024-06-28T02:26:02.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:25:00+00:00, map_index=-1, run_start_date=2024-06-28 02:26:01.109882+00:00, run_end_date=2024-06-28 02:26:01.506234+00:00, run_duration=0.396352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1034, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:26:00.210310+00:00, queued_by_job_id=2, pid=15072 2024-06-28T02:26:04.273455079Z [2024-06-28T02:26:04.273+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:26:04.274457686Z [2024-06-28T02:26:04.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:25:00+00:00, run_id=scheduled__2024-06-28T02:25:00+00:00, run_start_date=2024-06-28 02:26:00.121786+00:00, run_end_date=2024-06-28 02:26:04.274064+00:00, run_duration=4.152278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:25:00+00:00, data_interval_end=2024-06-28 02:26:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:26:04.288581933Z [2024-06-28T02:26:04.288+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:26:00+00:00, run_after=2024-06-28T02:27:00+00:00 2024-06-28T02:26:04.300254210Z [2024-06-28T02:26:04.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:26:04.300749473Z [2024-06-28T02:26:04.300+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:25:00+00:00, run_id=scheduled__2024-06-28T02:25:00+00:00, run_start_date=2024-06-28 02:26:00.118221+00:00, run_end_date=2024-06-28 02:26:04.300297+00:00, run_duration=4.182076, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:25:00+00:00, data_interval_end=2024-06-28 02:26:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:26:04.311839063Z [2024-06-28T02:26:04.311+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:26:00+00:00, run_after=2024-06-28T02:27:00+00:00 2024-06-28T02:26:04.341869091Z [2024-06-28T02:26:04.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:25:00+00:00 exited with status success for try_number 1 2024-06-28T02:26:04.341956744Z [2024-06-28T02:26:04.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:25:00+00:00 exited with status success for try_number 1 2024-06-28T02:26:04.347671005Z [2024-06-28T02:26:04.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:25:00+00:00, map_index=-1, run_start_date=2024-06-28 02:26:02.231601+00:00, run_end_date=2024-06-28 02:26:03.598969+00:00, run_duration=1.367368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1036, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:26:00.210310+00:00, queued_by_job_id=2, pid=15096 2024-06-28T02:26:04.347950383Z [2024-06-28T02:26:04.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:25:00+00:00, map_index=-1, run_start_date=2024-06-28 02:26:02.142196+00:00, run_end_date=2024-06-28 02:26:03.722558+00:00, run_duration=1.580362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1035, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:26:00.210310+00:00, queued_by_job_id=2, pid=15095 2024-06-28T02:26:47.461583708Z [2024-06-28T02:26:47.460+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T02:27:00.156374172Z [2024-06-28T02:27:00.155+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:27:00+00:00, run_after=2024-06-28T02:28:00+00:00 2024-06-28T02:27:00.171697603Z [2024-06-28T02:27:00.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:27:00+00:00, run_after=2024-06-28T02:28:00+00:00 2024-06-28T02:27:00.179801874Z [2024-06-28T02:27:00.179+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:27:00.248215598Z [2024-06-28T02:27:00.247+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:27:00.248257488Z 2024-06-28T02:27:00.248261884Z 2024-06-28T02:27:00.248264939Z 2024-06-28T02:27:00.248268100Z [2024-06-28T02:27:00.248+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:27:00.248718356Z [2024-06-28T02:27:00.248+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:27:00.248925141Z [2024-06-28T02:27:00.248+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:27:00.249664337Z [2024-06-28T02:27:00.249+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:27:00.249676415Z 2024-06-28T02:27:00.249680190Z 2024-06-28T02:27:00.249683464Z 2024-06-28T02:27:00.252774615Z [2024-06-28T02:27:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:27:00.252984079Z [2024-06-28T02:27:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:27:00.253316656Z [2024-06-28T02:27:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:27:00.253535115Z [2024-06-28T02:27:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:27:00.253831286Z [2024-06-28T02:27:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:27:00.254041449Z [2024-06-28T02:27:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:27:00.489608206Z [2024-06-28T02:27:00.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:26:00+00:00 exited with status queued for try_number 1 2024-06-28T02:27:00.489656208Z [2024-06-28T02:27:00.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:26:00+00:00 exited with status queued for try_number 1 2024-06-28T02:27:00.489939887Z [2024-06-28T02:27:00.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:26:00+00:00 exited with status queued for try_number 1 2024-06-28T02:27:00.499379478Z [2024-06-28T02:27:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2791226f-aada-48a4-a7ed-52af4e5e385f 2024-06-28T02:27:00.499438044Z [2024-06-28T02:27:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 606165ad-a5ac-4264-9c6b-3523ee51b8ca 2024-06-28T02:27:00.499667255Z [2024-06-28T02:27:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c25a955-be28-46ce-adb9-fb8972d2c359 2024-06-28T02:27:01.799809284Z [2024-06-28T02:27:01.799+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:27:01.800530505Z [2024-06-28T02:27:01.800+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:26:00+00:00, run_id=scheduled__2024-06-28T02:26:00+00:00, run_start_date=2024-06-28 02:27:00.195135+00:00, run_end_date=2024-06-28 02:27:01.800022+00:00, run_duration=1.604887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:26:00+00:00, data_interval_end=2024-06-28 02:27:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:27:01.813025851Z [2024-06-28T02:27:01.812+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:27:00+00:00, run_after=2024-06-28T02:28:00+00:00 2024-06-28T02:27:01.876935563Z [2024-06-28T02:27:01.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:26:00+00:00 exited with status success for try_number 1 2024-06-28T02:27:01.897366671Z [2024-06-28T02:27:01.896+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:26:00+00:00, map_index=-1, run_start_date=2024-06-28 02:27:01.079447+00:00, run_end_date=2024-06-28 02:27:01.508133+00:00, run_duration=0.428686, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1037, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:27:00.250357+00:00, queued_by_job_id=2, pid=15129 2024-06-28T02:27:04.082398477Z [2024-06-28T02:27:04.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:27:04.082432994Z [2024-06-28T02:27:04.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:26:00+00:00, run_id=scheduled__2024-06-28T02:26:00+00:00, run_start_date=2024-06-28 02:27:00.196446+00:00, run_end_date=2024-06-28 02:27:04.081067+00:00, run_duration=3.884621, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:26:00+00:00, data_interval_end=2024-06-28 02:27:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:27:04.107952574Z [2024-06-28T02:27:04.107+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:27:00+00:00, run_after=2024-06-28T02:28:00+00:00 2024-06-28T02:27:04.120245166Z [2024-06-28T02:27:04.116+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:27:04.120285557Z [2024-06-28T02:27:04.117+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:26:00+00:00, run_id=scheduled__2024-06-28T02:26:00+00:00, run_start_date=2024-06-28 02:27:00.197440+00:00, run_end_date=2024-06-28 02:27:04.117124+00:00, run_duration=3.919684, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:26:00+00:00, data_interval_end=2024-06-28 02:27:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:27:04.134884858Z [2024-06-28T02:27:04.134+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:27:00+00:00, run_after=2024-06-28T02:28:00+00:00 2024-06-28T02:27:04.172694286Z [2024-06-28T02:27:04.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:26:00+00:00 exited with status success for try_number 1 2024-06-28T02:27:04.172916361Z [2024-06-28T02:27:04.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:26:00+00:00 exited with status success for try_number 1 2024-06-28T02:27:04.181593101Z [2024-06-28T02:27:04.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:26:00+00:00, map_index=-1, run_start_date=2024-06-28 02:27:02.096968+00:00, run_end_date=2024-06-28 02:27:03.466009+00:00, run_duration=1.369041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1038, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:27:00.250357+00:00, queued_by_job_id=2, pid=15147 2024-06-28T02:27:04.182170568Z [2024-06-28T02:27:04.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:26:00+00:00, map_index=-1, run_start_date=2024-06-28 02:27:02.186844+00:00, run_end_date=2024-06-28 02:27:03.907101+00:00, run_duration=1.720257, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1039, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:27:00.250357+00:00, queued_by_job_id=2, pid=15148 2024-06-28T02:28:00.422866777Z [2024-06-28T02:28:00.422+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:28:00+00:00, run_after=2024-06-28T02:29:00+00:00 2024-06-28T02:28:00.433816208Z [2024-06-28T02:28:00.433+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:28:00.443034702Z [2024-06-28T02:28:00.442+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:28:00.457581843Z [2024-06-28T02:28:00.457+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:28:00+00:00, run_after=2024-06-28T02:29:00+00:00 2024-06-28T02:28:00.558281975Z [2024-06-28T02:28:00.557+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:28:00.558387900Z 2024-06-28T02:28:00.558399179Z 2024-06-28T02:28:00.558408090Z 2024-06-28T02:28:00.558417232Z 2024-06-28T02:28:00.558455676Z [2024-06-28T02:28:00.558+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:28:00.558669528Z [2024-06-28T02:28:00.558+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:28:00.558946813Z [2024-06-28T02:28:00.558+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:28:00.559201598Z [2024-06-28T02:28:00.558+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:28:00.560079051Z [2024-06-28T02:28:00.559+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:28:00.560103074Z 2024-06-28T02:28:00.560113450Z 2024-06-28T02:28:00.560122331Z 2024-06-28T02:28:00.560130999Z 2024-06-28T02:28:00.566051511Z [2024-06-28T02:28:00.565+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:28:00.566215887Z [2024-06-28T02:28:00.565+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:28:00.566587081Z [2024-06-28T02:28:00.566+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:28:00.566831478Z [2024-06-28T02:28:00.566+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:28:00.567176839Z [2024-06-28T02:28:00.566+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:28:00.567305652Z [2024-06-28T02:28:00.567+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:28:00.567633876Z [2024-06-28T02:28:00.567+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:28:00.567802732Z [2024-06-28T02:28:00.567+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:28:00.953300611Z [2024-06-28T02:28:00.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:26:00+00:00 exited with status queued for try_number 1 2024-06-28T02:28:00.953438491Z [2024-06-28T02:28:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:27:00+00:00 exited with status queued for try_number 1 2024-06-28T02:28:00.953534321Z [2024-06-28T02:28:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:27:00+00:00 exited with status queued for try_number 1 2024-06-28T02:28:00.953758986Z [2024-06-28T02:28:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:27:00+00:00 exited with status queued for try_number 1 2024-06-28T02:28:00.970989918Z [2024-06-28T02:28:00.970+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6235bab-1806-48bc-8729-ea4a39de644e 2024-06-28T02:28:00.971226321Z [2024-06-28T02:28:00.971+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2730feaa-4a2e-45ef-8c0a-f43d5dd9815e 2024-06-28T02:28:00.971423547Z [2024-06-28T02:28:00.971+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b27f735-adec-4e08-b149-860f35549086 2024-06-28T02:28:00.971583828Z [2024-06-28T02:28:00.971+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82b2343b-675c-4065-a449-ebb7fe6da509 2024-06-28T02:28:02.310922491Z [2024-06-28T02:28:02.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:28:02.311132652Z [2024-06-28T02:28:02.310+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:26:00+00:00, run_id=scheduled__2024-06-28T02:26:00+00:00, run_start_date=2024-06-28 02:28:00.471272+00:00, run_end_date=2024-06-28 02:28:02.310840+00:00, run_duration=1.839568, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:26:00+00:00, data_interval_end=2024-06-28 02:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:28:02.319431838Z [2024-06-28T02:28:02.319+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:28:00+00:00, run_after=2024-06-28T02:30:00+00:00 2024-06-28T02:28:02.327792874Z [2024-06-28T02:28:02.327+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:28:02.328323924Z [2024-06-28T02:28:02.328+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:27:00+00:00, run_id=scheduled__2024-06-28T02:27:00+00:00, run_start_date=2024-06-28 02:28:00.472658+00:00, run_end_date=2024-06-28 02:28:02.327705+00:00, run_duration=1.855047, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:27:00+00:00, data_interval_end=2024-06-28 02:28:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:28:02.338595344Z [2024-06-28T02:28:02.338+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:28:00+00:00, run_after=2024-06-28T02:29:00+00:00 2024-06-28T02:28:02.385222305Z [2024-06-28T02:28:02.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:26:00+00:00 exited with status success for try_number 1 2024-06-28T02:28:02.385270946Z [2024-06-28T02:28:02.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:27:00+00:00 exited with status success for try_number 1 2024-06-28T02:28:02.396392739Z [2024-06-28T02:28:02.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:26:00+00:00, map_index=-1, run_start_date=2024-06-28 02:28:01.483469+00:00, run_end_date=2024-06-28 02:28:01.849824+00:00, run_duration=0.366355, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1040, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:28:00.561267+00:00, queued_by_job_id=2, pid=15183 2024-06-28T02:28:02.396638435Z [2024-06-28T02:28:02.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:27:00+00:00, map_index=-1, run_start_date=2024-06-28 02:28:01.510402+00:00, run_end_date=2024-06-28 02:28:01.966024+00:00, run_duration=0.455622, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1041, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:28:00.561267+00:00, queued_by_job_id=2, pid=15182 2024-06-28T02:28:05.155944161Z [2024-06-28T02:28:05.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:28:05.156170339Z [2024-06-28T02:28:05.155+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:27:00+00:00, run_id=scheduled__2024-06-28T02:27:00+00:00, run_start_date=2024-06-28 02:28:00.473941+00:00, run_end_date=2024-06-28 02:28:05.155843+00:00, run_duration=4.681902, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:27:00+00:00, data_interval_end=2024-06-28 02:28:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:28:05.167368574Z [2024-06-28T02:28:05.167+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:28:00+00:00, run_after=2024-06-28T02:29:00+00:00 2024-06-28T02:28:05.180478090Z [2024-06-28T02:28:05.179+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:28:05.180987587Z [2024-06-28T02:28:05.180+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:27:00+00:00, run_id=scheduled__2024-06-28T02:27:00+00:00, run_start_date=2024-06-28 02:28:00.475272+00:00, run_end_date=2024-06-28 02:28:05.180426+00:00, run_duration=4.705154, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:27:00+00:00, data_interval_end=2024-06-28 02:28:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:28:05.206264257Z [2024-06-28T02:28:05.205+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:28:00+00:00, run_after=2024-06-28T02:29:00+00:00 2024-06-28T02:28:05.257345044Z [2024-06-28T02:28:05.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:27:00+00:00 exited with status success for try_number 1 2024-06-28T02:28:05.257567842Z [2024-06-28T02:28:05.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:27:00+00:00 exited with status success for try_number 1 2024-06-28T02:28:05.267090303Z [2024-06-28T02:28:05.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:27:00+00:00, map_index=-1, run_start_date=2024-06-28 02:28:02.668441+00:00, run_end_date=2024-06-28 02:28:04.189576+00:00, run_duration=1.521135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1043, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:28:00.561267+00:00, queued_by_job_id=2, pid=15207 2024-06-28T02:28:05.267322398Z [2024-06-28T02:28:05.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:27:00+00:00, map_index=-1, run_start_date=2024-06-28 02:28:02.575854+00:00, run_end_date=2024-06-28 02:28:04.710721+00:00, run_duration=2.134867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1042, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:28:00.561267+00:00, queued_by_job_id=2, pid=15206 2024-06-28T02:29:00.642293592Z [2024-06-28T02:29:00.641+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:29:00+00:00, run_after=2024-06-28T02:30:00+00:00 2024-06-28T02:29:00.660743992Z [2024-06-28T02:29:00.660+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:29:00+00:00, run_after=2024-06-28T02:30:00+00:00 2024-06-28T02:29:00.670565457Z [2024-06-28T02:29:00.670+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:29:00.760542565Z [2024-06-28T02:29:00.760+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:29:00.760577401Z 2024-06-28T02:29:00.760584795Z 2024-06-28T02:29:00.760590707Z 2024-06-28T02:29:00.760940788Z [2024-06-28T02:29:00.760+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:29:00.761347575Z [2024-06-28T02:29:00.761+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:29:00.762014608Z [2024-06-28T02:29:00.761+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:29:00.763152493Z [2024-06-28T02:29:00.762+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:29:00.763177599Z 2024-06-28T02:29:00.763186942Z 2024-06-28T02:29:00.763195464Z 2024-06-28T02:29:00.768328492Z [2024-06-28T02:29:00.767+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:29:00.768567877Z [2024-06-28T02:29:00.768+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:29:00.768946841Z [2024-06-28T02:29:00.768+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:29:00.769195130Z [2024-06-28T02:29:00.768+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:29:00.769561663Z [2024-06-28T02:29:00.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:29:00.769735370Z [2024-06-28T02:29:00.769+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:29:00.977096466Z [2024-06-28T02:29:00.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:28:00+00:00 exited with status queued for try_number 1 2024-06-28T02:29:00.979361181Z [2024-06-28T02:29:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:28:00+00:00 exited with status queued for try_number 1 2024-06-28T02:29:00.979568819Z [2024-06-28T02:29:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:28:00+00:00 exited with status queued for try_number 1 2024-06-28T02:29:00.989076573Z [2024-06-28T02:29:00.988+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b717948-ed33-436c-8ede-37eae103e849 2024-06-28T02:29:00.989416175Z [2024-06-28T02:29:00.989+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff68f088-683c-4f91-bf15-d87242432a43 2024-06-28T02:29:00.989768418Z [2024-06-28T02:29:00.989+0000] {scheduler_job.py:635} INFO - Setting external_id for to be610f12-847c-4b87-81f9-3981b9c2040d 2024-06-28T02:29:02.150654914Z [2024-06-28T02:29:02.150+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:29:02.151049141Z [2024-06-28T02:29:02.150+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:28:00+00:00, run_id=scheduled__2024-06-28T02:28:00+00:00, run_start_date=2024-06-28 02:29:00.684795+00:00, run_end_date=2024-06-28 02:29:02.150499+00:00, run_duration=1.465704, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:28:00+00:00, data_interval_end=2024-06-28 02:29:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:29:02.162145790Z [2024-06-28T02:29:02.161+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:29:00+00:00, run_after=2024-06-28T02:30:00+00:00 2024-06-28T02:29:02.214598607Z [2024-06-28T02:29:02.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:28:00+00:00 exited with status success for try_number 1 2024-06-28T02:29:02.222512877Z [2024-06-28T02:29:02.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:28:00+00:00, map_index=-1, run_start_date=2024-06-28 02:29:01.488495+00:00, run_end_date=2024-06-28 02:29:01.873200+00:00, run_duration=0.384705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1044, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:29:00.764324+00:00, queued_by_job_id=2, pid=15239 2024-06-28T02:29:03.940786139Z [2024-06-28T02:29:03.940+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:29:03.940966544Z [2024-06-28T02:29:03.940+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:28:00+00:00, run_id=scheduled__2024-06-28T02:28:00+00:00, run_start_date=2024-06-28 02:29:00.686210+00:00, run_end_date=2024-06-28 02:29:03.940696+00:00, run_duration=3.254486, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:28:00+00:00, data_interval_end=2024-06-28 02:29:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:29:03.952907803Z [2024-06-28T02:29:03.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:29:00+00:00, run_after=2024-06-28T02:30:00+00:00 2024-06-28T02:29:05.081034255Z [2024-06-28T02:29:05.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:29:05.081500045Z [2024-06-28T02:29:05.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:28:00+00:00, run_id=scheduled__2024-06-28T02:28:00+00:00, run_start_date=2024-06-28 02:29:00.687445+00:00, run_end_date=2024-06-28 02:29:05.081193+00:00, run_duration=4.393748, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:28:00+00:00, data_interval_end=2024-06-28 02:29:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:29:05.090856094Z [2024-06-28T02:29:05.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:29:00+00:00, run_after=2024-06-28T02:30:00+00:00 2024-06-28T02:29:05.129251601Z [2024-06-28T02:29:05.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:28:00+00:00 exited with status success for try_number 1 2024-06-28T02:29:05.129725726Z [2024-06-28T02:29:05.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:28:00+00:00 exited with status success for try_number 1 2024-06-28T02:29:05.138962170Z [2024-06-28T02:29:05.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:28:00+00:00, map_index=-1, run_start_date=2024-06-28 02:29:02.485667+00:00, run_end_date=2024-06-28 02:29:03.873315+00:00, run_duration=1.387648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1046, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:29:00.764324+00:00, queued_by_job_id=2, pid=15257 2024-06-28T02:29:05.139477364Z [2024-06-28T02:29:05.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:28:00+00:00, map_index=-1, run_start_date=2024-06-28 02:29:02.489565+00:00, run_end_date=2024-06-28 02:29:04.210662+00:00, run_duration=1.721097, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1045, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:29:00.764324+00:00, queued_by_job_id=2, pid=15258 2024-06-28T02:30:00.956799444Z [2024-06-28T02:30:00.956+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:30:00.982880428Z [2024-06-28T02:30:00.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:30:00+00:00, run_after=2024-06-28T02:35:00+00:00 2024-06-28T02:30:01.006934437Z [2024-06-28T02:30:01.006+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:30:00+00:00, run_after=2024-06-28T02:31:00+00:00 2024-06-28T02:30:01.023152068Z [2024-06-28T02:30:01.022+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:30:00+00:00, run_after=2024-06-28T02:31:00+00:00 2024-06-28T02:30:01.031558627Z [2024-06-28T02:30:01.031+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:30:01.151694128Z [2024-06-28T02:30:01.151+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-28T02:30:01.151727424Z 2024-06-28T02:30:01.151732527Z 2024-06-28T02:30:01.151740283Z 2024-06-28T02:30:01.151754504Z 2024-06-28T02:30:01.151759225Z 2024-06-28T02:30:01.151938459Z [2024-06-28T02:30:01.151+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:30:01.152222982Z [2024-06-28T02:30:01.152+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:30:01.152400956Z [2024-06-28T02:30:01.152+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:30:01.152600664Z [2024-06-28T02:30:01.152+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:30:01.152818567Z [2024-06-28T02:30:01.152+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:30:01.153621389Z [2024-06-28T02:30:01.153+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:30:01.153637803Z 2024-06-28T02:30:01.153644425Z 2024-06-28T02:30:01.153649579Z 2024-06-28T02:30:01.153654806Z 2024-06-28T02:30:01.153659566Z 2024-06-28T02:30:01.158382768Z [2024-06-28T02:30:01.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T02:30:01.158657970Z [2024-06-28T02:30:01.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:30:01.159043345Z [2024-06-28T02:30:01.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:30:01.159266256Z [2024-06-28T02:30:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:30:01.159600961Z [2024-06-28T02:30:01.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:30:01.159858687Z [2024-06-28T02:30:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:30:01.160164434Z [2024-06-28T02:30:01.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:30:01.160373715Z [2024-06-28T02:30:01.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:30:01.160680549Z [2024-06-28T02:30:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:30:01.160871548Z [2024-06-28T02:30:01.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:30:01.606497135Z [2024-06-28T02:30:01.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:25:00+00:00 exited with status queued for try_number 1 2024-06-28T02:30:01.609052814Z [2024-06-28T02:30:01.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:28:00+00:00 exited with status queued for try_number 1 2024-06-28T02:30:01.609283828Z [2024-06-28T02:30:01.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:29:00+00:00 exited with status queued for try_number 1 2024-06-28T02:30:01.609337070Z [2024-06-28T02:30:01.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:29:00+00:00 exited with status queued for try_number 1 2024-06-28T02:30:01.609416544Z [2024-06-28T02:30:01.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:29:00+00:00 exited with status queued for try_number 1 2024-06-28T02:30:01.632190877Z [2024-06-28T02:30:01.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33c117fc-cb33-464e-8ff1-33ec7b71a01b 2024-06-28T02:30:01.632257326Z [2024-06-28T02:30:01.632+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6383d83-a2c6-4329-93ff-31342e3fb83b 2024-06-28T02:30:01.632451794Z [2024-06-28T02:30:01.632+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6b57bdc-24c4-4de1-a50c-38ab7046b13a 2024-06-28T02:30:01.632600332Z [2024-06-28T02:30:01.632+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6db8118-031b-4e9d-9d37-647b640b678e 2024-06-28T02:30:01.632744351Z [2024-06-28T02:30:01.632+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c369dbe-1183-4c56-843b-0843a1696bdf 2024-06-28T02:30:02.992660007Z [2024-06-28T02:30:02.992+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:30:02.993396588Z [2024-06-28T02:30:02.992+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:28:00+00:00, run_id=scheduled__2024-06-28T02:28:00+00:00, run_start_date=2024-06-28 02:30:01.043857+00:00, run_end_date=2024-06-28 02:30:02.992607+00:00, run_duration=1.94875, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:28:00+00:00, data_interval_end=2024-06-28 02:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:30:03.006594073Z [2024-06-28T02:30:03.006+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:30:00+00:00, run_after=2024-06-28T02:32:00+00:00 2024-06-28T02:30:03.015312060Z [2024-06-28T02:30:03.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:30:03.015621440Z [2024-06-28T02:30:03.015+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:29:00+00:00, run_id=scheduled__2024-06-28T02:29:00+00:00, run_start_date=2024-06-28 02:30:01.045020+00:00, run_end_date=2024-06-28 02:30:03.015244+00:00, run_duration=1.970224, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:29:00+00:00, data_interval_end=2024-06-28 02:30:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:30:03.029771107Z [2024-06-28T02:30:03.029+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:30:00+00:00, run_after=2024-06-28T02:31:00+00:00 2024-06-28T02:30:03.101912605Z [2024-06-28T02:30:03.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:28:00+00:00 exited with status success for try_number 1 2024-06-28T02:30:03.102019833Z [2024-06-28T02:30:03.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:29:00+00:00 exited with status success for try_number 1 2024-06-28T02:30:03.112627279Z [2024-06-28T02:30:03.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:28:00+00:00, map_index=-1, run_start_date=2024-06-28 02:30:02.107167+00:00, run_end_date=2024-06-28 02:30:02.541728+00:00, run_duration=0.434561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1047, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:30:01.154875+00:00, queued_by_job_id=2, pid=15292 2024-06-28T02:30:03.113053628Z [2024-06-28T02:30:03.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:29:00+00:00, map_index=-1, run_start_date=2024-06-28 02:30:02.173087+00:00, run_end_date=2024-06-28 02:30:02.682584+00:00, run_duration=0.509497, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1048, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:30:01.154875+00:00, queued_by_job_id=2, pid=15293 2024-06-28T02:30:04.993298941Z [2024-06-28T02:30:04.992+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:30:04.993712941Z [2024-06-28T02:30:04.993+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:29:00+00:00, run_id=scheduled__2024-06-28T02:29:00+00:00, run_start_date=2024-06-28 02:30:01.046084+00:00, run_end_date=2024-06-28 02:30:04.993216+00:00, run_duration=3.947132, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:29:00+00:00, data_interval_end=2024-06-28 02:30:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:30:05.007142547Z [2024-06-28T02:30:05.006+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:30:00+00:00, run_after=2024-06-28T02:31:00+00:00 2024-06-28T02:30:05.033406673Z [2024-06-28T02:30:05.033+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:30:05.033448697Z 2024-06-28T02:30:05.033624615Z [2024-06-28T02:30:05.033+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:30:05.034289155Z [2024-06-28T02:30:05.034+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:30:05.034301466Z 2024-06-28T02:30:05.037309705Z [2024-06-28T02:30:05.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T02:30:05.037526346Z [2024-06-28T02:30:05.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:30:05.091456773Z [2024-06-28T02:30:05.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:25:00+00:00 exited with status queued for try_number 1 2024-06-28T02:30:05.091580955Z [2024-06-28T02:30:05.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:25:00+00:00 exited with status success for try_number 1 2024-06-28T02:30:05.091798144Z [2024-06-28T02:30:05.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:29:00+00:00 exited with status success for try_number 1 2024-06-28T02:30:05.101570956Z [2024-06-28T02:30:05.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to 323f9339-1294-41f3-9387-062d2cbfc202 2024-06-28T02:30:05.101874791Z [2024-06-28T02:30:05.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T02:25:00+00:00, map_index=-1, run_start_date=2024-06-28 02:30:03.793294+00:00, run_end_date=2024-06-28 02:30:04.325694+00:00, run_duration=0.5324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1051, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:30:01.154875+00:00, queued_by_job_id=2, pid=15327 2024-06-28T02:30:05.102243737Z [2024-06-28T02:30:05.102+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:29:00+00:00, map_index=-1, run_start_date=2024-06-28 02:30:03.523078+00:00, run_end_date=2024-06-28 02:30:04.876854+00:00, run_duration=1.353776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1050, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:30:01.154875+00:00, queued_by_job_id=2, pid=15318 2024-06-28T02:30:06.356871807Z [2024-06-28T02:30:06.356+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:30:06.357080522Z [2024-06-28T02:30:06.356+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:29:00+00:00, run_id=scheduled__2024-06-28T02:29:00+00:00, run_start_date=2024-06-28 02:30:01.047295+00:00, run_end_date=2024-06-28 02:30:06.356734+00:00, run_duration=5.309439, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:29:00+00:00, data_interval_end=2024-06-28 02:30:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:30:06.366543641Z [2024-06-28T02:30:06.366+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:30:00+00:00, run_after=2024-06-28T02:31:00+00:00 2024-06-28T02:30:06.517319549Z [2024-06-28T02:30:06.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:29:00+00:00 exited with status success for try_number 1 2024-06-28T02:30:06.541371050Z [2024-06-28T02:30:06.541+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:29:00+00:00, map_index=-1, run_start_date=2024-06-28 02:30:03.437747+00:00, run_end_date=2024-06-28 02:30:05.207909+00:00, run_duration=1.770162, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1049, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:30:01.154875+00:00, queued_by_job_id=2, pid=15317 2024-06-28T02:30:07.609131191Z [2024-06-28T02:30:07.608+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:30:07.609178866Z 2024-06-28T02:30:07.609302063Z [2024-06-28T02:30:07.608+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:30:07.610589253Z [2024-06-28T02:30:07.610+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:30:07.610641190Z 2024-06-28T02:30:07.614907229Z [2024-06-28T02:30:07.614+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T02:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T02:30:07.615215752Z [2024-06-28T02:30:07.614+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T02:30:07.680614525Z [2024-06-28T02:30:07.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:25:00+00:00 exited with status queued for try_number 1 2024-06-28T02:30:07.680783663Z [2024-06-28T02:30:07.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:25:00+00:00 exited with status success for try_number 1 2024-06-28T02:30:07.690228905Z [2024-06-28T02:30:07.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6f7feba-9e43-405b-b901-031640b20be8 2024-06-28T02:30:07.690493883Z [2024-06-28T02:30:07.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T02:25:00+00:00, map_index=-1, run_start_date=2024-06-28 02:30:06.933317+00:00, run_end_date=2024-06-28 02:30:07.312864+00:00, run_duration=0.379547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1052, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:30:05.034790+00:00, queued_by_job_id=2, pid=15347 2024-06-28T02:30:11.351985774Z [2024-06-28T02:30:11.351+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:30:11.352080268Z 2024-06-28T02:30:11.352197963Z [2024-06-28T02:30:11.351+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:30:11.352912135Z [2024-06-28T02:30:11.352+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:30:11.352941615Z 2024-06-28T02:30:11.355785759Z [2024-06-28T02:30:11.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:30:11.356121109Z [2024-06-28T02:30:11.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:30:11.423701784Z [2024-06-28T02:30:11.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:25:00+00:00 exited with status queued for try_number 1 2024-06-28T02:30:11.423884074Z [2024-06-28T02:30:11.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:25:00+00:00 exited with status success for try_number 1 2024-06-28T02:30:11.431740800Z [2024-06-28T02:30:11.431+0000] {scheduler_job.py:635} INFO - Setting external_id for to d796ad7a-e96f-4cc0-9361-40bda4e4ae53 2024-06-28T02:30:11.432024327Z [2024-06-28T02:30:11.431+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T02:25:00+00:00, map_index=0, run_start_date=2024-06-28 02:30:09.275804+00:00, run_end_date=2024-06-28 02:30:10.622543+00:00, run_duration=1.346739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1053, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:30:07.611339+00:00, queued_by_job_id=2, pid=15355 2024-06-28T02:30:13.672226418Z [2024-06-28T02:30:13.671+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:30:13.672583295Z [2024-06-28T02:30:13.672+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:25:00+00:00, run_id=scheduled__2024-06-28T02:25:00+00:00, run_start_date=2024-06-28 02:30:01.042343+00:00, run_end_date=2024-06-28 02:30:13.672196+00:00, run_duration=12.629853, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:25:00+00:00, data_interval_end=2024-06-28 02:30:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T02:30:13.680190599Z [2024-06-28T02:30:13.679+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:30:00+00:00, run_after=2024-06-28T02:35:00+00:00 2024-06-28T02:30:13.725711543Z [2024-06-28T02:30:13.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:25:00+00:00 exited with status success for try_number 1 2024-06-28T02:30:13.734344632Z [2024-06-28T02:30:13.733+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T02:25:00+00:00, map_index=-1, run_start_date=2024-06-28 02:30:13.138327+00:00, run_end_date=2024-06-28 02:30:13.525269+00:00, run_duration=0.386942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1054, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:30:11.353319+00:00, queued_by_job_id=2, pid=15368 2024-06-28T02:31:00.146098894Z [2024-06-28T02:31:00.145+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:31:00+00:00, run_after=2024-06-28T02:32:00+00:00 2024-06-28T02:31:00.160183449Z [2024-06-28T02:31:00.159+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:31:00.191128492Z [2024-06-28T02:31:00.190+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:31:00+00:00, run_after=2024-06-28T02:32:00+00:00 2024-06-28T02:31:00.292274175Z [2024-06-28T02:31:00.291+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:31:00.292315102Z 2024-06-28T02:31:00.292328602Z 2024-06-28T02:31:00.292346946Z 2024-06-28T02:31:00.292357011Z [2024-06-28T02:31:00.292+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:31:00.292451435Z [2024-06-28T02:31:00.292+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:31:00.292535818Z [2024-06-28T02:31:00.292+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:31:00.293263330Z [2024-06-28T02:31:00.293+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:31:00.293274309Z 2024-06-28T02:31:00.293298268Z 2024-06-28T02:31:00.293304158Z 2024-06-28T02:31:00.296690910Z [2024-06-28T02:31:00.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:31:00.296890137Z [2024-06-28T02:31:00.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:31:00.297165698Z [2024-06-28T02:31:00.297+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:31:00.297390270Z [2024-06-28T02:31:00.297+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:31:00.297740614Z [2024-06-28T02:31:00.297+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:31:00.297900757Z [2024-06-28T02:31:00.297+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:31:00.471279419Z [2024-06-28T02:31:00.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:30:00+00:00 exited with status queued for try_number 1 2024-06-28T02:31:00.473169614Z [2024-06-28T02:31:00.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:30:00+00:00 exited with status queued for try_number 1 2024-06-28T02:31:00.473293381Z [2024-06-28T02:31:00.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:30:00+00:00 exited with status queued for try_number 1 2024-06-28T02:31:00.482144767Z [2024-06-28T02:31:00.481+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e75373c-e783-4c73-a4b1-2cc83fdf2afe 2024-06-28T02:31:00.482311325Z [2024-06-28T02:31:00.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1931cbeb-13e4-46de-b274-1a3211605a9e 2024-06-28T02:31:00.482461052Z [2024-06-28T02:31:00.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4300673-8dc5-4a08-8c3b-ca203026ddc1 2024-06-28T02:31:01.692052502Z [2024-06-28T02:31:01.691+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:31:01.692446312Z [2024-06-28T02:31:01.692+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:30:00+00:00, run_id=scheduled__2024-06-28T02:30:00+00:00, run_start_date=2024-06-28 02:31:00.222576+00:00, run_end_date=2024-06-28 02:31:01.691936+00:00, run_duration=1.46936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:30:00+00:00, data_interval_end=2024-06-28 02:31:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:31:01.703580074Z [2024-06-28T02:31:01.703+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:31:00+00:00, run_after=2024-06-28T02:32:00+00:00 2024-06-28T02:31:01.748150081Z [2024-06-28T02:31:01.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:30:00+00:00 exited with status success for try_number 1 2024-06-28T02:31:01.755892514Z [2024-06-28T02:31:01.755+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:30:00+00:00, map_index=-1, run_start_date=2024-06-28 02:31:01.026790+00:00, run_end_date=2024-06-28 02:31:01.364118+00:00, run_duration=0.337328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1055, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:31:00.293995+00:00, queued_by_job_id=2, pid=15390 2024-06-28T02:31:05.090619149Z [2024-06-28T02:31:05.090+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:31:05.090946479Z [2024-06-28T02:31:05.090+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:30:00+00:00, run_id=scheduled__2024-06-28T02:30:00+00:00, run_start_date=2024-06-28 02:31:00.227351+00:00, run_end_date=2024-06-28 02:31:05.090500+00:00, run_duration=4.863149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:30:00+00:00, data_interval_end=2024-06-28 02:31:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:31:05.101118521Z [2024-06-28T02:31:05.100+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:31:00+00:00, run_after=2024-06-28T02:32:00+00:00 2024-06-28T02:31:05.146279807Z [2024-06-28T02:31:05.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:30:00+00:00 exited with status success for try_number 1 2024-06-28T02:31:05.150562069Z [2024-06-28T02:31:05.150+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:30:00+00:00, map_index=-1, run_start_date=2024-06-28 02:31:02.125778+00:00, run_end_date=2024-06-28 02:31:03.974169+00:00, run_duration=1.848391, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1056, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:31:00.293995+00:00, queued_by_job_id=2, pid=15408 2024-06-28T02:31:06.027143780Z [2024-06-28T02:31:06.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:31:06.027344397Z [2024-06-28T02:31:06.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:30:00+00:00, run_id=scheduled__2024-06-28T02:30:00+00:00, run_start_date=2024-06-28 02:31:00.225046+00:00, run_end_date=2024-06-28 02:31:06.027036+00:00, run_duration=5.80199, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:30:00+00:00, data_interval_end=2024-06-28 02:31:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:31:06.036092183Z [2024-06-28T02:31:06.035+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:31:00+00:00, run_after=2024-06-28T02:32:00+00:00 2024-06-28T02:31:06.081032919Z [2024-06-28T02:31:06.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:30:00+00:00 exited with status success for try_number 1 2024-06-28T02:31:06.089051984Z [2024-06-28T02:31:06.088+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:30:00+00:00, map_index=-1, run_start_date=2024-06-28 02:31:02.223206+00:00, run_end_date=2024-06-28 02:31:05.260141+00:00, run_duration=3.036935, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1057, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:31:00.293995+00:00, queued_by_job_id=2, pid=15409 2024-06-28T02:31:47.538362889Z [2024-06-28T02:31:47.537+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T02:32:00.069139548Z [2024-06-28T02:32:00.068+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:32:00.082172599Z [2024-06-28T02:32:00.081+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:32:00.117347763Z [2024-06-28T02:32:00.116+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:32:00+00:00, run_after=2024-06-28T02:33:00+00:00 2024-06-28T02:32:00.132731073Z [2024-06-28T02:32:00.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:32:00+00:00, run_after=2024-06-28T02:33:00+00:00 2024-06-28T02:32:00.202913299Z [2024-06-28T02:32:00.202+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:32:00.202943872Z 2024-06-28T02:32:00.202950337Z 2024-06-28T02:32:00.203001819Z 2024-06-28T02:32:00.203023622Z 2024-06-28T02:32:00.203031406Z [2024-06-28T02:32:00.202+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:32:00.203047083Z [2024-06-28T02:32:00.202+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:32:00.203150817Z [2024-06-28T02:32:00.202+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:32:00.203340321Z [2024-06-28T02:32:00.203+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:32:00.203948236Z [2024-06-28T02:32:00.203+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:32:00.203959309Z 2024-06-28T02:32:00.203965044Z 2024-06-28T02:32:00.203970249Z 2024-06-28T02:32:00.203975856Z 2024-06-28T02:32:00.207234523Z [2024-06-28T02:32:00.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:32:00.207430755Z [2024-06-28T02:32:00.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:32:00.207690492Z [2024-06-28T02:32:00.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:32:00.207859048Z [2024-06-28T02:32:00.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:32:00.208092607Z [2024-06-28T02:32:00.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:32:00.208236545Z [2024-06-28T02:32:00.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:32:00.208477530Z [2024-06-28T02:32:00.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:32:00.208617541Z [2024-06-28T02:32:00.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:32:00.570788568Z [2024-06-28T02:32:00.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:30:00+00:00 exited with status queued for try_number 1 2024-06-28T02:32:00.570845106Z [2024-06-28T02:32:00.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:31:00+00:00 exited with status queued for try_number 1 2024-06-28T02:32:00.570849786Z [2024-06-28T02:32:00.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:31:00+00:00 exited with status queued for try_number 1 2024-06-28T02:32:00.570925156Z [2024-06-28T02:32:00.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:31:00+00:00 exited with status queued for try_number 1 2024-06-28T02:32:00.584783857Z [2024-06-28T02:32:00.584+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0549ab7b-60ec-47f3-9249-366c1a0181c2 2024-06-28T02:32:00.584856988Z [2024-06-28T02:32:00.584+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4b25c46-c4f1-4020-8c3f-24fc1d701818 2024-06-28T02:32:00.585015239Z [2024-06-28T02:32:00.584+0000] {scheduler_job.py:635} INFO - Setting external_id for to 622e381f-05cf-42e5-a1ba-214f714952e2 2024-06-28T02:32:00.585168152Z [2024-06-28T02:32:00.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9e40d0c-8d94-4f3d-9a1e-19681ef1bb5c 2024-06-28T02:32:01.841945393Z [2024-06-28T02:32:01.841+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:32:01.842657243Z [2024-06-28T02:32:01.842+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:30:00+00:00, run_id=scheduled__2024-06-28T02:30:00+00:00, run_start_date=2024-06-28 02:32:00.142025+00:00, run_end_date=2024-06-28 02:32:01.842103+00:00, run_duration=1.700078, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:30:00+00:00, data_interval_end=2024-06-28 02:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:32:01.868968924Z [2024-06-28T02:32:01.868+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:32:00+00:00, run_after=2024-06-28T02:34:00+00:00 2024-06-28T02:32:01.881829452Z [2024-06-28T02:32:01.881+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:32:01.883028490Z [2024-06-28T02:32:01.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:31:00+00:00, run_id=scheduled__2024-06-28T02:31:00+00:00, run_start_date=2024-06-28 02:32:00.143464+00:00, run_end_date=2024-06-28 02:32:01.882404+00:00, run_duration=1.73894, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:31:00+00:00, data_interval_end=2024-06-28 02:32:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:32:01.908846705Z [2024-06-28T02:32:01.908+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:32:00+00:00, run_after=2024-06-28T02:33:00+00:00 2024-06-28T02:32:01.957757778Z [2024-06-28T02:32:01.957+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:32:01.957787102Z 2024-06-28T02:32:01.958222390Z [2024-06-28T02:32:01.957+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-06-28T02:32:01.959346342Z [2024-06-28T02:32:01.959+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:32:01.959363180Z 2024-06-28T02:32:01.963000611Z [2024-06-28T02:32:01.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240628023200_629921', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:32:01.963477763Z [2024-06-28T02:32:01.963+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240628023200_629921', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-06-28T02:32:02.042333259Z [2024-06-28T02:32:02.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240628023200_629921 exited with status queued for try_number 1 2024-06-28T02:32:02.044603745Z [2024-06-28T02:32:02.044+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:30:00+00:00 exited with status success for try_number 1 2024-06-28T02:32:02.044821910Z [2024-06-28T02:32:02.044+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:31:00+00:00 exited with status success for try_number 1 2024-06-28T02:32:02.051583629Z [2024-06-28T02:32:02.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:31:00+00:00, map_index=-1, run_start_date=2024-06-28 02:32:01.155134+00:00, run_end_date=2024-06-28 02:32:01.541422+00:00, run_duration=0.386288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1059, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:32:00.204744+00:00, queued_by_job_id=2, pid=15443 2024-06-28T02:32:02.052031873Z [2024-06-28T02:32:02.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6332e09a-3577-4f62-8689-2864075901fd 2024-06-28T02:32:02.052338412Z [2024-06-28T02:32:02.052+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:30:00+00:00, map_index=-1, run_start_date=2024-06-28 02:32:00.962342+00:00, run_end_date=2024-06-28 02:32:01.475182+00:00, run_duration=0.51284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1058, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:32:00.204744+00:00, queued_by_job_id=2, pid=15442 2024-06-28T02:32:04.330066500Z [2024-06-28T02:32:04.329+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:32:04.330553665Z [2024-06-28T02:32:04.330+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-06-28 02:32:00.960145+00:00, run_id=scaleout_vdu_20240628023200_629921, run_start_date=2024-06-28 02:32:01.808306+00:00, run_end_date=2024-06-28 02:32:04.329965+00:00, run_duration=2.521659, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-06-28 02:32:00.960145+00:00, data_interval_end=2024-06-28 02:32:00.960145+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-06-28T02:32:04.333752740Z [2024-06-28T02:32:04.333+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-06-28T02:32:04.339505569Z [2024-06-28T02:32:04.339+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:32:04.339880652Z [2024-06-28T02:32:04.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:31:00+00:00, run_id=scheduled__2024-06-28T02:31:00+00:00, run_start_date=2024-06-28 02:32:00.144528+00:00, run_end_date=2024-06-28 02:32:04.339343+00:00, run_duration=4.194815, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:31:00+00:00, data_interval_end=2024-06-28 02:32:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:32:04.348876916Z [2024-06-28T02:32:04.348+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:32:00+00:00, run_after=2024-06-28T02:33:00+00:00 2024-06-28T02:32:04.419231431Z [2024-06-28T02:32:04.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:31:00+00:00 exited with status success for try_number 1 2024-06-28T02:32:04.419274339Z [2024-06-28T02:32:04.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240628023200_629921 exited with status success for try_number 1 2024-06-28T02:32:04.427896720Z [2024-06-28T02:32:04.427+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:31:00+00:00, map_index=-1, run_start_date=2024-06-28 02:32:02.488978+00:00, run_end_date=2024-06-28 02:32:03.900237+00:00, run_duration=1.411259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1060, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:32:00.204744+00:00, queued_by_job_id=2, pid=15467 2024-06-28T02:32:04.428126427Z [2024-06-28T02:32:04.427+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240628023200_629921, map_index=-1, run_start_date=2024-06-28 02:32:02.815091+00:00, run_end_date=2024-06-28 02:32:03.258604+00:00, run_duration=0.443513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1062, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:32:01.960010+00:00, queued_by_job_id=2, pid=15469 2024-06-28T02:32:05.461025512Z [2024-06-28T02:32:05.460+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:32:05.461377811Z [2024-06-28T02:32:05.461+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:31:00+00:00, run_id=scheduled__2024-06-28T02:31:00+00:00, run_start_date=2024-06-28 02:32:00.145442+00:00, run_end_date=2024-06-28 02:32:05.460927+00:00, run_duration=5.315485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:31:00+00:00, data_interval_end=2024-06-28 02:32:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:32:05.470579557Z [2024-06-28T02:32:05.470+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:32:00+00:00, run_after=2024-06-28T02:33:00+00:00 2024-06-28T02:32:05.499056660Z [2024-06-28T02:32:05.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:31:00+00:00 exited with status success for try_number 1 2024-06-28T02:32:05.509406461Z [2024-06-28T02:32:05.509+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:31:00+00:00, map_index=-1, run_start_date=2024-06-28 02:32:02.622766+00:00, run_end_date=2024-06-28 02:32:04.514455+00:00, run_duration=1.891689, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1061, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:32:00.204744+00:00, queued_by_job_id=2, pid=15468 2024-06-28T02:33:00.537687373Z [2024-06-28T02:33:00.537+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:33:00+00:00, run_after=2024-06-28T02:34:00+00:00 2024-06-28T02:33:00.547210437Z [2024-06-28T02:33:00.546+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:33:00.561320429Z [2024-06-28T02:33:00.561+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:33:00+00:00, run_after=2024-06-28T02:34:00+00:00 2024-06-28T02:33:00.653640611Z [2024-06-28T02:33:00.652+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:33:00.653681626Z 2024-06-28T02:33:00.653690442Z 2024-06-28T02:33:00.653698360Z 2024-06-28T02:33:00.654198996Z [2024-06-28T02:33:00.653+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:33:00.654960512Z [2024-06-28T02:33:00.654+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:33:00.655566843Z [2024-06-28T02:33:00.655+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:33:00.657772116Z [2024-06-28T02:33:00.657+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:33:00.657784671Z 2024-06-28T02:33:00.657789149Z 2024-06-28T02:33:00.657793302Z 2024-06-28T02:33:00.666681876Z [2024-06-28T02:33:00.666+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:33:00.667198714Z [2024-06-28T02:33:00.666+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:33:00.667841417Z [2024-06-28T02:33:00.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:33:00.668274294Z [2024-06-28T02:33:00.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:33:00.668886244Z [2024-06-28T02:33:00.668+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:33:00.669307649Z [2024-06-28T02:33:00.669+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:33:00.903956439Z [2024-06-28T02:33:00.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:32:00+00:00 exited with status queued for try_number 1 2024-06-28T02:33:00.904108373Z [2024-06-28T02:33:00.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:32:00+00:00 exited with status queued for try_number 1 2024-06-28T02:33:00.904240146Z [2024-06-28T02:33:00.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:32:00+00:00 exited with status queued for try_number 1 2024-06-28T02:33:00.910869055Z [2024-06-28T02:33:00.910+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1446ed3-1a9a-49aa-8efe-cd29a299ae06 2024-06-28T02:33:00.911100552Z [2024-06-28T02:33:00.910+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae58f7aa-4220-4726-9628-1ffdda295c0c 2024-06-28T02:33:00.911277704Z [2024-06-28T02:33:00.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c3a281c-8400-4372-ba47-21ec59295d2b 2024-06-28T02:33:02.048092056Z [2024-06-28T02:33:02.047+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:33:02.048289408Z [2024-06-28T02:33:02.048+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:32:00+00:00, run_id=scheduled__2024-06-28T02:32:00+00:00, run_start_date=2024-06-28 02:33:00.574367+00:00, run_end_date=2024-06-28 02:33:02.048003+00:00, run_duration=1.473636, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:32:00+00:00, data_interval_end=2024-06-28 02:33:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:33:02.056770854Z [2024-06-28T02:33:02.056+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:33:00+00:00, run_after=2024-06-28T02:34:00+00:00 2024-06-28T02:33:02.099095476Z [2024-06-28T02:33:02.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:32:00+00:00 exited with status success for try_number 1 2024-06-28T02:33:02.106727752Z [2024-06-28T02:33:02.106+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:32:00+00:00, map_index=-1, run_start_date=2024-06-28 02:33:01.441561+00:00, run_end_date=2024-06-28 02:33:01.834677+00:00, run_duration=0.393116, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1063, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:33:00.661932+00:00, queued_by_job_id=2, pid=15507 2024-06-28T02:33:04.115540287Z [2024-06-28T02:33:04.112+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:33:04.115567547Z [2024-06-28T02:33:04.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:32:00+00:00, run_id=scheduled__2024-06-28T02:32:00+00:00, run_start_date=2024-06-28 02:33:00.576007+00:00, run_end_date=2024-06-28 02:33:04.112490+00:00, run_duration=3.536483, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:32:00+00:00, data_interval_end=2024-06-28 02:33:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:33:04.121773034Z [2024-06-28T02:33:04.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:33:00+00:00, run_after=2024-06-28T02:34:00+00:00 2024-06-28T02:33:04.204536664Z [2024-06-28T02:33:04.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:32:00+00:00 exited with status success for try_number 1 2024-06-28T02:33:04.209954058Z [2024-06-28T02:33:04.209+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:32:00+00:00, map_index=-1, run_start_date=2024-06-28 02:33:02.378867+00:00, run_end_date=2024-06-28 02:33:03.841064+00:00, run_duration=1.462197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1065, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:33:00.661932+00:00, queued_by_job_id=2, pid=15526 2024-06-28T02:33:05.260606497Z [2024-06-28T02:33:05.259+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:33:05.260975268Z [2024-06-28T02:33:05.260+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:32:00+00:00, run_id=scheduled__2024-06-28T02:32:00+00:00, run_start_date=2024-06-28 02:33:00.577293+00:00, run_end_date=2024-06-28 02:33:05.260524+00:00, run_duration=4.683231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:32:00+00:00, data_interval_end=2024-06-28 02:33:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:33:05.274736715Z [2024-06-28T02:33:05.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:33:00+00:00, run_after=2024-06-28T02:34:00+00:00 2024-06-28T02:33:05.316522910Z [2024-06-28T02:33:05.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:32:00+00:00 exited with status success for try_number 1 2024-06-28T02:33:05.321185778Z [2024-06-28T02:33:05.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:32:00+00:00, map_index=-1, run_start_date=2024-06-28 02:33:02.350197+00:00, run_end_date=2024-06-28 02:33:04.586420+00:00, run_duration=2.236223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1064, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:33:00.661932+00:00, queued_by_job_id=2, pid=15525 2024-06-28T02:34:00.948756084Z [2024-06-28T02:34:00.948+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:34:00+00:00, run_after=2024-06-28T02:35:00+00:00 2024-06-28T02:34:00.956628801Z [2024-06-28T02:34:00.956+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:34:00.963376213Z [2024-06-28T02:34:00.962+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:34:00.975042598Z [2024-06-28T02:34:00.974+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:34:00+00:00, run_after=2024-06-28T02:35:00+00:00 2024-06-28T02:34:01.054270521Z [2024-06-28T02:34:01.053+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:34:01.054302868Z 2024-06-28T02:34:01.054307909Z 2024-06-28T02:34:01.054330700Z 2024-06-28T02:34:01.054334492Z 2024-06-28T02:34:01.054466253Z [2024-06-28T02:34:01.054+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:34:01.054647035Z [2024-06-28T02:34:01.054+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:34:01.054867837Z [2024-06-28T02:34:01.054+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:34:01.055071945Z [2024-06-28T02:34:01.054+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:34:01.055849216Z [2024-06-28T02:34:01.055+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:34:01.055862196Z 2024-06-28T02:34:01.055866597Z 2024-06-28T02:34:01.055870430Z 2024-06-28T02:34:01.055874559Z 2024-06-28T02:34:01.060052983Z [2024-06-28T02:34:01.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:34:01.060223185Z [2024-06-28T02:34:01.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:34:01.060489142Z [2024-06-28T02:34:01.060+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:34:01.060638413Z [2024-06-28T02:34:01.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:34:01.060877408Z [2024-06-28T02:34:01.060+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:34:01.061018181Z [2024-06-28T02:34:01.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:34:01.061289503Z [2024-06-28T02:34:01.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:34:01.061422894Z [2024-06-28T02:34:01.061+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:34:01.330461311Z [2024-06-28T02:34:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:32:00+00:00 exited with status queued for try_number 1 2024-06-28T02:34:01.332944225Z [2024-06-28T02:34:01.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:33:00+00:00 exited with status queued for try_number 1 2024-06-28T02:34:01.333093173Z [2024-06-28T02:34:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:33:00+00:00 exited with status queued for try_number 1 2024-06-28T02:34:01.333210563Z [2024-06-28T02:34:01.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:33:00+00:00 exited with status queued for try_number 1 2024-06-28T02:34:01.342658452Z [2024-06-28T02:34:01.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34b8fd70-ed17-493d-aa27-a7dc88ca516c 2024-06-28T02:34:01.342831815Z [2024-06-28T02:34:01.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to e036fbc0-da16-4c15-9666-cd6521291d8d 2024-06-28T02:34:01.343003101Z [2024-06-28T02:34:01.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to dcfcb81f-9123-46a1-a146-c24a1d2a7d68 2024-06-28T02:34:01.343185918Z [2024-06-28T02:34:01.343+0000] {scheduler_job.py:635} INFO - Setting external_id for to 222dbe6c-3f77-4c9c-a734-a2c73fc48ad5 2024-06-28T02:34:03.345521662Z [2024-06-28T02:34:03.345+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:34:03.346661086Z [2024-06-28T02:34:03.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:32:00+00:00, run_id=scheduled__2024-06-28T02:32:00+00:00, run_start_date=2024-06-28 02:34:00.985061+00:00, run_end_date=2024-06-28 02:34:03.346234+00:00, run_duration=2.361173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:32:00+00:00, data_interval_end=2024-06-28 02:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:34:03.356793000Z [2024-06-28T02:34:03.356+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:34:00+00:00, run_after=2024-06-28T02:36:00+00:00 2024-06-28T02:34:03.366950025Z [2024-06-28T02:34:03.366+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:34:03.367267928Z [2024-06-28T02:34:03.366+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:33:00+00:00, run_id=scheduled__2024-06-28T02:33:00+00:00, run_start_date=2024-06-28 02:34:00.986110+00:00, run_end_date=2024-06-28 02:34:03.366856+00:00, run_duration=2.380746, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:33:00+00:00, data_interval_end=2024-06-28 02:34:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:34:03.377305878Z [2024-06-28T02:34:03.376+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:34:00+00:00, run_after=2024-06-28T02:35:00+00:00 2024-06-28T02:34:03.440512556Z [2024-06-28T02:34:03.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:32:00+00:00 exited with status success for try_number 1 2024-06-28T02:34:03.441044622Z [2024-06-28T02:34:03.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:33:00+00:00 exited with status success for try_number 1 2024-06-28T02:34:03.452751557Z [2024-06-28T02:34:03.452+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:33:00+00:00, map_index=-1, run_start_date=2024-06-28 02:34:02.209838+00:00, run_end_date=2024-06-28 02:34:02.702540+00:00, run_duration=0.492702, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1067, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:34:01.056939+00:00, queued_by_job_id=2, pid=15560 2024-06-28T02:34:03.453220928Z [2024-06-28T02:34:03.452+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:32:00+00:00, map_index=-1, run_start_date=2024-06-28 02:34:01.850929+00:00, run_end_date=2024-06-28 02:34:02.382008+00:00, run_duration=0.531079, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1066, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:34:01.056939+00:00, queued_by_job_id=2, pid=15554 2024-06-28T02:34:06.213733120Z [2024-06-28T02:34:06.213+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:34:06.214410686Z [2024-06-28T02:34:06.213+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:33:00+00:00, run_id=scheduled__2024-06-28T02:33:00+00:00, run_start_date=2024-06-28 02:34:00.987145+00:00, run_end_date=2024-06-28 02:34:06.213655+00:00, run_duration=5.22651, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:33:00+00:00, data_interval_end=2024-06-28 02:34:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:34:06.237216917Z [2024-06-28T02:34:06.236+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:34:00+00:00, run_after=2024-06-28T02:35:00+00:00 2024-06-28T02:34:06.245187647Z [2024-06-28T02:34:06.244+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:34:06.245297087Z [2024-06-28T02:34:06.245+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:33:00+00:00, run_id=scheduled__2024-06-28T02:33:00+00:00, run_start_date=2024-06-28 02:34:00.988152+00:00, run_end_date=2024-06-28 02:34:06.245073+00:00, run_duration=5.256921, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:33:00+00:00, data_interval_end=2024-06-28 02:34:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:34:06.254475508Z [2024-06-28T02:34:06.254+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:34:00+00:00, run_after=2024-06-28T02:35:00+00:00 2024-06-28T02:34:06.292462237Z [2024-06-28T02:34:06.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:33:00+00:00 exited with status success for try_number 1 2024-06-28T02:34:06.292491785Z [2024-06-28T02:34:06.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:33:00+00:00 exited with status success for try_number 1 2024-06-28T02:34:06.298609184Z [2024-06-28T02:34:06.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:33:00+00:00, map_index=-1, run_start_date=2024-06-28 02:34:03.302592+00:00, run_end_date=2024-06-28 02:34:05.121445+00:00, run_duration=1.818853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1069, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:34:01.056939+00:00, queued_by_job_id=2, pid=15584 2024-06-28T02:34:06.298693316Z [2024-06-28T02:34:06.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:33:00+00:00, map_index=-1, run_start_date=2024-06-28 02:34:03.255599+00:00, run_end_date=2024-06-28 02:34:05.433042+00:00, run_duration=2.177443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1068, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:34:01.056939+00:00, queued_by_job_id=2, pid=15583 2024-06-28T02:35:00.306606635Z [2024-06-28T02:35:00.305+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:35:00.326965103Z [2024-06-28T02:35:00.326+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:35:00+00:00, run_after=2024-06-28T02:40:00+00:00 2024-06-28T02:35:00.348193842Z [2024-06-28T02:35:00.347+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:35:00+00:00, run_after=2024-06-28T02:36:00+00:00 2024-06-28T02:35:00.380466832Z [2024-06-28T02:35:00.379+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:35:00+00:00, run_after=2024-06-28T02:36:00+00:00 2024-06-28T02:35:00.499556441Z [2024-06-28T02:35:00.499+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:35:00.499591525Z 2024-06-28T02:35:00.499620126Z 2024-06-28T02:35:00.499626201Z 2024-06-28T02:35:00.499632647Z 2024-06-28T02:35:00.499933073Z [2024-06-28T02:35:00.499+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:35:00.500056321Z [2024-06-28T02:35:00.499+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:35:00.500227800Z [2024-06-28T02:35:00.500+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:35:00.500392350Z [2024-06-28T02:35:00.500+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:35:00.501425214Z [2024-06-28T02:35:00.501+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:35:00.501452189Z 2024-06-28T02:35:00.501462061Z 2024-06-28T02:35:00.501470471Z 2024-06-28T02:35:00.501479165Z 2024-06-28T02:35:00.509209069Z [2024-06-28T02:35:00.508+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T02:35:00.509353680Z [2024-06-28T02:35:00.509+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:35:00.509673167Z [2024-06-28T02:35:00.509+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:35:00.509937524Z [2024-06-28T02:35:00.509+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:35:00.510166587Z [2024-06-28T02:35:00.509+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:35:00.510598505Z [2024-06-28T02:35:00.510+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:35:00.510987579Z [2024-06-28T02:35:00.510+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:35:00.512486896Z [2024-06-28T02:35:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:35:01.118291741Z [2024-06-28T02:35:01.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:30:00+00:00 exited with status queued for try_number 1 2024-06-28T02:35:01.118571421Z [2024-06-28T02:35:01.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:34:00+00:00 exited with status queued for try_number 1 2024-06-28T02:35:01.118786564Z [2024-06-28T02:35:01.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:34:00+00:00 exited with status queued for try_number 1 2024-06-28T02:35:01.118952123Z [2024-06-28T02:35:01.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:34:00+00:00 exited with status queued for try_number 1 2024-06-28T02:35:01.136565448Z [2024-06-28T02:35:01.136+0000] {scheduler_job.py:635} INFO - Setting external_id for to be257051-f700-4e0a-b38c-42b6eec67829 2024-06-28T02:35:01.136817149Z [2024-06-28T02:35:01.136+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb9bbf2c-0675-4e09-bf3c-4c0568b5566d 2024-06-28T02:35:01.137059999Z [2024-06-28T02:35:01.136+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2536f035-4fcd-47e2-a7f7-27e33ba361a0 2024-06-28T02:35:01.137265525Z [2024-06-28T02:35:01.137+0000] {scheduler_job.py:635} INFO - Setting external_id for to b45ea7da-1702-496f-8879-ca6afca66170 2024-06-28T02:35:02.354804478Z [2024-06-28T02:35:02.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:35:02.354969661Z [2024-06-28T02:35:02.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:34:00+00:00, run_id=scheduled__2024-06-28T02:34:00+00:00, run_start_date=2024-06-28 02:35:00.399456+00:00, run_end_date=2024-06-28 02:35:02.354630+00:00, run_duration=1.955174, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:34:00+00:00, data_interval_end=2024-06-28 02:35:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:35:02.368036809Z [2024-06-28T02:35:02.367+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:35:00+00:00, run_after=2024-06-28T02:36:00+00:00 2024-06-28T02:35:02.455115053Z [2024-06-28T02:35:02.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:34:00+00:00 exited with status success for try_number 1 2024-06-28T02:35:02.467508400Z [2024-06-28T02:35:02.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:34:00+00:00, map_index=-1, run_start_date=2024-06-28 02:35:01.373747+00:00, run_end_date=2024-06-28 02:35:01.786551+00:00, run_duration=0.412804, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1070, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:35:00.504455+00:00, queued_by_job_id=2, pid=15617 2024-06-28T02:35:03.591185069Z [2024-06-28T02:35:03.590+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:35:03.591276413Z 2024-06-28T02:35:03.591320098Z [2024-06-28T02:35:03.590+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:35:03.591873438Z [2024-06-28T02:35:03.591+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:35:03.591899173Z 2024-06-28T02:35:03.594228877Z [2024-06-28T02:35:03.593+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T02:35:03.594529628Z [2024-06-28T02:35:03.594+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:35:03.648267617Z [2024-06-28T02:35:03.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:30:00+00:00 exited with status queued for try_number 1 2024-06-28T02:35:03.648683224Z [2024-06-28T02:35:03.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:30:00+00:00 exited with status success for try_number 1 2024-06-28T02:35:03.654339835Z [2024-06-28T02:35:03.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c2953be-b06d-461d-ba47-1c7ed8645034 2024-06-28T02:35:03.654572397Z [2024-06-28T02:35:03.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T02:30:00+00:00, map_index=-1, run_start_date=2024-06-28 02:35:02.749158+00:00, run_end_date=2024-06-28 02:35:03.160231+00:00, run_duration=0.411073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1073, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:35:00.504455+00:00, queued_by_job_id=2, pid=15643 2024-06-28T02:35:04.814503408Z [2024-06-28T02:35:04.814+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:35:04.814972303Z [2024-06-28T02:35:04.814+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:34:00+00:00, run_id=scheduled__2024-06-28T02:34:00+00:00, run_start_date=2024-06-28 02:35:00.400957+00:00, run_end_date=2024-06-28 02:35:04.814427+00:00, run_duration=4.41347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:34:00+00:00, data_interval_end=2024-06-28 02:35:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:35:04.825416658Z [2024-06-28T02:35:04.825+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:35:00+00:00, run_after=2024-06-28T02:36:00+00:00 2024-06-28T02:35:04.833411306Z [2024-06-28T02:35:04.832+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:35:04.833768676Z [2024-06-28T02:35:04.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:34:00+00:00, run_id=scheduled__2024-06-28T02:34:00+00:00, run_start_date=2024-06-28 02:35:00.402386+00:00, run_end_date=2024-06-28 02:35:04.833320+00:00, run_duration=4.430934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:34:00+00:00, data_interval_end=2024-06-28 02:35:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:35:04.848797597Z [2024-06-28T02:35:04.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:35:00+00:00, run_after=2024-06-28T02:36:00+00:00 2024-06-28T02:35:04.902260349Z [2024-06-28T02:35:04.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:34:00+00:00 exited with status success for try_number 1 2024-06-28T02:35:04.902478915Z [2024-06-28T02:35:04.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:34:00+00:00 exited with status success for try_number 1 2024-06-28T02:35:04.913423732Z [2024-06-28T02:35:04.913+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:34:00+00:00, map_index=-1, run_start_date=2024-06-28 02:35:02.634204+00:00, run_end_date=2024-06-28 02:35:04.235923+00:00, run_duration=1.601719, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1072, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:35:00.504455+00:00, queued_by_job_id=2, pid=15642 2024-06-28T02:35:04.913696143Z [2024-06-28T02:35:04.913+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:34:00+00:00, map_index=-1, run_start_date=2024-06-28 02:35:02.512433+00:00, run_end_date=2024-06-28 02:35:03.767919+00:00, run_duration=1.255486, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1071, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:35:00.504455+00:00, queued_by_job_id=2, pid=15636 2024-06-28T02:35:07.144585113Z [2024-06-28T02:35:07.143+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:35:07.144663391Z 2024-06-28T02:35:07.144985603Z [2024-06-28T02:35:07.144+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:35:07.147494419Z [2024-06-28T02:35:07.147+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:35:07.147532569Z 2024-06-28T02:35:07.150167575Z [2024-06-28T02:35:07.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T02:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T02:35:07.150191626Z [2024-06-28T02:35:07.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T02:35:07.221287554Z [2024-06-28T02:35:07.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:30:00+00:00 exited with status queued for try_number 1 2024-06-28T02:35:07.221632984Z [2024-06-28T02:35:07.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:30:00+00:00 exited with status success for try_number 1 2024-06-28T02:35:07.228518818Z [2024-06-28T02:35:07.228+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0de9855b-e00a-4924-a398-d0b93e65a12e 2024-06-28T02:35:07.228851693Z [2024-06-28T02:35:07.228+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T02:30:00+00:00, map_index=-1, run_start_date=2024-06-28 02:35:05.417487+00:00, run_end_date=2024-06-28 02:35:05.878239+00:00, run_duration=0.460752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1074, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:35:03.592283+00:00, queued_by_job_id=2, pid=15666 2024-06-28T02:35:09.524045732Z [2024-06-28T02:35:09.523+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:35:09.524080037Z 2024-06-28T02:35:09.524320293Z [2024-06-28T02:35:09.524+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:35:09.524944617Z [2024-06-28T02:35:09.524+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:35:09.524965180Z 2024-06-28T02:35:09.527236174Z [2024-06-28T02:35:09.527+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:35:09.527471272Z [2024-06-28T02:35:09.527+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:35:09.574102303Z [2024-06-28T02:35:09.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:30:00+00:00 exited with status queued for try_number 1 2024-06-28T02:35:09.574154604Z [2024-06-28T02:35:09.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:30:00+00:00 exited with status success for try_number 1 2024-06-28T02:35:09.581965459Z [2024-06-28T02:35:09.581+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b7b0c01-d245-43db-870a-6d8aa5c06bab 2024-06-28T02:35:09.582135894Z [2024-06-28T02:35:09.581+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T02:30:00+00:00, map_index=0, run_start_date=2024-06-28 02:35:08.762946+00:00, run_end_date=2024-06-28 02:35:09.127091+00:00, run_duration=0.364145, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1075, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:35:07.147771+00:00, queued_by_job_id=2, pid=15674 2024-06-28T02:35:12.243560552Z [2024-06-28T02:35:12.242+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:35:12.244162757Z [2024-06-28T02:35:12.243+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:30:00+00:00, run_id=scheduled__2024-06-28T02:30:00+00:00, run_start_date=2024-06-28 02:35:00.397506+00:00, run_end_date=2024-06-28 02:35:12.243449+00:00, run_duration=11.845943, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:30:00+00:00, data_interval_end=2024-06-28 02:35:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T02:35:12.255464915Z [2024-06-28T02:35:12.254+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:35:00+00:00, run_after=2024-06-28T02:40:00+00:00 2024-06-28T02:35:12.308157114Z [2024-06-28T02:35:12.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:30:00+00:00 exited with status success for try_number 1 2024-06-28T02:35:12.317743027Z [2024-06-28T02:35:12.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T02:30:00+00:00, map_index=-1, run_start_date=2024-06-28 02:35:11.036645+00:00, run_end_date=2024-06-28 02:35:11.468216+00:00, run_duration=0.431571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1076, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:35:09.525334+00:00, queued_by_job_id=2, pid=15682 2024-06-28T02:36:00.808680468Z [2024-06-28T02:36:00.807+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:36:00.830825451Z [2024-06-28T02:36:00.830+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:36:00+00:00, run_after=2024-06-28T02:37:00+00:00 2024-06-28T02:36:00.840056457Z [2024-06-28T02:36:00.839+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:36:00.858242582Z [2024-06-28T02:36:00.857+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:36:00+00:00, run_after=2024-06-28T02:37:00+00:00 2024-06-28T02:36:01.009103174Z [2024-06-28T02:36:01.008+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:36:01.009128551Z 2024-06-28T02:36:01.009132717Z 2024-06-28T02:36:01.009136005Z 2024-06-28T02:36:01.009139145Z 2024-06-28T02:36:01.009411224Z [2024-06-28T02:36:01.009+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:36:01.009658645Z [2024-06-28T02:36:01.009+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:36:01.009875433Z [2024-06-28T02:36:01.009+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:36:01.010084479Z [2024-06-28T02:36:01.009+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:36:01.011207736Z [2024-06-28T02:36:01.010+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:36:01.011222236Z 2024-06-28T02:36:01.011225891Z 2024-06-28T02:36:01.011229545Z 2024-06-28T02:36:01.011232906Z 2024-06-28T02:36:01.016482107Z [2024-06-28T02:36:01.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:36:01.016671084Z [2024-06-28T02:36:01.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:36:01.016979794Z [2024-06-28T02:36:01.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:36:01.017168345Z [2024-06-28T02:36:01.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:36:01.017450174Z [2024-06-28T02:36:01.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:36:01.017603742Z [2024-06-28T02:36:01.017+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:36:01.017926356Z [2024-06-28T02:36:01.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:36:01.018084544Z [2024-06-28T02:36:01.017+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:36:01.427882444Z [2024-06-28T02:36:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:34:00+00:00 exited with status queued for try_number 1 2024-06-28T02:36:01.427924341Z [2024-06-28T02:36:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:35:00+00:00 exited with status queued for try_number 1 2024-06-28T02:36:01.428490543Z [2024-06-28T02:36:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:35:00+00:00 exited with status queued for try_number 1 2024-06-28T02:36:01.428510849Z [2024-06-28T02:36:01.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:35:00+00:00 exited with status queued for try_number 1 2024-06-28T02:36:01.452172744Z [2024-06-28T02:36:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c68d86c-0914-4b8a-84ff-6b782511f0c0 2024-06-28T02:36:01.452213931Z [2024-06-28T02:36:01.452+0000] {scheduler_job.py:635} INFO - Setting external_id for to a31c1d35-2dba-439e-9fce-c62fdf3deab2 2024-06-28T02:36:01.452523878Z [2024-06-28T02:36:01.452+0000] {scheduler_job.py:635} INFO - Setting external_id for to 079febf7-a2e4-46a4-9c30-585292be0458 2024-06-28T02:36:01.452626890Z [2024-06-28T02:36:01.452+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1e95664-f396-4ca5-bd71-783a343240ac 2024-06-28T02:36:02.525658344Z [2024-06-28T02:36:02.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:36:02.526345548Z [2024-06-28T02:36:02.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:34:00+00:00, run_id=scheduled__2024-06-28T02:34:00+00:00, run_start_date=2024-06-28 02:36:00.875424+00:00, run_end_date=2024-06-28 02:36:02.525860+00:00, run_duration=1.650436, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:34:00+00:00, data_interval_end=2024-06-28 02:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:36:02.533731283Z [2024-06-28T02:36:02.533+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:36:00+00:00, run_after=2024-06-28T02:38:00+00:00 2024-06-28T02:36:02.540191713Z [2024-06-28T02:36:02.539+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:36:02.540630330Z [2024-06-28T02:36:02.540+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:35:00+00:00, run_id=scheduled__2024-06-28T02:35:00+00:00, run_start_date=2024-06-28 02:36:00.877357+00:00, run_end_date=2024-06-28 02:36:02.540331+00:00, run_duration=1.662974, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:35:00+00:00, data_interval_end=2024-06-28 02:36:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:36:02.551158068Z [2024-06-28T02:36:02.550+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:36:00+00:00, run_after=2024-06-28T02:37:00+00:00 2024-06-28T02:36:02.607279288Z [2024-06-28T02:36:02.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:34:00+00:00 exited with status success for try_number 1 2024-06-28T02:36:02.614906305Z [2024-06-28T02:36:02.614+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:34:00+00:00, map_index=-1, run_start_date=2024-06-28 02:36:01.879091+00:00, run_end_date=2024-06-28 02:36:02.274852+00:00, run_duration=0.395761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1077, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:36:01.012223+00:00, queued_by_job_id=2, pid=15705 2024-06-28T02:36:03.816251828Z [2024-06-28T02:36:03.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:35:00+00:00 exited with status success for try_number 1 2024-06-28T02:36:03.822849156Z [2024-06-28T02:36:03.820+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:35:00+00:00, map_index=-1, run_start_date=2024-06-28 02:36:02.015773+00:00, run_end_date=2024-06-28 02:36:02.454663+00:00, run_duration=0.43889, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1078, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:36:01.012223+00:00, queued_by_job_id=2, pid=15706 2024-06-28T02:36:05.964772393Z [2024-06-28T02:36:05.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:36:05.965265257Z [2024-06-28T02:36:05.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:35:00+00:00, run_id=scheduled__2024-06-28T02:35:00+00:00, run_start_date=2024-06-28 02:36:00.879127+00:00, run_end_date=2024-06-28 02:36:05.964668+00:00, run_duration=5.085541, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:35:00+00:00, data_interval_end=2024-06-28 02:36:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:36:05.979143662Z [2024-06-28T02:36:05.978+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:36:00+00:00, run_after=2024-06-28T02:37:00+00:00 2024-06-28T02:36:06.041570691Z [2024-06-28T02:36:06.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:35:00+00:00 exited with status success for try_number 1 2024-06-28T02:36:06.046792841Z [2024-06-28T02:36:06.046+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:35:00+00:00, map_index=-1, run_start_date=2024-06-28 02:36:03.169999+00:00, run_end_date=2024-06-28 02:36:05.198213+00:00, run_duration=2.028214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1080, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:36:01.012223+00:00, queued_by_job_id=2, pid=15730 2024-06-28T02:36:07.674665851Z [2024-06-28T02:36:07.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:36:07.675591852Z [2024-06-28T02:36:07.675+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:35:00+00:00, run_id=scheduled__2024-06-28T02:35:00+00:00, run_start_date=2024-06-28 02:36:00.880804+00:00, run_end_date=2024-06-28 02:36:07.674842+00:00, run_duration=6.794038, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:35:00+00:00, data_interval_end=2024-06-28 02:36:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:36:07.700436139Z [2024-06-28T02:36:07.698+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:36:00+00:00, run_after=2024-06-28T02:37:00+00:00 2024-06-28T02:36:07.738337638Z [2024-06-28T02:36:07.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:35:00+00:00 exited with status success for try_number 1 2024-06-28T02:36:07.742870084Z [2024-06-28T02:36:07.742+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:35:00+00:00, map_index=-1, run_start_date=2024-06-28 02:36:03.029735+00:00, run_end_date=2024-06-28 02:36:06.860085+00:00, run_duration=3.83035, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1079, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:36:01.012223+00:00, queued_by_job_id=2, pid=15729 2024-06-28T02:36:47.637438220Z [2024-06-28T02:36:47.636+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T02:37:00.581484118Z [2024-06-28T02:37:00.580+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:37:00.598175534Z [2024-06-28T02:37:00.597+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:37:00+00:00, run_after=2024-06-28T02:38:00+00:00 2024-06-28T02:37:00.612244223Z [2024-06-28T02:37:00.611+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:37:00+00:00, run_after=2024-06-28T02:38:00+00:00 2024-06-28T02:37:00.723895797Z [2024-06-28T02:37:00.723+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:37:00.723955563Z 2024-06-28T02:37:00.723965872Z 2024-06-28T02:37:00.723973783Z 2024-06-28T02:37:00.724063412Z [2024-06-28T02:37:00.723+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:37:00.724369052Z [2024-06-28T02:37:00.724+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:37:00.724584244Z [2024-06-28T02:37:00.724+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:37:00.725618547Z [2024-06-28T02:37:00.725+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:37:00.725629130Z 2024-06-28T02:37:00.725636971Z 2024-06-28T02:37:00.725644317Z 2024-06-28T02:37:00.731541492Z [2024-06-28T02:37:00.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:37:00.731790437Z [2024-06-28T02:37:00.731+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:37:00.732134701Z [2024-06-28T02:37:00.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:37:00.732330620Z [2024-06-28T02:37:00.732+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:37:00.732670408Z [2024-06-28T02:37:00.732+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:37:00.732872854Z [2024-06-28T02:37:00.732+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:37:00.984965164Z [2024-06-28T02:37:00.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:36:00+00:00 exited with status queued for try_number 1 2024-06-28T02:37:00.985025876Z [2024-06-28T02:37:00.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:36:00+00:00 exited with status queued for try_number 1 2024-06-28T02:37:00.985193475Z [2024-06-28T02:37:00.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:36:00+00:00 exited with status queued for try_number 1 2024-06-28T02:37:00.993259059Z [2024-06-28T02:37:00.992+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8554fea-95da-4490-8c23-0ab171f4a405 2024-06-28T02:37:00.993506397Z [2024-06-28T02:37:00.993+0000] {scheduler_job.py:635} INFO - Setting external_id for to 367dd049-1f4b-4b9b-b0b4-a5e53ceb889a 2024-06-28T02:37:00.993732710Z [2024-06-28T02:37:00.993+0000] {scheduler_job.py:635} INFO - Setting external_id for to c00057f3-dd66-43bf-a6b4-16091df72e89 2024-06-28T02:37:02.458748959Z [2024-06-28T02:37:02.458+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:37:02.459427763Z [2024-06-28T02:37:02.459+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:36:00+00:00, run_id=scheduled__2024-06-28T02:36:00+00:00, run_start_date=2024-06-28 02:37:00.626333+00:00, run_end_date=2024-06-28 02:37:02.458847+00:00, run_duration=1.832514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:36:00+00:00, data_interval_end=2024-06-28 02:37:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:37:02.476534884Z [2024-06-28T02:37:02.476+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:37:00+00:00, run_after=2024-06-28T02:38:00+00:00 2024-06-28T02:37:02.534680996Z [2024-06-28T02:37:02.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:36:00+00:00 exited with status success for try_number 1 2024-06-28T02:37:02.542231673Z [2024-06-28T02:37:02.541+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:36:00+00:00, map_index=-1, run_start_date=2024-06-28 02:37:01.572190+00:00, run_end_date=2024-06-28 02:37:02.018851+00:00, run_duration=0.446661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1081, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:37:00.726973+00:00, queued_by_job_id=2, pid=15762 2024-06-28T02:37:04.877728614Z [2024-06-28T02:37:04.877+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:37:04.878143158Z [2024-06-28T02:37:04.877+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:36:00+00:00, run_id=scheduled__2024-06-28T02:36:00+00:00, run_start_date=2024-06-28 02:37:00.628984+00:00, run_end_date=2024-06-28 02:37:04.877805+00:00, run_duration=4.248821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:36:00+00:00, data_interval_end=2024-06-28 02:37:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:37:04.896228173Z [2024-06-28T02:37:04.895+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:37:00+00:00, run_after=2024-06-28T02:38:00+00:00 2024-06-28T02:37:04.902816732Z [2024-06-28T02:37:04.902+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:37:04.903072831Z [2024-06-28T02:37:04.902+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:36:00+00:00, run_id=scheduled__2024-06-28T02:36:00+00:00, run_start_date=2024-06-28 02:37:00.631659+00:00, run_end_date=2024-06-28 02:37:04.902789+00:00, run_duration=4.27113, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:36:00+00:00, data_interval_end=2024-06-28 02:37:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:37:04.911905137Z [2024-06-28T02:37:04.911+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:37:00+00:00, run_after=2024-06-28T02:38:00+00:00 2024-06-28T02:37:04.950548327Z [2024-06-28T02:37:04.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:36:00+00:00 exited with status success for try_number 1 2024-06-28T02:37:04.951053022Z [2024-06-28T02:37:04.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:36:00+00:00 exited with status success for try_number 1 2024-06-28T02:37:04.965502604Z [2024-06-28T02:37:04.964+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:36:00+00:00, map_index=-1, run_start_date=2024-06-28 02:37:02.504484+00:00, run_end_date=2024-06-28 02:37:04.738391+00:00, run_duration=2.233907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1083, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:37:00.726973+00:00, queued_by_job_id=2, pid=15781 2024-06-28T02:37:04.966093431Z [2024-06-28T02:37:04.965+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:36:00+00:00, map_index=-1, run_start_date=2024-06-28 02:37:02.481997+00:00, run_end_date=2024-06-28 02:37:04.244361+00:00, run_duration=1.762364, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1082, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:37:00.726973+00:00, queued_by_job_id=2, pid=15780 2024-06-28T02:38:00.625606100Z [2024-06-28T02:38:00.624+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:38:00+00:00, run_after=2024-06-28T02:39:00+00:00 2024-06-28T02:38:00.643418738Z [2024-06-28T02:38:00.642+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:38:00.654920963Z [2024-06-28T02:38:00.654+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:38:00.672848449Z [2024-06-28T02:38:00.672+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:38:00+00:00, run_after=2024-06-28T02:39:00+00:00 2024-06-28T02:38:00.767512864Z [2024-06-28T02:38:00.767+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:38:00.767537550Z 2024-06-28T02:38:00.767541549Z 2024-06-28T02:38:00.767544985Z 2024-06-28T02:38:00.767548359Z 2024-06-28T02:38:00.767790720Z [2024-06-28T02:38:00.767+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:38:00.768065941Z [2024-06-28T02:38:00.767+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:38:00.768409125Z [2024-06-28T02:38:00.768+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:38:00.768727514Z [2024-06-28T02:38:00.768+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:38:00.769639316Z [2024-06-28T02:38:00.769+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:38:00.769653745Z 2024-06-28T02:38:00.769679363Z 2024-06-28T02:38:00.769685475Z 2024-06-28T02:38:00.769711687Z 2024-06-28T02:38:00.775318262Z [2024-06-28T02:38:00.774+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:38:00.775331699Z [2024-06-28T02:38:00.775+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:38:00.775610725Z [2024-06-28T02:38:00.775+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:38:00.775812797Z [2024-06-28T02:38:00.775+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:38:00.776088335Z [2024-06-28T02:38:00.775+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:38:00.776262319Z [2024-06-28T02:38:00.776+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:38:00.776569082Z [2024-06-28T02:38:00.776+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:38:00.776849033Z [2024-06-28T02:38:00.776+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:38:01.368231484Z [2024-06-28T02:38:01.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:36:00+00:00 exited with status queued for try_number 1 2024-06-28T02:38:01.368490117Z [2024-06-28T02:38:01.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:37:00+00:00 exited with status queued for try_number 1 2024-06-28T02:38:01.368774452Z [2024-06-28T02:38:01.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:37:00+00:00 exited with status queued for try_number 1 2024-06-28T02:38:01.369025770Z [2024-06-28T02:38:01.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:37:00+00:00 exited with status queued for try_number 1 2024-06-28T02:38:01.383770059Z [2024-06-28T02:38:01.383+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc12c650-9672-4936-8408-7ee084d2cd7d 2024-06-28T02:38:01.384687950Z [2024-06-28T02:38:01.384+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44eac263-ee53-45fc-8fd5-5a3a497f8ee9 2024-06-28T02:38:01.385188445Z [2024-06-28T02:38:01.384+0000] {scheduler_job.py:635} INFO - Setting external_id for to d67b096d-100b-4744-8392-2ed13ce7df0e 2024-06-28T02:38:01.387265943Z [2024-06-28T02:38:01.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8dc46e44-20c2-4a8b-a098-630e4c814b70 2024-06-28T02:38:02.429955251Z [2024-06-28T02:38:02.429+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:38:02.432558296Z [2024-06-28T02:38:02.432+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:36:00+00:00, run_id=scheduled__2024-06-28T02:36:00+00:00, run_start_date=2024-06-28 02:38:00.686422+00:00, run_end_date=2024-06-28 02:38:02.429841+00:00, run_duration=1.743419, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:36:00+00:00, data_interval_end=2024-06-28 02:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:38:02.451809903Z [2024-06-28T02:38:02.451+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:38:00+00:00, run_after=2024-06-28T02:40:00+00:00 2024-06-28T02:38:02.462125967Z [2024-06-28T02:38:02.461+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:38:02.462263681Z [2024-06-28T02:38:02.462+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:37:00+00:00, run_id=scheduled__2024-06-28T02:37:00+00:00, run_start_date=2024-06-28 02:38:00.688338+00:00, run_end_date=2024-06-28 02:38:02.461979+00:00, run_duration=1.773641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:37:00+00:00, data_interval_end=2024-06-28 02:38:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:38:02.473084102Z [2024-06-28T02:38:02.472+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:38:00+00:00, run_after=2024-06-28T02:39:00+00:00 2024-06-28T02:38:02.503683545Z [2024-06-28T02:38:02.503+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:38:02.503706518Z 2024-06-28T02:38:02.504073214Z [2024-06-28T02:38:02.503+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-06-28T02:38:02.504718999Z [2024-06-28T02:38:02.504+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:38:02.504730643Z 2024-06-28T02:38:02.507001543Z [2024-06-28T02:38:02.506+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240628023800_917852', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:38:02.507352966Z [2024-06-28T02:38:02.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240628023800_917852', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-06-28T02:38:02.607102186Z [2024-06-28T02:38:02.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240628023800_917852 exited with status queued for try_number 1 2024-06-28T02:38:02.607515613Z [2024-06-28T02:38:02.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:36:00+00:00 exited with status success for try_number 1 2024-06-28T02:38:02.608051846Z [2024-06-28T02:38:02.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:37:00+00:00 exited with status success for try_number 1 2024-06-28T02:38:02.621508999Z [2024-06-28T02:38:02.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:37:00+00:00, map_index=-1, run_start_date=2024-06-28 02:38:01.809689+00:00, run_end_date=2024-06-28 02:38:02.241964+00:00, run_duration=0.432275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1084, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:38:00.770969+00:00, queued_by_job_id=2, pid=15814 2024-06-28T02:38:02.621976785Z [2024-06-28T02:38:02.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:36:00+00:00, map_index=-1, run_start_date=2024-06-28 02:38:01.903199+00:00, run_end_date=2024-06-28 02:38:02.258122+00:00, run_duration=0.354923, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1085, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:38:00.770969+00:00, queued_by_job_id=2, pid=15815 2024-06-28T02:38:02.622234502Z [2024-06-28T02:38:02.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39141c0e-ed27-451f-bc94-40f739ab1ac4 2024-06-28T02:38:04.651927189Z [2024-06-28T02:38:04.651+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:38:04.652202679Z [2024-06-28T02:38:04.651+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:37:00+00:00, run_id=scheduled__2024-06-28T02:37:00+00:00, run_start_date=2024-06-28 02:38:00.689676+00:00, run_end_date=2024-06-28 02:38:04.651809+00:00, run_duration=3.962133, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:37:00+00:00, data_interval_end=2024-06-28 02:38:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:38:04.660262138Z [2024-06-28T02:38:04.659+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:38:00+00:00, run_after=2024-06-28T02:39:00+00:00 2024-06-28T02:38:04.666053338Z [2024-06-28T02:38:04.665+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:38:04.666355892Z [2024-06-28T02:38:04.666+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-06-28 02:38:00.927857+00:00, run_id=scaleout_vdu_20240628023800_917852, run_start_date=2024-06-28 02:38:02.404628+00:00, run_end_date=2024-06-28 02:38:04.665978+00:00, run_duration=2.26135, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-06-28 02:38:00.927857+00:00, data_interval_end=2024-06-28 02:38:00.927857+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-06-28T02:38:04.669451871Z [2024-06-28T02:38:04.669+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-06-28T02:38:04.709250682Z [2024-06-28T02:38:04.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:37:00+00:00 exited with status success for try_number 1 2024-06-28T02:38:04.709278584Z [2024-06-28T02:38:04.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240628023800_917852 exited with status success for try_number 1 2024-06-28T02:38:04.715002900Z [2024-06-28T02:38:04.714+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:37:00+00:00, map_index=-1, run_start_date=2024-06-28 02:38:02.713687+00:00, run_end_date=2024-06-28 02:38:03.945396+00:00, run_duration=1.231709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1086, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:38:00.770969+00:00, queued_by_job_id=2, pid=15839 2024-06-28T02:38:04.715197690Z [2024-06-28T02:38:04.714+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240628023800_917852, map_index=-1, run_start_date=2024-06-28 02:38:03.272312+00:00, run_end_date=2024-06-28 02:38:03.662972+00:00, run_duration=0.39066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1088, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:38:02.505084+00:00, queued_by_job_id=2, pid=15851 2024-06-28T02:38:05.761642238Z [2024-06-28T02:38:05.761+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:38:05.761923125Z [2024-06-28T02:38:05.761+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:37:00+00:00, run_id=scheduled__2024-06-28T02:37:00+00:00, run_start_date=2024-06-28 02:38:00.690805+00:00, run_end_date=2024-06-28 02:38:05.761542+00:00, run_duration=5.070737, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:37:00+00:00, data_interval_end=2024-06-28 02:38:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:38:05.772169116Z [2024-06-28T02:38:05.771+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:38:00+00:00, run_after=2024-06-28T02:39:00+00:00 2024-06-28T02:38:05.804219024Z [2024-06-28T02:38:05.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:37:00+00:00 exited with status success for try_number 1 2024-06-28T02:38:05.809148233Z [2024-06-28T02:38:05.808+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:37:00+00:00, map_index=-1, run_start_date=2024-06-28 02:38:02.932051+00:00, run_end_date=2024-06-28 02:38:04.874971+00:00, run_duration=1.94292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1087, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:38:00.770969+00:00, queued_by_job_id=2, pid=15840 2024-06-28T02:39:00.622460534Z [2024-06-28T02:39:00.621+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:39:00+00:00, run_after=2024-06-28T02:40:00+00:00 2024-06-28T02:39:00.632958033Z [2024-06-28T02:39:00.632+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:39:00.647303345Z [2024-06-28T02:39:00.646+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:39:00+00:00, run_after=2024-06-28T02:40:00+00:00 2024-06-28T02:39:00.737768820Z [2024-06-28T02:39:00.737+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:39:00.737815605Z 2024-06-28T02:39:00.737825050Z 2024-06-28T02:39:00.737833055Z 2024-06-28T02:39:00.738086422Z [2024-06-28T02:39:00.737+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:39:00.738314172Z [2024-06-28T02:39:00.738+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:39:00.738488431Z [2024-06-28T02:39:00.738+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:39:00.740088128Z [2024-06-28T02:39:00.739+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:39:00.740115876Z 2024-06-28T02:39:00.740124738Z 2024-06-28T02:39:00.740133451Z 2024-06-28T02:39:00.747639066Z [2024-06-28T02:39:00.747+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:39:00.747929348Z [2024-06-28T02:39:00.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:39:00.748469982Z [2024-06-28T02:39:00.748+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:39:00.748752247Z [2024-06-28T02:39:00.748+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:39:00.749254960Z [2024-06-28T02:39:00.748+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:39:00.749440733Z [2024-06-28T02:39:00.749+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:39:00.992832685Z [2024-06-28T02:39:00.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:38:00+00:00 exited with status queued for try_number 1 2024-06-28T02:39:00.992978142Z [2024-06-28T02:39:00.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:38:00+00:00 exited with status queued for try_number 1 2024-06-28T02:39:00.993097226Z [2024-06-28T02:39:00.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:38:00+00:00 exited with status queued for try_number 1 2024-06-28T02:39:01.005035911Z [2024-06-28T02:39:01.004+0000] {scheduler_job.py:635} INFO - Setting external_id for to db163cfa-202e-4ed7-b204-b57123e7439b 2024-06-28T02:39:01.005209163Z [2024-06-28T02:39:01.005+0000] {scheduler_job.py:635} INFO - Setting external_id for to c400e1ac-311a-413b-be86-aeef07c9062a 2024-06-28T02:39:01.005367416Z [2024-06-28T02:39:01.005+0000] {scheduler_job.py:635} INFO - Setting external_id for to 735d4c19-0daa-4843-82a2-4fff600c8083 2024-06-28T02:39:02.168958369Z [2024-06-28T02:39:02.168+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:39:02.169145585Z [2024-06-28T02:39:02.168+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:38:00+00:00, run_id=scheduled__2024-06-28T02:38:00+00:00, run_start_date=2024-06-28 02:39:00.660629+00:00, run_end_date=2024-06-28 02:39:02.168827+00:00, run_duration=1.508198, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:38:00+00:00, data_interval_end=2024-06-28 02:39:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:39:02.178112587Z [2024-06-28T02:39:02.177+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:39:00+00:00, run_after=2024-06-28T02:40:00+00:00 2024-06-28T02:39:02.246484685Z [2024-06-28T02:39:02.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:38:00+00:00 exited with status success for try_number 1 2024-06-28T02:39:02.252546881Z [2024-06-28T02:39:02.252+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:38:00+00:00, map_index=-1, run_start_date=2024-06-28 02:39:01.528639+00:00, run_end_date=2024-06-28 02:39:01.922163+00:00, run_duration=0.393524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1089, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:39:00.741831+00:00, queued_by_job_id=2, pid=15878 2024-06-28T02:39:04.137606821Z [2024-06-28T02:39:04.137+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:39:04.137735223Z [2024-06-28T02:39:04.137+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:38:00+00:00, run_id=scheduled__2024-06-28T02:38:00+00:00, run_start_date=2024-06-28 02:39:00.661884+00:00, run_end_date=2024-06-28 02:39:04.137413+00:00, run_duration=3.475529, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:38:00+00:00, data_interval_end=2024-06-28 02:39:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:39:04.148003957Z [2024-06-28T02:39:04.147+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:39:00+00:00, run_after=2024-06-28T02:40:00+00:00 2024-06-28T02:39:04.223795116Z [2024-06-28T02:39:04.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:38:00+00:00 exited with status success for try_number 1 2024-06-28T02:39:04.229891135Z [2024-06-28T02:39:04.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:38:00+00:00, map_index=-1, run_start_date=2024-06-28 02:39:02.522963+00:00, run_end_date=2024-06-28 02:39:03.862992+00:00, run_duration=1.340029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1091, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:39:00.741831+00:00, queued_by_job_id=2, pid=15897 2024-06-28T02:39:04.630584866Z [2024-06-28T02:39:04.630+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:39:04.630901361Z [2024-06-28T02:39:04.630+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:38:00+00:00, run_id=scheduled__2024-06-28T02:38:00+00:00, run_start_date=2024-06-28 02:39:00.663278+00:00, run_end_date=2024-06-28 02:39:04.630464+00:00, run_duration=3.967186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:38:00+00:00, data_interval_end=2024-06-28 02:39:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:39:04.639697028Z [2024-06-28T02:39:04.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:39:00+00:00, run_after=2024-06-28T02:40:00+00:00 2024-06-28T02:39:04.672325596Z [2024-06-28T02:39:04.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:38:00+00:00 exited with status success for try_number 1 2024-06-28T02:39:04.684935287Z [2024-06-28T02:39:04.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:38:00+00:00, map_index=-1, run_start_date=2024-06-28 02:39:02.518954+00:00, run_end_date=2024-06-28 02:39:04.233663+00:00, run_duration=1.714709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1090, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:39:00.741831+00:00, queued_by_job_id=2, pid=15896 2024-06-28T02:40:00.530824244Z [2024-06-28T02:40:00.530+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:40:00+00:00, run_after=2024-06-28T02:41:00+00:00 2024-06-28T02:40:00.538498839Z [2024-06-28T02:40:00.538+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:40:00.546266663Z [2024-06-28T02:40:00.545+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:40:00.560431602Z [2024-06-28T02:40:00.559+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:40:00+00:00, run_after=2024-06-28T02:41:00+00:00 2024-06-28T02:40:00.575459396Z [2024-06-28T02:40:00.574+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:40:00+00:00, run_after=2024-06-28T02:45:00+00:00 2024-06-28T02:40:00.686184086Z [2024-06-28T02:40:00.685+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-28T02:40:00.686222458Z 2024-06-28T02:40:00.686235367Z 2024-06-28T02:40:00.686249960Z 2024-06-28T02:40:00.686257886Z 2024-06-28T02:40:00.686265325Z 2024-06-28T02:40:00.686965470Z [2024-06-28T02:40:00.686+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:40:00.687434415Z [2024-06-28T02:40:00.687+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:40:00.688038772Z [2024-06-28T02:40:00.687+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:40:00.688753816Z [2024-06-28T02:40:00.688+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:40:00.689435821Z [2024-06-28T02:40:00.689+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:40:00.692279601Z [2024-06-28T02:40:00.691+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:40:00.692288589Z 2024-06-28T02:40:00.692292714Z 2024-06-28T02:40:00.692296331Z 2024-06-28T02:40:00.692299381Z 2024-06-28T02:40:00.692302670Z 2024-06-28T02:40:00.700331249Z [2024-06-28T02:40:00.700+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T02:40:00.700725739Z [2024-06-28T02:40:00.700+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:40:00.701125618Z [2024-06-28T02:40:00.700+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:40:00.701367428Z [2024-06-28T02:40:00.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:40:00.701731011Z [2024-06-28T02:40:00.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:40:00.701973267Z [2024-06-28T02:40:00.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:40:00.702504093Z [2024-06-28T02:40:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:40:00.702981653Z [2024-06-28T02:40:00.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:40:00.703445573Z [2024-06-28T02:40:00.703+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:40:00.703703556Z [2024-06-28T02:40:00.703+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:40:01.081808102Z [2024-06-28T02:40:01.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:35:00+00:00 exited with status queued for try_number 1 2024-06-28T02:40:01.081857659Z [2024-06-28T02:40:01.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:38:00+00:00 exited with status queued for try_number 1 2024-06-28T02:40:01.083974105Z [2024-06-28T02:40:01.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:39:00+00:00 exited with status queued for try_number 1 2024-06-28T02:40:01.084335938Z [2024-06-28T02:40:01.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:39:00+00:00 exited with status queued for try_number 1 2024-06-28T02:40:01.084461558Z [2024-06-28T02:40:01.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:39:00+00:00 exited with status queued for try_number 1 2024-06-28T02:40:01.103599135Z [2024-06-28T02:40:01.103+0000] {scheduler_job.py:635} INFO - Setting external_id for to 718c943d-2cee-483e-bb42-3f7caf0fde22 2024-06-28T02:40:01.103656520Z [2024-06-28T02:40:01.103+0000] {scheduler_job.py:635} INFO - Setting external_id for to a88e86ff-0ca0-4378-880c-1d30618f4e16 2024-06-28T02:40:01.107223085Z [2024-06-28T02:40:01.106+0000] {scheduler_job.py:635} INFO - Setting external_id for to e69bbbcc-bb1b-410e-acae-4f86b5539170 2024-06-28T02:40:01.107352671Z [2024-06-28T02:40:01.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9511cd8e-0e69-4416-a9d3-3a109a382e2f 2024-06-28T02:40:01.107471126Z [2024-06-28T02:40:01.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49bc8919-bf41-4a88-8e1c-e84ab0b4ff1a 2024-06-28T02:40:01.322056666Z [2024-06-28T02:40:01.321+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:40:01.322080325Z 2024-06-28T02:40:01.322418561Z [2024-06-28T02:40:01.322+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-06-28T02:40:01.323122613Z [2024-06-28T02:40:01.322+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:40:01.323135784Z 2024-06-28T02:40:01.326072509Z [2024-06-28T02:40:01.325+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240628024000_323935', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:40:01.326263187Z [2024-06-28T02:40:01.326+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240628024000_323935', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-06-28T02:40:01.410067508Z [2024-06-28T02:40:01.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240628024000_323935 exited with status queued for try_number 1 2024-06-28T02:40:01.415755472Z [2024-06-28T02:40:01.415+0000] {scheduler_job.py:635} INFO - Setting external_id for to 410c81c0-5bfd-48f3-b8ba-494ea0bbf075 2024-06-28T02:40:02.684765775Z [2024-06-28T02:40:02.684+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:40:02.685274527Z [2024-06-28T02:40:02.685+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:39:00+00:00, run_id=scheduled__2024-06-28T02:39:00+00:00, run_start_date=2024-06-28 02:40:00.596103+00:00, run_end_date=2024-06-28 02:40:02.684924+00:00, run_duration=2.088821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:39:00+00:00, data_interval_end=2024-06-28 02:40:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:40:02.696176988Z [2024-06-28T02:40:02.695+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:40:00+00:00, run_after=2024-06-28T02:41:00+00:00 2024-06-28T02:40:02.797137573Z [2024-06-28T02:40:02.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:39:00+00:00 exited with status success for try_number 1 2024-06-28T02:40:02.807543835Z [2024-06-28T02:40:02.807+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:39:00+00:00, map_index=-1, run_start_date=2024-06-28 02:40:02.002596+00:00, run_end_date=2024-06-28 02:40:02.452928+00:00, run_duration=0.450332, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1092, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:40:00.694319+00:00, queued_by_job_id=2, pid=15931 2024-06-28T02:40:02.924942860Z [2024-06-28T02:40:02.924+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:40:02.925342760Z [2024-06-28T02:40:02.925+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-06-28 02:40:00.910941+00:00, run_id=scaleout_vdu_20240628024000_323935, run_start_date=2024-06-28 02:40:01.245428+00:00, run_end_date=2024-06-28 02:40:02.924882+00:00, run_duration=1.679454, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-06-28 02:40:00.910941+00:00, data_interval_end=2024-06-28 02:40:00.910941+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-06-28T02:40:02.992373643Z [2024-06-28T02:40:02.992+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-06-28T02:40:03.024685763Z [2024-06-28T02:40:03.024+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:40:03.024849813Z [2024-06-28T02:40:03.024+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:38:00+00:00, run_id=scheduled__2024-06-28T02:38:00+00:00, run_start_date=2024-06-28 02:40:00.594463+00:00, run_end_date=2024-06-28 02:40:03.024601+00:00, run_duration=2.430138, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:38:00+00:00, data_interval_end=2024-06-28 02:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:40:03.035081384Z [2024-06-28T02:40:03.034+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:40:00+00:00, run_after=2024-06-28T02:42:00+00:00 2024-06-28T02:40:03.138527754Z [2024-06-28T02:40:03.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:38:00+00:00 exited with status success for try_number 1 2024-06-28T02:40:03.138565186Z [2024-06-28T02:40:03.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240628024000_323935 exited with status success for try_number 1 2024-06-28T02:40:03.160152879Z [2024-06-28T02:40:03.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:38:00+00:00, map_index=-1, run_start_date=2024-06-28 02:40:02.160865+00:00, run_end_date=2024-06-28 02:40:02.690381+00:00, run_duration=0.529516, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1093, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:40:00.694319+00:00, queued_by_job_id=2, pid=15933 2024-06-28T02:40:03.160439157Z [2024-06-28T02:40:03.160+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240628024000_323935, map_index=-1, run_start_date=2024-06-28 02:40:02.230677+00:00, run_end_date=2024-06-28 02:40:02.792159+00:00, run_duration=0.561482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1094, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:40:01.323834+00:00, queued_by_job_id=2, pid=15934 2024-06-28T02:40:04.493159240Z [2024-06-28T02:40:04.492+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:40:04.493186323Z 2024-06-28T02:40:04.493362445Z [2024-06-28T02:40:04.493+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:40:04.494002757Z [2024-06-28T02:40:04.493+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:40:04.494015971Z 2024-06-28T02:40:04.496197264Z [2024-06-28T02:40:04.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T02:40:04.496370839Z [2024-06-28T02:40:04.496+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:40:04.550896437Z [2024-06-28T02:40:04.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:35:00+00:00 exited with status queued for try_number 1 2024-06-28T02:40:04.551343454Z [2024-06-28T02:40:04.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:35:00+00:00 exited with status success for try_number 1 2024-06-28T02:40:04.558386252Z [2024-06-28T02:40:04.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2955c66f-75e6-4ba3-a0cf-7daeed7e3ba9 2024-06-28T02:40:04.558557922Z [2024-06-28T02:40:04.558+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T02:35:00+00:00, map_index=-1, run_start_date=2024-06-28 02:40:03.204688+00:00, run_end_date=2024-06-28 02:40:03.661013+00:00, run_duration=0.456325, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1095, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:40:00.694319+00:00, queued_by_job_id=2, pid=15962 2024-06-28T02:40:05.806242637Z [2024-06-28T02:40:05.805+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:40:05.806391057Z [2024-06-28T02:40:05.806+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:39:00+00:00, run_id=scheduled__2024-06-28T02:39:00+00:00, run_start_date=2024-06-28 02:40:00.597561+00:00, run_end_date=2024-06-28 02:40:05.806152+00:00, run_duration=5.208591, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:39:00+00:00, data_interval_end=2024-06-28 02:40:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:40:05.816662426Z [2024-06-28T02:40:05.816+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:40:00+00:00, run_after=2024-06-28T02:41:00+00:00 2024-06-28T02:40:05.823006934Z [2024-06-28T02:40:05.822+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:40:05.823286679Z [2024-06-28T02:40:05.823+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:39:00+00:00, run_id=scheduled__2024-06-28T02:39:00+00:00, run_start_date=2024-06-28 02:40:00.599232+00:00, run_end_date=2024-06-28 02:40:05.822933+00:00, run_duration=5.223701, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:39:00+00:00, data_interval_end=2024-06-28 02:40:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:40:05.834913598Z [2024-06-28T02:40:05.834+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:40:00+00:00, run_after=2024-06-28T02:41:00+00:00 2024-06-28T02:40:05.892640381Z [2024-06-28T02:40:05.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:39:00+00:00 exited with status success for try_number 1 2024-06-28T02:40:05.892733492Z [2024-06-28T02:40:05.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:39:00+00:00 exited with status success for try_number 1 2024-06-28T02:40:05.900874899Z [2024-06-28T02:40:05.900+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:39:00+00:00, map_index=-1, run_start_date=2024-06-28 02:40:03.605759+00:00, run_end_date=2024-06-28 02:40:05.068006+00:00, run_duration=1.462247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1097, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:40:00.694319+00:00, queued_by_job_id=2, pid=15979 2024-06-28T02:40:05.901056097Z [2024-06-28T02:40:05.900+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:39:00+00:00, map_index=-1, run_start_date=2024-06-28 02:40:03.230402+00:00, run_end_date=2024-06-28 02:40:05.118951+00:00, run_duration=1.888549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1096, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:40:00.694319+00:00, queued_by_job_id=2, pid=15963 2024-06-28T02:40:07.376841965Z [2024-06-28T02:40:07.376+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:40:07.376881565Z 2024-06-28T02:40:07.377031666Z [2024-06-28T02:40:07.376+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:40:07.377849944Z [2024-06-28T02:40:07.377+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:40:07.377880266Z 2024-06-28T02:40:07.382351542Z [2024-06-28T02:40:07.382+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T02:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T02:40:07.382433046Z [2024-06-28T02:40:07.382+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T02:40:07.484621485Z [2024-06-28T02:40:07.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:35:00+00:00 exited with status queued for try_number 1 2024-06-28T02:40:07.484999250Z [2024-06-28T02:40:07.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:35:00+00:00 exited with status success for try_number 1 2024-06-28T02:40:07.490836728Z [2024-06-28T02:40:07.490+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3413631-3522-40f0-996e-f114f95657be 2024-06-28T02:40:07.491155324Z [2024-06-28T02:40:07.490+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T02:35:00+00:00, map_index=-1, run_start_date=2024-06-28 02:40:06.343356+00:00, run_end_date=2024-06-28 02:40:06.701439+00:00, run_duration=0.358083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1098, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:40:04.494421+00:00, queued_by_job_id=2, pid=15992 2024-06-28T02:40:10.879279962Z [2024-06-28T02:40:10.878+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:40:10.879309709Z 2024-06-28T02:40:10.879851675Z [2024-06-28T02:40:10.879+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:40:10.881093548Z [2024-06-28T02:40:10.880+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:40:10.881107430Z 2024-06-28T02:40:10.885128602Z [2024-06-28T02:40:10.884+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:40:10.885450330Z [2024-06-28T02:40:10.885+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:40:10.965443713Z [2024-06-28T02:40:10.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:35:00+00:00 exited with status queued for try_number 1 2024-06-28T02:40:10.965744973Z [2024-06-28T02:40:10.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:35:00+00:00 exited with status success for try_number 1 2024-06-28T02:40:10.975911947Z [2024-06-28T02:40:10.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58c7d140-1137-4a5d-b81f-bae9f9955986 2024-06-28T02:40:10.976244366Z [2024-06-28T02:40:10.975+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T02:35:00+00:00, map_index=0, run_start_date=2024-06-28 02:40:09.013964+00:00, run_end_date=2024-06-28 02:40:10.171739+00:00, run_duration=1.157775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1099, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:40:07.378320+00:00, queued_by_job_id=2, pid=16000 2024-06-28T02:40:13.448404868Z [2024-06-28T02:40:13.447+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:40:13.449019803Z [2024-06-28T02:40:13.448+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:35:00+00:00, run_id=scheduled__2024-06-28T02:35:00+00:00, run_start_date=2024-06-28 02:40:00.592676+00:00, run_end_date=2024-06-28 02:40:13.448236+00:00, run_duration=12.85556, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:35:00+00:00, data_interval_end=2024-06-28 02:40:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T02:40:13.458291951Z [2024-06-28T02:40:13.457+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:40:00+00:00, run_after=2024-06-28T02:45:00+00:00 2024-06-28T02:40:13.503176993Z [2024-06-28T02:40:13.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:35:00+00:00 exited with status success for try_number 1 2024-06-28T02:40:13.512765337Z [2024-06-28T02:40:13.512+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T02:35:00+00:00, map_index=-1, run_start_date=2024-06-28 02:40:12.511506+00:00, run_end_date=2024-06-28 02:40:12.939984+00:00, run_duration=0.428478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:40:10.881903+00:00, queued_by_job_id=2, pid=16013 2024-06-28T02:41:00.348467873Z [2024-06-28T02:41:00.348+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:41:00+00:00, run_after=2024-06-28T02:42:00+00:00 2024-06-28T02:41:00.360488700Z [2024-06-28T02:41:00.360+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:41:00+00:00, run_after=2024-06-28T02:42:00+00:00 2024-06-28T02:41:00.366985503Z [2024-06-28T02:41:00.366+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:41:00.419806050Z [2024-06-28T02:41:00.419+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:41:00.419856874Z 2024-06-28T02:41:00.419869987Z 2024-06-28T02:41:00.419881848Z 2024-06-28T02:41:00.419911902Z [2024-06-28T02:41:00.419+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:41:00.420122115Z [2024-06-28T02:41:00.419+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:41:00.420353458Z [2024-06-28T02:41:00.420+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:41:00.420978710Z [2024-06-28T02:41:00.420+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:41:00.420990643Z 2024-06-28T02:41:00.420994291Z 2024-06-28T02:41:00.420997862Z 2024-06-28T02:41:00.423784973Z [2024-06-28T02:41:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:41:00.423997711Z [2024-06-28T02:41:00.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:41:00.424311587Z [2024-06-28T02:41:00.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:41:00.424510283Z [2024-06-28T02:41:00.424+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:41:00.424777869Z [2024-06-28T02:41:00.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:41:00.424932346Z [2024-06-28T02:41:00.424+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:41:00.771261383Z [2024-06-28T02:41:00.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:40:00+00:00 exited with status queued for try_number 1 2024-06-28T02:41:00.771467985Z [2024-06-28T02:41:00.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:40:00+00:00 exited with status queued for try_number 1 2024-06-28T02:41:00.771629479Z [2024-06-28T02:41:00.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:40:00+00:00 exited with status queued for try_number 1 2024-06-28T02:41:00.783303263Z [2024-06-28T02:41:00.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2098569d-b5df-42d2-a23e-35d38c34a594 2024-06-28T02:41:00.786507038Z [2024-06-28T02:41:00.786+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea4a574a-e79b-46f7-bf80-d13b3e5e40b5 2024-06-28T02:41:00.786768940Z [2024-06-28T02:41:00.786+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90acf1d7-1b95-4c53-8774-d8c26ff2c3f4 2024-06-28T02:41:01.961591149Z [2024-06-28T02:41:01.961+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:41:01.962323978Z [2024-06-28T02:41:01.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:40:00+00:00, run_id=scheduled__2024-06-28T02:40:00+00:00, run_start_date=2024-06-28 02:41:00.376175+00:00, run_end_date=2024-06-28 02:41:01.961920+00:00, run_duration=1.585745, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:40:00+00:00, data_interval_end=2024-06-28 02:41:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:41:01.976028240Z [2024-06-28T02:41:01.975+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:41:00+00:00, run_after=2024-06-28T02:42:00+00:00 2024-06-28T02:41:02.028680906Z [2024-06-28T02:41:02.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:40:00+00:00 exited with status success for try_number 1 2024-06-28T02:41:02.035244349Z [2024-06-28T02:41:02.034+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:40:00+00:00, map_index=-1, run_start_date=2024-06-28 02:41:01.377937+00:00, run_end_date=2024-06-28 02:41:01.761629+00:00, run_duration=0.383692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:41:00.421662+00:00, queued_by_job_id=2, pid=16035 2024-06-28T02:41:03.619763607Z [2024-06-28T02:41:03.619+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:41:03.620101741Z [2024-06-28T02:41:03.619+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:40:00+00:00, run_id=scheduled__2024-06-28T02:40:00+00:00, run_start_date=2024-06-28 02:41:00.377213+00:00, run_end_date=2024-06-28 02:41:03.619605+00:00, run_duration=3.242392, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:40:00+00:00, data_interval_end=2024-06-28 02:41:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:41:03.632989550Z [2024-06-28T02:41:03.632+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:41:00+00:00, run_after=2024-06-28T02:42:00+00:00 2024-06-28T02:41:03.685986034Z [2024-06-28T02:41:03.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:40:00+00:00 exited with status success for try_number 1 2024-06-28T02:41:03.695824905Z [2024-06-28T02:41:03.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:40:00+00:00, map_index=-1, run_start_date=2024-06-28 02:41:02.133895+00:00, run_end_date=2024-06-28 02:41:03.402613+00:00, run_duration=1.268718, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:41:00.421662+00:00, queued_by_job_id=2, pid=16050 2024-06-28T02:41:04.919731592Z [2024-06-28T02:41:04.918+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:41:04.921956803Z [2024-06-28T02:41:04.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:40:00+00:00, run_id=scheduled__2024-06-28T02:40:00+00:00, run_start_date=2024-06-28 02:41:00.378106+00:00, run_end_date=2024-06-28 02:41:04.919651+00:00, run_duration=4.541545, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:40:00+00:00, data_interval_end=2024-06-28 02:41:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:41:04.934243347Z [2024-06-28T02:41:04.933+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:41:00+00:00, run_after=2024-06-28T02:42:00+00:00 2024-06-28T02:41:04.983637890Z [2024-06-28T02:41:04.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:40:00+00:00 exited with status success for try_number 1 2024-06-28T02:41:04.997114840Z [2024-06-28T02:41:04.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:40:00+00:00, map_index=-1, run_start_date=2024-06-28 02:41:02.356669+00:00, run_end_date=2024-06-28 02:41:03.871780+00:00, run_duration=1.515111, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:41:00.421662+00:00, queued_by_job_id=2, pid=16054 2024-06-28T02:41:47.719076266Z [2024-06-28T02:41:47.718+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T02:42:00.285443040Z [2024-06-28T02:42:00.284+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:42:00+00:00, run_after=2024-06-28T02:43:00+00:00 2024-06-28T02:42:00.296885140Z [2024-06-28T02:42:00.296+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:42:00.305919936Z [2024-06-28T02:42:00.305+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:42:00.323859804Z [2024-06-28T02:42:00.323+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:42:00+00:00, run_after=2024-06-28T02:43:00+00:00 2024-06-28T02:42:00.424638280Z [2024-06-28T02:42:00.424+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:42:00.424666561Z 2024-06-28T02:42:00.424672351Z 2024-06-28T02:42:00.424677183Z 2024-06-28T02:42:00.424682174Z 2024-06-28T02:42:00.425040709Z [2024-06-28T02:42:00.424+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:42:00.425388349Z [2024-06-28T02:42:00.425+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:42:00.425734610Z [2024-06-28T02:42:00.425+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:42:00.426016532Z [2024-06-28T02:42:00.425+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:42:00.427154652Z [2024-06-28T02:42:00.426+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:42:00.427171680Z 2024-06-28T02:42:00.427176667Z 2024-06-28T02:42:00.427191621Z 2024-06-28T02:42:00.427196557Z 2024-06-28T02:42:00.432028551Z [2024-06-28T02:42:00.431+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:42:00.432366972Z [2024-06-28T02:42:00.432+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:42:00.432758974Z [2024-06-28T02:42:00.432+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:42:00.433121551Z [2024-06-28T02:42:00.432+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:42:00.433481345Z [2024-06-28T02:42:00.433+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:42:00.433722967Z [2024-06-28T02:42:00.433+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:42:00.434059951Z [2024-06-28T02:42:00.433+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:42:00.434297023Z [2024-06-28T02:42:00.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:42:00.794364661Z [2024-06-28T02:42:00.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:40:00+00:00 exited with status queued for try_number 1 2024-06-28T02:42:00.794739002Z [2024-06-28T02:42:00.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:41:00+00:00 exited with status queued for try_number 1 2024-06-28T02:42:00.797701983Z [2024-06-28T02:42:00.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:41:00+00:00 exited with status queued for try_number 1 2024-06-28T02:42:00.797926238Z [2024-06-28T02:42:00.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:41:00+00:00 exited with status queued for try_number 1 2024-06-28T02:42:00.825132748Z [2024-06-28T02:42:00.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99b57f9a-3e82-4024-b832-b7d2a98842fe 2024-06-28T02:42:00.825350634Z [2024-06-28T02:42:00.825+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65e9d505-5e2d-4a13-a5d4-08756719f683 2024-06-28T02:42:00.825568525Z [2024-06-28T02:42:00.825+0000] {scheduler_job.py:635} INFO - Setting external_id for to c20324fd-163f-4b5d-afb6-9ebaab0e13a0 2024-06-28T02:42:00.825798555Z [2024-06-28T02:42:00.825+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4f7246c-d69e-4ead-abea-63ecfb5d605a 2024-06-28T02:42:02.055065762Z [2024-06-28T02:42:02.054+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:42:02.055331856Z [2024-06-28T02:42:02.055+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:40:00+00:00, run_id=scheduled__2024-06-28T02:40:00+00:00, run_start_date=2024-06-28 02:42:00.340801+00:00, run_end_date=2024-06-28 02:42:02.055008+00:00, run_duration=1.714207, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:40:00+00:00, data_interval_end=2024-06-28 02:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:42:02.062513865Z [2024-06-28T02:42:02.062+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:42:00+00:00, run_after=2024-06-28T02:44:00+00:00 2024-06-28T02:42:02.148617850Z [2024-06-28T02:42:02.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:40:00+00:00 exited with status success for try_number 1 2024-06-28T02:42:02.166263348Z [2024-06-28T02:42:02.165+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:40:00+00:00, map_index=-1, run_start_date=2024-06-28 02:42:01.407214+00:00, run_end_date=2024-06-28 02:42:01.881172+00:00, run_duration=0.473958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:42:00.428376+00:00, queued_by_job_id=2, pid=16082 2024-06-28T02:42:03.251550728Z [2024-06-28T02:42:03.251+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:42:03.255428495Z [2024-06-28T02:42:03.255+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:41:00+00:00, run_id=scheduled__2024-06-28T02:41:00+00:00, run_start_date=2024-06-28 02:42:00.343603+00:00, run_end_date=2024-06-28 02:42:03.251448+00:00, run_duration=2.907845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:41:00+00:00, data_interval_end=2024-06-28 02:42:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:42:03.273013722Z [2024-06-28T02:42:03.272+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:42:00+00:00, run_after=2024-06-28T02:43:00+00:00 2024-06-28T02:42:03.386446403Z [2024-06-28T02:42:03.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:41:00+00:00 exited with status success for try_number 1 2024-06-28T02:42:03.396535394Z [2024-06-28T02:42:03.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:41:00+00:00, map_index=-1, run_start_date=2024-06-28 02:42:01.943592+00:00, run_end_date=2024-06-28 02:42:02.321629+00:00, run_duration=0.378037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:42:00.428376+00:00, queued_by_job_id=2, pid=16093 2024-06-28T02:42:03.991173155Z [2024-06-28T02:42:03.990+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:42:03.991207957Z 2024-06-28T02:42:03.991348453Z [2024-06-28T02:42:03.991+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-06-28T02:42:03.992473838Z [2024-06-28T02:42:03.992+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:42:03.992522226Z 2024-06-28T02:42:03.996683589Z [2024-06-28T02:42:03.996+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240628024202_644265', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:42:03.996892185Z [2024-06-28T02:42:03.996+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240628024202_644265', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-06-28T02:42:04.068372027Z [2024-06-28T02:42:04.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240628024202_644265 exited with status queued for try_number 1 2024-06-28T02:42:04.078142432Z [2024-06-28T02:42:04.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac93761a-0ae9-4222-8c33-0e61a0adaa95 2024-06-28T02:42:05.391270578Z [2024-06-28T02:42:05.390+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:42:05.391685289Z [2024-06-28T02:42:05.391+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:41:00+00:00, run_id=scheduled__2024-06-28T02:41:00+00:00, run_start_date=2024-06-28 02:42:00.346156+00:00, run_end_date=2024-06-28 02:42:05.391189+00:00, run_duration=5.045033, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:41:00+00:00, data_interval_end=2024-06-28 02:42:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:42:05.409138971Z [2024-06-28T02:42:05.408+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:42:00+00:00, run_after=2024-06-28T02:43:00+00:00 2024-06-28T02:42:05.424879260Z [2024-06-28T02:42:05.424+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:42:05.425181370Z [2024-06-28T02:42:05.425+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-06-28 02:42:03.572392+00:00, run_id=vdu_alarm_20240628024202_644265, run_start_date=2024-06-28 02:42:03.923444+00:00, run_end_date=2024-06-28 02:42:05.424809+00:00, run_duration=1.501365, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-06-28 02:42:03.572392+00:00, data_interval_end=2024-06-28 02:42:03.572392+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-06-28T02:42:05.429146318Z [2024-06-28T02:42:05.428+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-06-28T02:42:05.538974878Z [2024-06-28T02:42:05.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:41:00+00:00 exited with status success for try_number 1 2024-06-28T02:42:05.538997201Z [2024-06-28T02:42:05.536+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:41:00+00:00, map_index=-1, run_start_date=2024-06-28 02:42:03.053954+00:00, run_end_date=2024-06-28 02:42:05.195122+00:00, run_duration=2.141168, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:42:00.428376+00:00, queued_by_job_id=2, pid=16112 2024-06-28T02:42:06.584022346Z [2024-06-28T02:42:06.582+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:42:06.584797009Z [2024-06-28T02:42:06.584+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:41:00+00:00, run_id=scheduled__2024-06-28T02:41:00+00:00, run_start_date=2024-06-28 02:42:00.348657+00:00, run_end_date=2024-06-28 02:42:06.584184+00:00, run_duration=6.235527, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:41:00+00:00, data_interval_end=2024-06-28 02:42:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:42:06.598922150Z [2024-06-28T02:42:06.598+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:42:00+00:00, run_after=2024-06-28T02:43:00+00:00 2024-06-28T02:42:06.649659277Z [2024-06-28T02:42:06.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:41:00+00:00 exited with status success for try_number 1 2024-06-28T02:42:06.649973036Z [2024-06-28T02:42:06.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240628024202_644265 exited with status success for try_number 1 2024-06-28T02:42:06.661488472Z [2024-06-28T02:42:06.660+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:41:00+00:00, map_index=-1, run_start_date=2024-06-28 02:42:02.973014+00:00, run_end_date=2024-06-28 02:42:05.528636+00:00, run_duration=2.555622, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:42:00.428376+00:00, queued_by_job_id=2, pid=16111 2024-06-28T02:42:06.662353847Z [2024-06-28T02:42:06.661+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240628024202_644265, map_index=-1, run_start_date=2024-06-28 02:42:04.942961+00:00, run_end_date=2024-06-28 02:42:05.397798+00:00, run_duration=0.454837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:42:03.993699+00:00, queued_by_job_id=2, pid=16124 2024-06-28T02:43:00.278444538Z [2024-06-28T02:43:00.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:43:00+00:00, run_after=2024-06-28T02:44:00+00:00 2024-06-28T02:43:00.285252675Z [2024-06-28T02:43:00.284+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:43:00.295545309Z [2024-06-28T02:43:00.295+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:43:00+00:00, run_after=2024-06-28T02:44:00+00:00 2024-06-28T02:43:00.357808569Z [2024-06-28T02:43:00.357+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:43:00.357920749Z 2024-06-28T02:43:00.357931482Z 2024-06-28T02:43:00.357938889Z 2024-06-28T02:43:00.357945993Z [2024-06-28T02:43:00.357+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:43:00.357968036Z [2024-06-28T02:43:00.357+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:43:00.357975906Z [2024-06-28T02:43:00.357+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:43:00.358590724Z [2024-06-28T02:43:00.358+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:43:00.358609900Z 2024-06-28T02:43:00.358617649Z 2024-06-28T02:43:00.358647776Z 2024-06-28T02:43:00.366912876Z [2024-06-28T02:43:00.366+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:43:00.367133296Z [2024-06-28T02:43:00.366+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:43:00.367495940Z [2024-06-28T02:43:00.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:43:00.367623588Z [2024-06-28T02:43:00.367+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:43:00.368098039Z [2024-06-28T02:43:00.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:43:00.368164017Z [2024-06-28T02:43:00.367+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:43:00.665994373Z [2024-06-28T02:43:00.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:42:00+00:00 exited with status queued for try_number 1 2024-06-28T02:43:00.668016051Z [2024-06-28T02:43:00.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:42:00+00:00 exited with status queued for try_number 1 2024-06-28T02:43:00.668119501Z [2024-06-28T02:43:00.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:42:00+00:00 exited with status queued for try_number 1 2024-06-28T02:43:00.679020019Z [2024-06-28T02:43:00.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a5949f4-1d15-45af-8152-098cf6d424f8 2024-06-28T02:43:00.680165783Z [2024-06-28T02:43:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66f010b1-9cd9-4b1e-a8f7-ce01017b7003 2024-06-28T02:43:00.680351481Z [2024-06-28T02:43:00.680+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cdc4fff-ca7b-45bf-9bbd-44ca4f34b44e 2024-06-28T02:43:02.949948658Z [2024-06-28T02:43:02.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:43:02.950284827Z [2024-06-28T02:43:02.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:42:00+00:00, run_id=scheduled__2024-06-28T02:42:00+00:00, run_start_date=2024-06-28 02:43:00.304130+00:00, run_end_date=2024-06-28 02:43:02.949757+00:00, run_duration=2.645627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:42:00+00:00, data_interval_end=2024-06-28 02:43:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:43:02.959862487Z [2024-06-28T02:43:02.959+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:43:00+00:00, run_after=2024-06-28T02:44:00+00:00 2024-06-28T02:43:03.010618758Z [2024-06-28T02:43:03.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:42:00+00:00 exited with status success for try_number 1 2024-06-28T02:43:03.015623613Z [2024-06-28T02:43:03.015+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:42:00+00:00, map_index=-1, run_start_date=2024-06-28 02:43:01.560027+00:00, run_end_date=2024-06-28 02:43:01.991593+00:00, run_duration=0.431566, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:43:00.359516+00:00, queued_by_job_id=2, pid=16151 2024-06-28T02:43:04.297641416Z [2024-06-28T02:43:04.297+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:43:04.297985308Z [2024-06-28T02:43:04.297+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:42:00+00:00, run_id=scheduled__2024-06-28T02:42:00+00:00, run_start_date=2024-06-28 02:43:00.305212+00:00, run_end_date=2024-06-28 02:43:04.297547+00:00, run_duration=3.992335, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:42:00+00:00, data_interval_end=2024-06-28 02:43:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:43:04.306904174Z [2024-06-28T02:43:04.306+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:43:00+00:00, run_after=2024-06-28T02:44:00+00:00 2024-06-28T02:43:04.359405422Z [2024-06-28T02:43:04.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:42:00+00:00 exited with status success for try_number 1 2024-06-28T02:43:04.390036362Z [2024-06-28T02:43:04.389+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:42:00+00:00, map_index=-1, run_start_date=2024-06-28 02:43:02.503456+00:00, run_end_date=2024-06-28 02:43:04.020461+00:00, run_duration=1.517005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:43:00.359516+00:00, queued_by_job_id=2, pid=16169 2024-06-28T02:43:05.799358030Z [2024-06-28T02:43:05.798+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:43:05.799660612Z [2024-06-28T02:43:05.799+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:42:00+00:00, run_id=scheduled__2024-06-28T02:42:00+00:00, run_start_date=2024-06-28 02:43:00.306161+00:00, run_end_date=2024-06-28 02:43:05.799252+00:00, run_duration=5.493091, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:42:00+00:00, data_interval_end=2024-06-28 02:43:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:43:05.811947547Z [2024-06-28T02:43:05.811+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:43:00+00:00, run_after=2024-06-28T02:44:00+00:00 2024-06-28T02:43:05.853052497Z [2024-06-28T02:43:05.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:42:00+00:00 exited with status success for try_number 1 2024-06-28T02:43:05.858115915Z [2024-06-28T02:43:05.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:42:00+00:00, map_index=-1, run_start_date=2024-06-28 02:43:02.627791+00:00, run_end_date=2024-06-28 02:43:05.102534+00:00, run_duration=2.474743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:43:00.359516+00:00, queued_by_job_id=2, pid=16170 2024-06-28T02:44:00.235500654Z [2024-06-28T02:44:00.234+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:44:00+00:00, run_after=2024-06-28T02:45:00+00:00 2024-06-28T02:44:00.242280848Z [2024-06-28T02:44:00.241+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:44:00.252670623Z [2024-06-28T02:44:00.252+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:44:00+00:00, run_after=2024-06-28T02:45:00+00:00 2024-06-28T02:44:00.258612484Z [2024-06-28T02:44:00.258+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:44:00.338517378Z [2024-06-28T02:44:00.338+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:44:00.338552824Z 2024-06-28T02:44:00.338563986Z 2024-06-28T02:44:00.338570234Z 2024-06-28T02:44:00.338576160Z 2024-06-28T02:44:00.339155424Z [2024-06-28T02:44:00.338+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:44:00.339579672Z [2024-06-28T02:44:00.339+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:44:00.339940246Z [2024-06-28T02:44:00.339+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:44:00.340420433Z [2024-06-28T02:44:00.340+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:44:00.341471732Z [2024-06-28T02:44:00.341+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:44:00.341488952Z 2024-06-28T02:44:00.341493375Z 2024-06-28T02:44:00.341496482Z 2024-06-28T02:44:00.341499603Z 2024-06-28T02:44:00.347649620Z [2024-06-28T02:44:00.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:44:00.347985482Z [2024-06-28T02:44:00.347+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:44:00.348356747Z [2024-06-28T02:44:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:44:00.348563445Z [2024-06-28T02:44:00.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:44:00.348860606Z [2024-06-28T02:44:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:44:00.349058685Z [2024-06-28T02:44:00.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:44:00.349342703Z [2024-06-28T02:44:00.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:44:00.349514837Z [2024-06-28T02:44:00.349+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:44:00.584182161Z [2024-06-28T02:44:00.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:42:00+00:00 exited with status queued for try_number 1 2024-06-28T02:44:00.586439099Z [2024-06-28T02:44:00.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:43:00+00:00 exited with status queued for try_number 1 2024-06-28T02:44:00.586677593Z [2024-06-28T02:44:00.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:43:00+00:00 exited with status queued for try_number 1 2024-06-28T02:44:00.586915513Z [2024-06-28T02:44:00.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:43:00+00:00 exited with status queued for try_number 1 2024-06-28T02:44:00.610889804Z [2024-06-28T02:44:00.610+0000] {scheduler_job.py:635} INFO - Setting external_id for to 723bb6a4-c08e-418b-b5d0-5b521841182a 2024-06-28T02:44:00.611307315Z [2024-06-28T02:44:00.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6abfba6-3c6a-4891-9d09-d57a77d7bd0a 2024-06-28T02:44:00.611869859Z [2024-06-28T02:44:00.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff69db93-cf33-463e-8ecf-9495675950a7 2024-06-28T02:44:00.612402445Z [2024-06-28T02:44:00.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c80d623-39f4-4b6b-b28e-c02e26db61fa 2024-06-28T02:44:01.904250398Z [2024-06-28T02:44:01.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:44:01.904464764Z [2024-06-28T02:44:01.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:43:00+00:00, run_id=scheduled__2024-06-28T02:43:00+00:00, run_start_date=2024-06-28 02:44:00.269050+00:00, run_end_date=2024-06-28 02:44:01.904145+00:00, run_duration=1.635095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:43:00+00:00, data_interval_end=2024-06-28 02:44:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:44:01.932970679Z [2024-06-28T02:44:01.932+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:44:00+00:00, run_after=2024-06-28T02:45:00+00:00 2024-06-28T02:44:03.102491765Z [2024-06-28T02:44:03.102+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:44:03.102632598Z [2024-06-28T02:44:03.102+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:42:00+00:00, run_id=scheduled__2024-06-28T02:42:00+00:00, run_start_date=2024-06-28 02:44:00.267937+00:00, run_end_date=2024-06-28 02:44:03.102397+00:00, run_duration=2.83446, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:42:00+00:00, data_interval_end=2024-06-28 02:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:44:03.113005229Z [2024-06-28T02:44:03.112+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:44:00+00:00, run_after=2024-06-28T02:46:00+00:00 2024-06-28T02:44:03.172562088Z [2024-06-28T02:44:03.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:42:00+00:00 exited with status success for try_number 1 2024-06-28T02:44:03.172604098Z [2024-06-28T02:44:03.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:43:00+00:00 exited with status success for try_number 1 2024-06-28T02:44:03.179022959Z [2024-06-28T02:44:03.178+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:43:00+00:00, map_index=-1, run_start_date=2024-06-28 02:44:01.288172+00:00, run_end_date=2024-06-28 02:44:01.813397+00:00, run_duration=0.525225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:44:00.343030+00:00, queued_by_job_id=2, pid=16204 2024-06-28T02:44:03.179417658Z [2024-06-28T02:44:03.179+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:42:00+00:00, map_index=-1, run_start_date=2024-06-28 02:44:01.389095+00:00, run_end_date=2024-06-28 02:44:02.037253+00:00, run_duration=0.648158, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:44:00.343030+00:00, queued_by_job_id=2, pid=16205 2024-06-28T02:44:04.680531704Z [2024-06-28T02:44:04.679+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:44:04.680987305Z [2024-06-28T02:44:04.680+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:43:00+00:00, run_id=scheduled__2024-06-28T02:43:00+00:00, run_start_date=2024-06-28 02:44:00.269938+00:00, run_end_date=2024-06-28 02:44:04.680463+00:00, run_duration=4.410525, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:43:00+00:00, data_interval_end=2024-06-28 02:44:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:44:04.701514263Z [2024-06-28T02:44:04.701+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:44:00+00:00, run_after=2024-06-28T02:45:00+00:00 2024-06-28T02:44:04.720308172Z [2024-06-28T02:44:04.719+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:44:04.720465597Z [2024-06-28T02:44:04.720+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:43:00+00:00, run_id=scheduled__2024-06-28T02:43:00+00:00, run_start_date=2024-06-28 02:44:00.270847+00:00, run_end_date=2024-06-28 02:44:04.720227+00:00, run_duration=4.44938, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:43:00+00:00, data_interval_end=2024-06-28 02:44:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:44:04.739807669Z [2024-06-28T02:44:04.739+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:44:00+00:00, run_after=2024-06-28T02:45:00+00:00 2024-06-28T02:44:04.784918012Z [2024-06-28T02:44:04.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:43:00+00:00 exited with status success for try_number 1 2024-06-28T02:44:04.785210181Z [2024-06-28T02:44:04.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:43:00+00:00 exited with status success for try_number 1 2024-06-28T02:44:04.792048154Z [2024-06-28T02:44:04.791+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:43:00+00:00, map_index=-1, run_start_date=2024-06-28 02:44:02.892360+00:00, run_end_date=2024-06-28 02:44:04.093951+00:00, run_duration=1.201591, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:44:00.343030+00:00, queued_by_job_id=2, pid=16229 2024-06-28T02:44:04.792478362Z [2024-06-28T02:44:04.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:43:00+00:00, map_index=-1, run_start_date=2024-06-28 02:44:02.854307+00:00, run_end_date=2024-06-28 02:44:04.435224+00:00, run_duration=1.580917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:44:00.343030+00:00, queued_by_job_id=2, pid=16228 2024-06-28T02:45:00.805012195Z [2024-06-28T02:45:00.804+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:45:00+00:00, run_after=2024-06-28T02:50:00+00:00 2024-06-28T02:45:00.815722560Z [2024-06-28T02:45:00.815+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:45:00.837327993Z [2024-06-28T02:45:00.836+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:45:00+00:00, run_after=2024-06-28T02:46:00+00:00 2024-06-28T02:45:00.859024647Z [2024-06-28T02:45:00.858+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:45:00+00:00, run_after=2024-06-28T02:46:00+00:00 2024-06-28T02:45:00.968983727Z [2024-06-28T02:45:00.968+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:45:00.969016262Z 2024-06-28T02:45:00.969022069Z 2024-06-28T02:45:00.969026356Z 2024-06-28T02:45:00.969030370Z 2024-06-28T02:45:00.969294362Z [2024-06-28T02:45:00.968+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:45:00.969561883Z [2024-06-28T02:45:00.969+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:45:00.969930809Z [2024-06-28T02:45:00.969+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:45:00.970246500Z [2024-06-28T02:45:00.969+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:45:00.971927420Z [2024-06-28T02:45:00.971+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:45:00.971939138Z 2024-06-28T02:45:00.971944277Z 2024-06-28T02:45:00.971949413Z 2024-06-28T02:45:00.971954335Z 2024-06-28T02:45:00.979467708Z [2024-06-28T02:45:00.978+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T02:45:00.980063550Z [2024-06-28T02:45:00.979+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:45:00.980622049Z [2024-06-28T02:45:00.980+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:45:00.980974393Z [2024-06-28T02:45:00.980+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:45:00.981486882Z [2024-06-28T02:45:00.981+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:45:00.981791277Z [2024-06-28T02:45:00.981+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:45:00.983167448Z [2024-06-28T02:45:00.981+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:45:00.983649891Z [2024-06-28T02:45:00.983+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:45:01.410454895Z [2024-06-28T02:45:01.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:40:00+00:00 exited with status queued for try_number 1 2024-06-28T02:45:01.410492625Z [2024-06-28T02:45:01.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:44:00+00:00 exited with status queued for try_number 1 2024-06-28T02:45:01.414294564Z [2024-06-28T02:45:01.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:44:00+00:00 exited with status queued for try_number 1 2024-06-28T02:45:01.414319007Z [2024-06-28T02:45:01.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:44:00+00:00 exited with status queued for try_number 1 2024-06-28T02:45:01.420772014Z [2024-06-28T02:45:01.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f523be2-e4ec-43a0-86a9-2e2641f152d4 2024-06-28T02:45:01.421118292Z [2024-06-28T02:45:01.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to 194c6086-e21b-4bb1-9db5-447ae98b1631 2024-06-28T02:45:01.421373967Z [2024-06-28T02:45:01.421+0000] {scheduler_job.py:635} INFO - Setting external_id for to af94c546-478f-4fe0-a0e4-d4375a815a9d 2024-06-28T02:45:01.421605482Z [2024-06-28T02:45:01.421+0000] {scheduler_job.py:635} INFO - Setting external_id for to a66e219e-4b23-41ab-aa45-e5cb58f328d6 2024-06-28T02:45:02.631671929Z [2024-06-28T02:45:02.631+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:45:02.632049814Z [2024-06-28T02:45:02.631+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:44:00+00:00, run_id=scheduled__2024-06-28T02:44:00+00:00, run_start_date=2024-06-28 02:45:00.871758+00:00, run_end_date=2024-06-28 02:45:02.631722+00:00, run_duration=1.759964, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:44:00+00:00, data_interval_end=2024-06-28 02:45:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:45:02.645626412Z [2024-06-28T02:45:02.645+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:45:00+00:00, run_after=2024-06-28T02:46:00+00:00 2024-06-28T02:45:02.725471550Z [2024-06-28T02:45:02.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:44:00+00:00 exited with status success for try_number 1 2024-06-28T02:45:02.732914525Z [2024-06-28T02:45:02.732+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:44:00+00:00, map_index=-1, run_start_date=2024-06-28 02:45:01.956306+00:00, run_end_date=2024-06-28 02:45:02.333213+00:00, run_duration=0.376907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:45:00.973897+00:00, queued_by_job_id=2, pid=16262 2024-06-28T02:45:05.016772215Z [2024-06-28T02:45:05.016+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:45:05.016800749Z 2024-06-28T02:45:05.016922870Z [2024-06-28T02:45:05.016+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:45:05.017850813Z [2024-06-28T02:45:05.017+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:45:05.017865281Z 2024-06-28T02:45:05.024006194Z [2024-06-28T02:45:05.023+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T02:45:05.024224448Z [2024-06-28T02:45:05.023+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:45:05.231614091Z [2024-06-28T02:45:05.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:40:00+00:00 exited with status queued for try_number 1 2024-06-28T02:45:05.231646886Z [2024-06-28T02:45:05.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:40:00+00:00 exited with status success for try_number 1 2024-06-28T02:45:05.237816635Z [2024-06-28T02:45:05.237+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17fa65ef-7eb9-4e2b-aac5-1c50996cc402 2024-06-28T02:45:05.238107331Z [2024-06-28T02:45:05.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T02:40:00+00:00, map_index=-1, run_start_date=2024-06-28 02:45:03.367354+00:00, run_end_date=2024-06-28 02:45:04.302087+00:00, run_duration=0.934733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1117, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:45:00.973897+00:00, queued_by_job_id=2, pid=16286 2024-06-28T02:45:05.684217637Z [2024-06-28T02:45:05.683+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:45:05.691128494Z [2024-06-28T02:45:05.684+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:44:00+00:00, run_id=scheduled__2024-06-28T02:44:00+00:00, run_start_date=2024-06-28 02:45:00.872807+00:00, run_end_date=2024-06-28 02:45:05.684154+00:00, run_duration=4.811347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:44:00+00:00, data_interval_end=2024-06-28 02:45:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:45:05.750012497Z [2024-06-28T02:45:05.749+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:45:00+00:00, run_after=2024-06-28T02:46:00+00:00 2024-06-28T02:45:05.857153158Z [2024-06-28T02:45:05.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:44:00+00:00 exited with status success for try_number 1 2024-06-28T02:45:05.866578508Z [2024-06-28T02:45:05.866+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:44:00+00:00, map_index=-1, run_start_date=2024-06-28 02:45:03.463477+00:00, run_end_date=2024-06-28 02:45:05.357901+00:00, run_duration=1.894424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:45:00.973897+00:00, queued_by_job_id=2, pid=16288 2024-06-28T02:45:06.613965822Z [2024-06-28T02:45:06.613+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:45:06.614423400Z [2024-06-28T02:45:06.614+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:44:00+00:00, run_id=scheduled__2024-06-28T02:44:00+00:00, run_start_date=2024-06-28 02:45:00.873775+00:00, run_end_date=2024-06-28 02:45:06.613867+00:00, run_duration=5.740092, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:44:00+00:00, data_interval_end=2024-06-28 02:45:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:45:06.623271522Z [2024-06-28T02:45:06.622+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:45:00+00:00, run_after=2024-06-28T02:46:00+00:00 2024-06-28T02:45:06.666552923Z [2024-06-28T02:45:06.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:44:00+00:00 exited with status success for try_number 1 2024-06-28T02:45:06.671863794Z [2024-06-28T02:45:06.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:44:00+00:00, map_index=-1, run_start_date=2024-06-28 02:45:03.388140+00:00, run_end_date=2024-06-28 02:45:05.740947+00:00, run_duration=2.352807, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:45:00.973897+00:00, queued_by_job_id=2, pid=16287 2024-06-28T02:45:08.998391416Z [2024-06-28T02:45:08.998+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:45:08.998421174Z 2024-06-28T02:45:08.998751810Z [2024-06-28T02:45:08.998+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:45:08.999596871Z [2024-06-28T02:45:08.999+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:45:08.999607653Z 2024-06-28T02:45:09.002549978Z [2024-06-28T02:45:09.002+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T02:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T02:45:09.002781772Z [2024-06-28T02:45:09.002+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T02:45:09.062376900Z [2024-06-28T02:45:09.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:40:00+00:00 exited with status queued for try_number 1 2024-06-28T02:45:09.062843734Z [2024-06-28T02:45:09.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:40:00+00:00 exited with status success for try_number 1 2024-06-28T02:45:09.073563088Z [2024-06-28T02:45:09.073+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16c49c00-c2f8-4c77-b10a-ce7988bf825e 2024-06-28T02:45:09.074066643Z [2024-06-28T02:45:09.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T02:40:00+00:00, map_index=-1, run_start_date=2024-06-28 02:45:07.495000+00:00, run_end_date=2024-06-28 02:45:07.908944+00:00, run_duration=0.413944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1120, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:45:05.018384+00:00, queued_by_job_id=2, pid=16311 2024-06-28T02:45:11.336090554Z [2024-06-28T02:45:11.335+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:45:11.336120555Z 2024-06-28T02:45:11.336461191Z [2024-06-28T02:45:11.335+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:45:11.337007171Z [2024-06-28T02:45:11.336+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:45:11.337029460Z 2024-06-28T02:45:11.343013417Z [2024-06-28T02:45:11.342+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:45:11.343218836Z [2024-06-28T02:45:11.342+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:45:11.416398047Z [2024-06-28T02:45:11.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:40:00+00:00 exited with status queued for try_number 1 2024-06-28T02:45:11.416425999Z [2024-06-28T02:45:11.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:40:00+00:00 exited with status success for try_number 1 2024-06-28T02:45:11.432614240Z [2024-06-28T02:45:11.431+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb65ebb2-447a-4ad6-92dd-e11265de05df 2024-06-28T02:45:11.433717426Z [2024-06-28T02:45:11.432+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T02:40:00+00:00, map_index=0, run_start_date=2024-06-28 02:45:10.650222+00:00, run_end_date=2024-06-28 02:45:11.045359+00:00, run_duration=0.395137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1121, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:45:09.000180+00:00, queued_by_job_id=2, pid=16319 2024-06-28T02:45:13.965165097Z [2024-06-28T02:45:13.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:45:13.965909158Z [2024-06-28T02:45:13.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:40:00+00:00, run_id=scheduled__2024-06-28T02:40:00+00:00, run_start_date=2024-06-28 02:45:00.870323+00:00, run_end_date=2024-06-28 02:45:13.965388+00:00, run_duration=13.095065, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:40:00+00:00, data_interval_end=2024-06-28 02:45:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T02:45:13.974194587Z [2024-06-28T02:45:13.973+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:45:00+00:00, run_after=2024-06-28T02:50:00+00:00 2024-06-28T02:45:14.014800093Z [2024-06-28T02:45:14.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:40:00+00:00 exited with status success for try_number 1 2024-06-28T02:45:14.020166489Z [2024-06-28T02:45:14.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T02:40:00+00:00, map_index=-1, run_start_date=2024-06-28 02:45:13.220552+00:00, run_end_date=2024-06-28 02:45:13.651225+00:00, run_duration=0.430673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:45:11.338351+00:00, queued_by_job_id=2, pid=16327 2024-06-28T02:46:00.731899627Z [2024-06-28T02:46:00.731+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:46:00+00:00, run_after=2024-06-28T02:47:00+00:00 2024-06-28T02:46:00.742874206Z [2024-06-28T02:46:00.742+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:46:00.757690813Z [2024-06-28T02:46:00.757+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:46:00+00:00, run_after=2024-06-28T02:47:00+00:00 2024-06-28T02:46:00.767376491Z [2024-06-28T02:46:00.767+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:46:00.851822864Z [2024-06-28T02:46:00.850+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:46:00.851850524Z 2024-06-28T02:46:00.851855253Z 2024-06-28T02:46:00.851859080Z 2024-06-28T02:46:00.851862921Z 2024-06-28T02:46:00.852290928Z [2024-06-28T02:46:00.851+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:46:00.852942722Z [2024-06-28T02:46:00.852+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:46:00.853363190Z [2024-06-28T02:46:00.853+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:46:00.853745966Z [2024-06-28T02:46:00.853+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:46:00.855372699Z [2024-06-28T02:46:00.855+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:46:00.855380273Z 2024-06-28T02:46:00.855384100Z 2024-06-28T02:46:00.855387989Z 2024-06-28T02:46:00.855391773Z 2024-06-28T02:46:00.861907534Z [2024-06-28T02:46:00.861+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:46:00.862197046Z [2024-06-28T02:46:00.861+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:46:00.862635829Z [2024-06-28T02:46:00.862+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:46:00.862977612Z [2024-06-28T02:46:00.862+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:46:00.863451423Z [2024-06-28T02:46:00.863+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:46:00.863740895Z [2024-06-28T02:46:00.863+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:46:00.864153751Z [2024-06-28T02:46:00.863+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:46:00.864406140Z [2024-06-28T02:46:00.864+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:46:01.427882944Z [2024-06-28T02:46:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:44:00+00:00 exited with status queued for try_number 1 2024-06-28T02:46:01.428102331Z [2024-06-28T02:46:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:45:00+00:00 exited with status queued for try_number 1 2024-06-28T02:46:01.428335444Z [2024-06-28T02:46:01.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:45:00+00:00 exited with status queued for try_number 1 2024-06-28T02:46:01.428472664Z [2024-06-28T02:46:01.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:45:00+00:00 exited with status queued for try_number 1 2024-06-28T02:46:01.444220945Z [2024-06-28T02:46:01.443+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7eb3b1c7-2a0d-4344-a809-24f36c07aad7 2024-06-28T02:46:01.444471196Z [2024-06-28T02:46:01.444+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0894261c-fbb3-4c8d-a961-9ffe1146e87c 2024-06-28T02:46:01.444632864Z [2024-06-28T02:46:01.444+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3dcecd66-74f0-4f5f-a81d-cb2fba02d2de 2024-06-28T02:46:01.444810091Z [2024-06-28T02:46:01.444+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27029a8f-5358-48ec-9548-371417508e4b 2024-06-28T02:46:02.609014119Z [2024-06-28T02:46:02.608+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:46:02.609571473Z [2024-06-28T02:46:02.609+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:44:00+00:00, run_id=scheduled__2024-06-28T02:44:00+00:00, run_start_date=2024-06-28 02:46:00.780450+00:00, run_end_date=2024-06-28 02:46:02.608894+00:00, run_duration=1.828444, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:44:00+00:00, data_interval_end=2024-06-28 02:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:46:02.619084067Z [2024-06-28T02:46:02.618+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:46:00+00:00, run_after=2024-06-28T02:48:00+00:00 2024-06-28T02:46:02.628502306Z [2024-06-28T02:46:02.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:46:02.628894356Z [2024-06-28T02:46:02.628+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:45:00+00:00, run_id=scheduled__2024-06-28T02:45:00+00:00, run_start_date=2024-06-28 02:46:00.782142+00:00, run_end_date=2024-06-28 02:46:02.628365+00:00, run_duration=1.846223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:45:00+00:00, data_interval_end=2024-06-28 02:46:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:46:02.641899212Z [2024-06-28T02:46:02.641+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:46:00+00:00, run_after=2024-06-28T02:47:00+00:00 2024-06-28T02:46:02.726468389Z [2024-06-28T02:46:02.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:44:00+00:00 exited with status success for try_number 1 2024-06-28T02:46:02.726500015Z [2024-06-28T02:46:02.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:45:00+00:00 exited with status success for try_number 1 2024-06-28T02:46:02.739822648Z [2024-06-28T02:46:02.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:44:00+00:00, map_index=-1, run_start_date=2024-06-28 02:46:01.827925+00:00, run_end_date=2024-06-28 02:46:02.231676+00:00, run_duration=0.403751, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:46:00.857441+00:00, queued_by_job_id=2, pid=16352 2024-06-28T02:46:02.739941011Z [2024-06-28T02:46:02.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:45:00+00:00, map_index=-1, run_start_date=2024-06-28 02:46:01.756846+00:00, run_end_date=2024-06-28 02:46:02.174900+00:00, run_duration=0.418054, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:46:00.857441+00:00, queued_by_job_id=2, pid=16351 2024-06-28T02:46:03.873122926Z [2024-06-28T02:46:03.872+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:46:03.873178535Z 2024-06-28T02:46:03.873502156Z [2024-06-28T02:46:03.872+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-06-28T02:46:03.874947484Z [2024-06-28T02:46:03.874+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:46:03.874972327Z 2024-06-28T02:46:03.878739944Z [2024-06-28T02:46:03.878+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240628024602_611958', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:46:03.879167535Z [2024-06-28T02:46:03.878+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240628024602_611958', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-06-28T02:46:03.953213650Z [2024-06-28T02:46:03.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240628024602_611958 exited with status queued for try_number 1 2024-06-28T02:46:03.964435755Z [2024-06-28T02:46:03.964+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9f5311f-3912-4250-9bc0-91c187d341c5 2024-06-28T02:46:05.158986635Z [2024-06-28T02:46:05.158+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:46:05.159347238Z [2024-06-28T02:46:05.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:45:00+00:00, run_id=scheduled__2024-06-28T02:45:00+00:00, run_start_date=2024-06-28 02:46:00.783859+00:00, run_end_date=2024-06-28 02:46:05.158895+00:00, run_duration=4.375036, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:45:00+00:00, data_interval_end=2024-06-28 02:46:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:46:05.170294328Z [2024-06-28T02:46:05.169+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:46:00+00:00, run_after=2024-06-28T02:47:00+00:00 2024-06-28T02:46:05.176889977Z [2024-06-28T02:46:05.176+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:46:05.177549419Z [2024-06-28T02:46:05.177+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:45:00+00:00, run_id=scheduled__2024-06-28T02:45:00+00:00, run_start_date=2024-06-28 02:46:00.785817+00:00, run_end_date=2024-06-28 02:46:05.176811+00:00, run_duration=4.390994, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:45:00+00:00, data_interval_end=2024-06-28 02:46:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:46:05.186236894Z [2024-06-28T02:46:05.185+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:46:00+00:00, run_after=2024-06-28T02:47:00+00:00 2024-06-28T02:46:05.193258116Z [2024-06-28T02:46:05.192+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:46:05.193646693Z [2024-06-28T02:46:05.193+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-06-28 02:46:03.022429+00:00, run_id=vdu_alarm_20240628024602_611958, run_start_date=2024-06-28 02:46:03.807637+00:00, run_end_date=2024-06-28 02:46:05.193323+00:00, run_duration=1.385686, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-06-28 02:46:03.022429+00:00, data_interval_end=2024-06-28 02:46:03.022429+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-06-28T02:46:05.197454783Z [2024-06-28T02:46:05.197+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-06-28T02:46:05.241024687Z [2024-06-28T02:46:05.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:45:00+00:00 exited with status success for try_number 1 2024-06-28T02:46:05.241293429Z [2024-06-28T02:46:05.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:45:00+00:00 exited with status success for try_number 1 2024-06-28T02:46:05.256110111Z [2024-06-28T02:46:05.255+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:45:00+00:00, map_index=-1, run_start_date=2024-06-28 02:46:02.842235+00:00, run_end_date=2024-06-28 02:46:04.582752+00:00, run_duration=1.740517, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:46:00.857441+00:00, queued_by_job_id=2, pid=16375 2024-06-28T02:46:05.256479733Z [2024-06-28T02:46:05.256+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:45:00+00:00, map_index=-1, run_start_date=2024-06-28 02:46:02.898016+00:00, run_end_date=2024-06-28 02:46:04.231993+00:00, run_duration=1.333977, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:46:00.857441+00:00, queued_by_job_id=2, pid=16376 2024-06-28T02:46:05.480226288Z [2024-06-28T02:46:05.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240628024602_611958 exited with status success for try_number 1 2024-06-28T02:46:05.498897532Z [2024-06-28T02:46:05.498+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240628024602_611958, map_index=-1, run_start_date=2024-06-28 02:46:04.790365+00:00, run_end_date=2024-06-28 02:46:05.086741+00:00, run_duration=0.296376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:46:03.875853+00:00, queued_by_job_id=2, pid=16388 2024-06-28T02:46:47.783157858Z [2024-06-28T02:46:47.782+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T02:47:00.717429486Z [2024-06-28T02:47:00.716+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:47:00.738511784Z [2024-06-28T02:47:00.738+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:47:00+00:00, run_after=2024-06-28T02:48:00+00:00 2024-06-28T02:47:00.753674532Z [2024-06-28T02:47:00.753+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:47:00+00:00, run_after=2024-06-28T02:48:00+00:00 2024-06-28T02:47:00.847332210Z [2024-06-28T02:47:00.846+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:47:00.847378591Z 2024-06-28T02:47:00.847389040Z 2024-06-28T02:47:00.847448746Z 2024-06-28T02:47:00.847673299Z [2024-06-28T02:47:00.847+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:47:00.847723950Z [2024-06-28T02:47:00.847+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:47:00.847755004Z [2024-06-28T02:47:00.847+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:47:00.848064676Z [2024-06-28T02:47:00.847+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:47:00.848093657Z 2024-06-28T02:47:00.848103187Z 2024-06-28T02:47:00.848111931Z 2024-06-28T02:47:00.851449907Z [2024-06-28T02:47:00.851+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:47:00.851495553Z [2024-06-28T02:47:00.851+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:47:00.851882932Z [2024-06-28T02:47:00.851+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:47:00.852092067Z [2024-06-28T02:47:00.851+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:47:00.852291459Z [2024-06-28T02:47:00.852+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:47:00.852368869Z [2024-06-28T02:47:00.852+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:47:01.123573322Z [2024-06-28T02:47:01.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:46:00+00:00 exited with status queued for try_number 1 2024-06-28T02:47:01.123793565Z [2024-06-28T02:47:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:46:00+00:00 exited with status queued for try_number 1 2024-06-28T02:47:01.123889976Z [2024-06-28T02:47:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:46:00+00:00 exited with status queued for try_number 1 2024-06-28T02:47:01.137872335Z [2024-06-28T02:47:01.137+0000] {scheduler_job.py:635} INFO - Setting external_id for to df8394d7-091d-4fd1-ab13-233a1ac6bef6 2024-06-28T02:47:01.138145902Z [2024-06-28T02:47:01.137+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f3d2abd-c754-43cb-a507-e66648be6cc4 2024-06-28T02:47:01.138910172Z [2024-06-28T02:47:01.138+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3862b8c2-b6a4-4421-a738-3aeca020692c 2024-06-28T02:47:02.302291929Z [2024-06-28T02:47:02.301+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:47:02.302802963Z [2024-06-28T02:47:02.302+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:46:00+00:00, run_id=scheduled__2024-06-28T02:46:00+00:00, run_start_date=2024-06-28 02:47:00.768384+00:00, run_end_date=2024-06-28 02:47:02.302173+00:00, run_duration=1.533789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:46:00+00:00, data_interval_end=2024-06-28 02:47:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:47:02.313495485Z [2024-06-28T02:47:02.313+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:47:00+00:00, run_after=2024-06-28T02:48:00+00:00 2024-06-28T02:47:02.357612126Z [2024-06-28T02:47:02.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:46:00+00:00 exited with status success for try_number 1 2024-06-28T02:47:02.362376245Z [2024-06-28T02:47:02.362+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:46:00+00:00, map_index=-1, run_start_date=2024-06-28 02:47:01.681779+00:00, run_end_date=2024-06-28 02:47:02.165879+00:00, run_duration=0.4841, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:47:00.848634+00:00, queued_by_job_id=2, pid=16416 2024-06-28T02:47:05.168515353Z [2024-06-28T02:47:05.168+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:47:05.168905392Z [2024-06-28T02:47:05.168+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:46:00+00:00, run_id=scheduled__2024-06-28T02:46:00+00:00, run_start_date=2024-06-28 02:47:00.769971+00:00, run_end_date=2024-06-28 02:47:05.168591+00:00, run_duration=4.39862, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:46:00+00:00, data_interval_end=2024-06-28 02:47:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:47:05.178258971Z [2024-06-28T02:47:05.177+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:47:00+00:00, run_after=2024-06-28T02:48:00+00:00 2024-06-28T02:47:05.214283527Z [2024-06-28T02:47:05.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:46:00+00:00 exited with status success for try_number 1 2024-06-28T02:47:05.226282115Z [2024-06-28T02:47:05.225+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:46:00+00:00, map_index=-1, run_start_date=2024-06-28 02:47:02.531715+00:00, run_end_date=2024-06-28 02:47:04.314871+00:00, run_duration=1.783156, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:47:00.848634+00:00, queued_by_job_id=2, pid=16434 2024-06-28T02:47:05.775264105Z [2024-06-28T02:47:05.774+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:47:05.775726740Z [2024-06-28T02:47:05.775+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:46:00+00:00, run_id=scheduled__2024-06-28T02:46:00+00:00, run_start_date=2024-06-28 02:47:00.771373+00:00, run_end_date=2024-06-28 02:47:05.775374+00:00, run_duration=5.004001, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:46:00+00:00, data_interval_end=2024-06-28 02:47:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:47:05.786234603Z [2024-06-28T02:47:05.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:47:00+00:00, run_after=2024-06-28T02:48:00+00:00 2024-06-28T02:47:05.825080676Z [2024-06-28T02:47:05.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:46:00+00:00 exited with status success for try_number 1 2024-06-28T02:47:05.844827239Z [2024-06-28T02:47:05.844+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:46:00+00:00, map_index=-1, run_start_date=2024-06-28 02:47:02.667935+00:00, run_end_date=2024-06-28 02:47:05.412793+00:00, run_duration=2.744858, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:47:00.848634+00:00, queued_by_job_id=2, pid=16435 2024-06-28T02:48:00.713861211Z [2024-06-28T02:48:00.713+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:48:00.724132768Z [2024-06-28T02:48:00.723+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:48:00.735184779Z [2024-06-28T02:48:00.734+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:48:00+00:00, run_after=2024-06-28T02:49:00+00:00 2024-06-28T02:48:00.749338324Z [2024-06-28T02:48:00.748+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:48:00+00:00, run_after=2024-06-28T02:49:00+00:00 2024-06-28T02:48:00.817915307Z [2024-06-28T02:48:00.817+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:48:00.818025642Z 2024-06-28T02:48:00.818112440Z 2024-06-28T02:48:00.818154783Z 2024-06-28T02:48:00.818165519Z 2024-06-28T02:48:00.818195413Z [2024-06-28T02:48:00.817+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:48:00.818205051Z [2024-06-28T02:48:00.817+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:48:00.818299211Z [2024-06-28T02:48:00.818+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:48:00.818458711Z [2024-06-28T02:48:00.818+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:48:00.819447143Z [2024-06-28T02:48:00.819+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:48:00.819479677Z 2024-06-28T02:48:00.819485282Z 2024-06-28T02:48:00.819489962Z 2024-06-28T02:48:00.819494644Z 2024-06-28T02:48:00.823145028Z [2024-06-28T02:48:00.822+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:48:00.823359153Z [2024-06-28T02:48:00.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:48:00.823764589Z [2024-06-28T02:48:00.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:48:00.823961241Z [2024-06-28T02:48:00.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:48:00.824190546Z [2024-06-28T02:48:00.824+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:48:00.824467737Z [2024-06-28T02:48:00.824+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:48:00.824655121Z [2024-06-28T02:48:00.824+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:48:00.824818603Z [2024-06-28T02:48:00.824+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:48:01.122288308Z [2024-06-28T02:48:01.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:46:00+00:00 exited with status queued for try_number 1 2024-06-28T02:48:01.122727340Z [2024-06-28T02:48:01.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:47:00+00:00 exited with status queued for try_number 1 2024-06-28T02:48:01.122964310Z [2024-06-28T02:48:01.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:47:00+00:00 exited with status queued for try_number 1 2024-06-28T02:48:01.123145838Z [2024-06-28T02:48:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:47:00+00:00 exited with status queued for try_number 1 2024-06-28T02:48:01.133195162Z [2024-06-28T02:48:01.132+0000] {scheduler_job.py:635} INFO - Setting external_id for to de1d7c4c-5fcf-4ba9-90b0-08cc36a7bd09 2024-06-28T02:48:01.133506544Z [2024-06-28T02:48:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05534d74-ce03-4d34-a65c-2d650c1d9b33 2024-06-28T02:48:01.133751349Z [2024-06-28T02:48:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba265579-1062-4c0d-a055-999963d2a38b 2024-06-28T02:48:01.133967094Z [2024-06-28T02:48:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to 092710fc-5a40-45c7-8fe7-2d60a6b06ce6 2024-06-28T02:48:02.317283088Z [2024-06-28T02:48:02.314+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:48:02.318236826Z [2024-06-28T02:48:02.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:46:00+00:00, run_id=scheduled__2024-06-28T02:46:00+00:00, run_start_date=2024-06-28 02:48:00.759857+00:00, run_end_date=2024-06-28 02:48:02.317735+00:00, run_duration=1.557878, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:46:00+00:00, data_interval_end=2024-06-28 02:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:48:02.326826887Z [2024-06-28T02:48:02.326+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:48:00+00:00, run_after=2024-06-28T02:50:00+00:00 2024-06-28T02:48:02.333438732Z [2024-06-28T02:48:02.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:48:02.333939712Z [2024-06-28T02:48:02.333+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:47:00+00:00, run_id=scheduled__2024-06-28T02:47:00+00:00, run_start_date=2024-06-28 02:48:00.761134+00:00, run_end_date=2024-06-28 02:48:02.333357+00:00, run_duration=1.572223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:47:00+00:00, data_interval_end=2024-06-28 02:48:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:48:02.344027943Z [2024-06-28T02:48:02.343+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:48:00+00:00, run_after=2024-06-28T02:49:00+00:00 2024-06-28T02:48:02.388850437Z [2024-06-28T02:48:02.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:46:00+00:00 exited with status success for try_number 1 2024-06-28T02:48:02.389060101Z [2024-06-28T02:48:02.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:47:00+00:00 exited with status success for try_number 1 2024-06-28T02:48:02.396622940Z [2024-06-28T02:48:02.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:46:00+00:00, map_index=-1, run_start_date=2024-06-28 02:48:01.648348+00:00, run_end_date=2024-06-28 02:48:02.101860+00:00, run_duration=0.453512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:48:00.820410+00:00, queued_by_job_id=2, pid=16467 2024-06-28T02:48:02.396937905Z [2024-06-28T02:48:02.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:47:00+00:00, map_index=-1, run_start_date=2024-06-28 02:48:01.663870+00:00, run_end_date=2024-06-28 02:48:02.172644+00:00, run_duration=0.508774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:48:00.820410+00:00, queued_by_job_id=2, pid=16468 2024-06-28T02:48:04.738656696Z [2024-06-28T02:48:04.738+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:48:04.741326565Z [2024-06-28T02:48:04.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:47:00+00:00, run_id=scheduled__2024-06-28T02:47:00+00:00, run_start_date=2024-06-28 02:48:00.762107+00:00, run_end_date=2024-06-28 02:48:04.740941+00:00, run_duration=3.978834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:47:00+00:00, data_interval_end=2024-06-28 02:48:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:48:04.752922153Z [2024-06-28T02:48:04.751+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:48:00+00:00, run_after=2024-06-28T02:49:00+00:00 2024-06-28T02:48:04.762362973Z [2024-06-28T02:48:04.762+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:48:04.762816518Z [2024-06-28T02:48:04.762+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:47:00+00:00, run_id=scheduled__2024-06-28T02:47:00+00:00, run_start_date=2024-06-28 02:48:00.763096+00:00, run_end_date=2024-06-28 02:48:04.762436+00:00, run_duration=3.99934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:47:00+00:00, data_interval_end=2024-06-28 02:48:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:48:04.773798777Z [2024-06-28T02:48:04.773+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:48:00+00:00, run_after=2024-06-28T02:49:00+00:00 2024-06-28T02:48:04.831117553Z [2024-06-28T02:48:04.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:47:00+00:00 exited with status success for try_number 1 2024-06-28T02:48:04.831466406Z [2024-06-28T02:48:04.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:47:00+00:00 exited with status success for try_number 1 2024-06-28T02:48:04.841238046Z [2024-06-28T02:48:04.840+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:47:00+00:00, map_index=-1, run_start_date=2024-06-28 02:48:02.917225+00:00, run_end_date=2024-06-28 02:48:04.174003+00:00, run_duration=1.256778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:48:00.820410+00:00, queued_by_job_id=2, pid=16491 2024-06-28T02:48:04.841462484Z [2024-06-28T02:48:04.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:47:00+00:00, map_index=-1, run_start_date=2024-06-28 02:48:02.946387+00:00, run_end_date=2024-06-28 02:48:04.637987+00:00, run_duration=1.6916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:48:00.820410+00:00, queued_by_job_id=2, pid=16492 2024-06-28T02:49:00.563345270Z [2024-06-28T02:49:00.562+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:49:00+00:00, run_after=2024-06-28T02:50:00+00:00 2024-06-28T02:49:00.581248156Z [2024-06-28T02:49:00.580+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:49:00+00:00, run_after=2024-06-28T02:50:00+00:00 2024-06-28T02:49:00.589835375Z [2024-06-28T02:49:00.589+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:49:00.696071938Z [2024-06-28T02:49:00.695+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:49:00.696116223Z 2024-06-28T02:49:00.696125723Z 2024-06-28T02:49:00.696133049Z 2024-06-28T02:49:00.696231047Z [2024-06-28T02:49:00.695+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:49:00.696377130Z [2024-06-28T02:49:00.696+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:49:00.696519132Z [2024-06-28T02:49:00.696+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:49:00.697298578Z [2024-06-28T02:49:00.697+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:49:00.697313096Z 2024-06-28T02:49:00.697317017Z 2024-06-28T02:49:00.697320242Z 2024-06-28T02:49:00.701844409Z [2024-06-28T02:49:00.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:49:00.701880197Z [2024-06-28T02:49:00.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:49:00.701986292Z [2024-06-28T02:49:00.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:49:00.702072150Z [2024-06-28T02:49:00.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:49:00.702284251Z [2024-06-28T02:49:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:49:00.702333441Z [2024-06-28T02:49:00.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:49:00.934154088Z [2024-06-28T02:49:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:48:00+00:00 exited with status queued for try_number 1 2024-06-28T02:49:00.934345189Z [2024-06-28T02:49:00.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:48:00+00:00 exited with status queued for try_number 1 2024-06-28T02:49:00.934554963Z [2024-06-28T02:49:00.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:48:00+00:00 exited with status queued for try_number 1 2024-06-28T02:49:00.949923462Z [2024-06-28T02:49:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62c0f78d-0158-4932-b56d-b1e7d80a010b 2024-06-28T02:49:00.950348990Z [2024-06-28T02:49:00.950+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39e43a84-02da-4129-8f53-18b846a84b06 2024-06-28T02:49:00.950884801Z [2024-06-28T02:49:00.950+0000] {scheduler_job.py:635} INFO - Setting external_id for to c64c832e-96ba-47f4-8d4d-5b8f7b2f0ad4 2024-06-28T02:49:02.144640919Z [2024-06-28T02:49:02.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:49:02.144856338Z [2024-06-28T02:49:02.144+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:48:00+00:00, run_id=scheduled__2024-06-28T02:48:00+00:00, run_start_date=2024-06-28 02:49:00.604075+00:00, run_end_date=2024-06-28 02:49:02.144535+00:00, run_duration=1.54046, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:48:00+00:00, data_interval_end=2024-06-28 02:49:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:49:02.154556228Z [2024-06-28T02:49:02.154+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:49:00+00:00, run_after=2024-06-28T02:50:00+00:00 2024-06-28T02:49:02.214103999Z [2024-06-28T02:49:02.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:48:00+00:00 exited with status success for try_number 1 2024-06-28T02:49:02.220162275Z [2024-06-28T02:49:02.219+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:48:00+00:00, map_index=-1, run_start_date=2024-06-28 02:49:01.522943+00:00, run_end_date=2024-06-28 02:49:01.947391+00:00, run_duration=0.424448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:49:00.698235+00:00, queued_by_job_id=2, pid=16525 2024-06-28T02:49:04.231531975Z [2024-06-28T02:49:04.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:49:04.232128489Z [2024-06-28T02:49:04.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:48:00+00:00, run_id=scheduled__2024-06-28T02:48:00+00:00, run_start_date=2024-06-28 02:49:00.605348+00:00, run_end_date=2024-06-28 02:49:04.231404+00:00, run_duration=3.626056, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:48:00+00:00, data_interval_end=2024-06-28 02:49:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:49:04.243374372Z [2024-06-28T02:49:04.243+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:49:00+00:00, run_after=2024-06-28T02:50:00+00:00 2024-06-28T02:49:04.283824491Z [2024-06-28T02:49:04.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:48:00+00:00 exited with status success for try_number 1 2024-06-28T02:49:04.288664594Z [2024-06-28T02:49:04.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:48:00+00:00, map_index=-1, run_start_date=2024-06-28 02:49:02.535239+00:00, run_end_date=2024-06-28 02:49:03.973113+00:00, run_duration=1.437874, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:49:00.698235+00:00, queued_by_job_id=2, pid=16544 2024-06-28T02:49:05.338403008Z [2024-06-28T02:49:05.338+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:49:05.338625825Z [2024-06-28T02:49:05.338+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:48:00+00:00, run_id=scheduled__2024-06-28T02:48:00+00:00, run_start_date=2024-06-28 02:49:00.606421+00:00, run_end_date=2024-06-28 02:49:05.338308+00:00, run_duration=4.731887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:48:00+00:00, data_interval_end=2024-06-28 02:49:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:49:05.352516441Z [2024-06-28T02:49:05.352+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:49:00+00:00, run_after=2024-06-28T02:50:00+00:00 2024-06-28T02:49:05.391602481Z [2024-06-28T02:49:05.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:48:00+00:00 exited with status success for try_number 1 2024-06-28T02:49:05.397902241Z [2024-06-28T02:49:05.397+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:48:00+00:00, map_index=-1, run_start_date=2024-06-28 02:49:02.401855+00:00, run_end_date=2024-06-28 02:49:04.404497+00:00, run_duration=2.002642, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:49:00.698235+00:00, queued_by_job_id=2, pid=16543 2024-06-28T02:50:00.865482405Z [2024-06-28T02:50:00.864+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:50:00+00:00, run_after=2024-06-28T02:51:00+00:00 2024-06-28T02:50:00.886003180Z [2024-06-28T02:50:00.885+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:50:00+00:00, run_after=2024-06-28T02:55:00+00:00 2024-06-28T02:50:00.902861009Z [2024-06-28T02:50:00.902+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:50:00.914776968Z [2024-06-28T02:50:00.914+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:50:00.932097662Z [2024-06-28T02:50:00.931+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:50:00+00:00, run_after=2024-06-28T02:51:00+00:00 2024-06-28T02:50:01.044228145Z [2024-06-28T02:50:01.043+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-28T02:50:01.044267187Z 2024-06-28T02:50:01.044275844Z 2024-06-28T02:50:01.044283723Z 2024-06-28T02:50:01.044290962Z 2024-06-28T02:50:01.044298236Z 2024-06-28T02:50:01.058337689Z [2024-06-28T02:50:01.057+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:50:01.058407760Z [2024-06-28T02:50:01.057+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:50:01.058453261Z [2024-06-28T02:50:01.058+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:50:01.058650061Z [2024-06-28T02:50:01.058+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:50:01.058840753Z [2024-06-28T02:50:01.058+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:50:01.059818437Z [2024-06-28T02:50:01.059+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:50:01.059831096Z 2024-06-28T02:50:01.059835513Z 2024-06-28T02:50:01.059853055Z 2024-06-28T02:50:01.059856303Z 2024-06-28T02:50:01.059859337Z 2024-06-28T02:50:01.064800302Z [2024-06-28T02:50:01.064+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T02:50:01.064824018Z [2024-06-28T02:50:01.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:50:01.065022030Z [2024-06-28T02:50:01.064+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:50:01.065052029Z [2024-06-28T02:50:01.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:50:01.065234485Z [2024-06-28T02:50:01.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:50:01.065288440Z [2024-06-28T02:50:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:50:01.065488626Z [2024-06-28T02:50:01.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:50:01.065499196Z [2024-06-28T02:50:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:50:01.065683451Z [2024-06-28T02:50:01.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:50:01.065710048Z [2024-06-28T02:50:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:50:01.667942856Z [2024-06-28T02:50:01.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:45:00+00:00 exited with status queued for try_number 1 2024-06-28T02:50:01.668148169Z [2024-06-28T02:50:01.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:48:00+00:00 exited with status queued for try_number 1 2024-06-28T02:50:01.668278028Z [2024-06-28T02:50:01.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:49:00+00:00 exited with status queued for try_number 1 2024-06-28T02:50:01.668399873Z [2024-06-28T02:50:01.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:49:00+00:00 exited with status queued for try_number 1 2024-06-28T02:50:01.668489306Z [2024-06-28T02:50:01.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:49:00+00:00 exited with status queued for try_number 1 2024-06-28T02:50:01.688595064Z [2024-06-28T02:50:01.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d70473e-9772-40c0-9974-53e5099635ba 2024-06-28T02:50:01.688903297Z [2024-06-28T02:50:01.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32ced559-9303-456a-816a-7eb934670442 2024-06-28T02:50:01.689063714Z [2024-06-28T02:50:01.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2940ec83-b399-462c-92a7-927f4c610f94 2024-06-28T02:50:01.689233542Z [2024-06-28T02:50:01.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ebc4130-ef65-45eb-b63b-151207aaf691 2024-06-28T02:50:01.689466731Z [2024-06-28T02:50:01.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to 147d9008-ed6f-4d4a-b776-d90e51d00316 2024-06-28T02:50:03.028191400Z [2024-06-28T02:50:03.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:50:03.028364947Z [2024-06-28T02:50:03.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:48:00+00:00, run_id=scheduled__2024-06-28T02:48:00+00:00, run_start_date=2024-06-28 02:50:00.945328+00:00, run_end_date=2024-06-28 02:50:03.028063+00:00, run_duration=2.082735, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:48:00+00:00, data_interval_end=2024-06-28 02:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:50:03.037008794Z [2024-06-28T02:50:03.036+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:50:00+00:00, run_after=2024-06-28T02:52:00+00:00 2024-06-28T02:50:03.044341839Z [2024-06-28T02:50:03.043+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:50:03.044483055Z [2024-06-28T02:50:03.044+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:49:00+00:00, run_id=scheduled__2024-06-28T02:49:00+00:00, run_start_date=2024-06-28 02:50:00.946379+00:00, run_end_date=2024-06-28 02:50:03.044233+00:00, run_duration=2.097854, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:49:00+00:00, data_interval_end=2024-06-28 02:50:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:50:03.054992374Z [2024-06-28T02:50:03.054+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:50:00+00:00, run_after=2024-06-28T02:51:00+00:00 2024-06-28T02:50:03.105091013Z [2024-06-28T02:50:03.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:48:00+00:00 exited with status success for try_number 1 2024-06-28T02:50:03.105118410Z [2024-06-28T02:50:03.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:49:00+00:00 exited with status success for try_number 1 2024-06-28T02:50:03.318676838Z [2024-06-28T02:50:03.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:49:00+00:00, map_index=-1, run_start_date=2024-06-28 02:50:02.108972+00:00, run_end_date=2024-06-28 02:50:02.470799+00:00, run_duration=0.361827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:50:01.061122+00:00, queued_by_job_id=2, pid=16578 2024-06-28T02:50:03.318822193Z [2024-06-28T02:50:03.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:48:00+00:00, map_index=-1, run_start_date=2024-06-28 02:50:02.461968+00:00, run_end_date=2024-06-28 02:50:02.884209+00:00, run_duration=0.422241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:50:01.061122+00:00, queued_by_job_id=2, pid=16584 2024-06-28T02:50:04.406558997Z [2024-06-28T02:50:04.406+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:50:04.406586068Z 2024-06-28T02:50:04.406781202Z [2024-06-28T02:50:04.406+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:50:04.407327993Z [2024-06-28T02:50:04.407+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:50:04.407341804Z 2024-06-28T02:50:04.409578806Z [2024-06-28T02:50:04.409+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T02:50:04.409729293Z [2024-06-28T02:50:04.409+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:50:04.478038326Z [2024-06-28T02:50:04.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:45:00+00:00 exited with status queued for try_number 1 2024-06-28T02:50:04.494365230Z [2024-06-28T02:50:04.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18b46407-18b1-46b5-bae0-70921b27d316 2024-06-28T02:50:04.700476867Z [2024-06-28T02:50:04.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:45:00+00:00 exited with status success for try_number 1 2024-06-28T02:50:04.707288274Z [2024-06-28T02:50:04.706+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T02:45:00+00:00, map_index=-1, run_start_date=2024-06-28 02:50:03.819944+00:00, run_end_date=2024-06-28 02:50:04.311782+00:00, run_duration=0.491838, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1142, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:50:01.061122+00:00, queued_by_job_id=2, pid=16620 2024-06-28T02:50:05.794423212Z [2024-06-28T02:50:05.794+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:50:05.794621120Z [2024-06-28T02:50:05.794+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:49:00+00:00, run_id=scheduled__2024-06-28T02:49:00+00:00, run_start_date=2024-06-28 02:50:00.947367+00:00, run_end_date=2024-06-28 02:50:05.794338+00:00, run_duration=4.846971, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:49:00+00:00, data_interval_end=2024-06-28 02:50:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:50:05.803134757Z [2024-06-28T02:50:05.802+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:50:00+00:00, run_after=2024-06-28T02:51:00+00:00 2024-06-28T02:50:05.809698642Z [2024-06-28T02:50:05.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:50:05.809816428Z [2024-06-28T02:50:05.809+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:49:00+00:00, run_id=scheduled__2024-06-28T02:49:00+00:00, run_start_date=2024-06-28 02:50:00.948410+00:00, run_end_date=2024-06-28 02:50:05.809594+00:00, run_duration=4.861184, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:49:00+00:00, data_interval_end=2024-06-28 02:50:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:50:05.820300532Z [2024-06-28T02:50:05.819+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:50:00+00:00, run_after=2024-06-28T02:51:00+00:00 2024-06-28T02:50:05.869157441Z [2024-06-28T02:50:05.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:49:00+00:00 exited with status success for try_number 1 2024-06-28T02:50:05.869406255Z [2024-06-28T02:50:05.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:49:00+00:00 exited with status success for try_number 1 2024-06-28T02:50:05.876626201Z [2024-06-28T02:50:05.876+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:49:00+00:00, map_index=-1, run_start_date=2024-06-28 02:50:03.424682+00:00, run_end_date=2024-06-28 02:50:04.875573+00:00, run_duration=1.450891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:50:01.061122+00:00, queued_by_job_id=2, pid=16603 2024-06-28T02:50:05.877088947Z [2024-06-28T02:50:05.876+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:49:00+00:00, map_index=-1, run_start_date=2024-06-28 02:50:03.443934+00:00, run_end_date=2024-06-28 02:50:05.137113+00:00, run_duration=1.693179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:50:01.061122+00:00, queued_by_job_id=2, pid=16604 2024-06-28T02:50:07.058969776Z [2024-06-28T02:50:07.058+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:50:07.059004495Z 2024-06-28T02:50:07.059186913Z [2024-06-28T02:50:07.058+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:50:07.059997813Z [2024-06-28T02:50:07.059+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:50:07.060014305Z 2024-06-28T02:50:07.062631101Z [2024-06-28T02:50:07.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T02:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T02:50:07.062825384Z [2024-06-28T02:50:07.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T02:50:07.109974027Z [2024-06-28T02:50:07.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:45:00+00:00 exited with status queued for try_number 1 2024-06-28T02:50:07.110329678Z [2024-06-28T02:50:07.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:45:00+00:00 exited with status success for try_number 1 2024-06-28T02:50:07.121223964Z [2024-06-28T02:50:07.120+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1142588-b0e7-45f0-96f0-ac740b662f83 2024-06-28T02:50:07.121681335Z [2024-06-28T02:50:07.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T02:45:00+00:00, map_index=-1, run_start_date=2024-06-28 02:50:06.458607+00:00, run_end_date=2024-06-28 02:50:06.824045+00:00, run_duration=0.365438, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1143, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:50:04.407726+00:00, queued_by_job_id=2, pid=16633 2024-06-28T02:50:09.991436803Z [2024-06-28T02:50:09.990+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:50:09.991482309Z 2024-06-28T02:50:09.991733243Z [2024-06-28T02:50:09.991+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:50:09.992819662Z [2024-06-28T02:50:09.992+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:50:09.992836430Z 2024-06-28T02:50:09.996445908Z [2024-06-28T02:50:09.996+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:50:09.996796495Z [2024-06-28T02:50:09.996+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:50:10.075955109Z [2024-06-28T02:50:10.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:45:00+00:00 exited with status queued for try_number 1 2024-06-28T02:50:10.076166020Z [2024-06-28T02:50:10.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:45:00+00:00 exited with status success for try_number 1 2024-06-28T02:50:10.089767888Z [2024-06-28T02:50:10.089+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74ee4068-dccb-41f0-a647-ea7dc3318eff 2024-06-28T02:50:10.090108589Z [2024-06-28T02:50:10.089+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T02:45:00+00:00, map_index=0, run_start_date=2024-06-28 02:50:08.601746+00:00, run_end_date=2024-06-28 02:50:08.996825+00:00, run_duration=0.395079, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1144, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:50:07.060451+00:00, queued_by_job_id=2, pid=16641 2024-06-28T02:50:12.213415260Z [2024-06-28T02:50:12.213+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:50:12.213883048Z [2024-06-28T02:50:12.213+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:45:00+00:00, run_id=scheduled__2024-06-28T02:45:00+00:00, run_start_date=2024-06-28 02:50:00.944132+00:00, run_end_date=2024-06-28 02:50:12.213529+00:00, run_duration=11.269397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:45:00+00:00, data_interval_end=2024-06-28 02:50:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T02:50:12.221610760Z [2024-06-28T02:50:12.221+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:50:00+00:00, run_after=2024-06-28T02:55:00+00:00 2024-06-28T02:50:12.267823836Z [2024-06-28T02:50:12.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:45:00+00:00 exited with status success for try_number 1 2024-06-28T02:50:12.274942558Z [2024-06-28T02:50:12.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T02:45:00+00:00, map_index=-1, run_start_date=2024-06-28 02:50:11.576463+00:00, run_end_date=2024-06-28 02:50:11.953430+00:00, run_duration=0.376967, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:50:09.993496+00:00, queued_by_job_id=2, pid=16649 2024-06-28T02:51:00.247655973Z [2024-06-28T02:51:00.247+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:51:00+00:00, run_after=2024-06-28T02:52:00+00:00 2024-06-28T02:51:00.259268287Z [2024-06-28T02:51:00.258+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:51:00.283977997Z [2024-06-28T02:51:00.283+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:51:00+00:00, run_after=2024-06-28T02:52:00+00:00 2024-06-28T02:51:00.364948817Z [2024-06-28T02:51:00.364+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:51:00.365026397Z 2024-06-28T02:51:00.365067989Z 2024-06-28T02:51:00.365077643Z 2024-06-28T02:51:00.365166641Z [2024-06-28T02:51:00.364+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:51:00.365252702Z [2024-06-28T02:51:00.364+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:51:00.365328899Z [2024-06-28T02:51:00.365+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:51:00.366232204Z [2024-06-28T02:51:00.365+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:51:00.366250124Z 2024-06-28T02:51:00.366255792Z 2024-06-28T02:51:00.366260936Z 2024-06-28T02:51:00.371134620Z [2024-06-28T02:51:00.370+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:51:00.371428955Z [2024-06-28T02:51:00.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:51:00.371944122Z [2024-06-28T02:51:00.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:51:00.372197981Z [2024-06-28T02:51:00.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:51:00.372514429Z [2024-06-28T02:51:00.372+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:51:00.372761158Z [2024-06-28T02:51:00.372+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:51:00.623751270Z [2024-06-28T02:51:00.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:50:00+00:00 exited with status queued for try_number 1 2024-06-28T02:51:00.624050384Z [2024-06-28T02:51:00.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:50:00+00:00 exited with status queued for try_number 1 2024-06-28T02:51:00.624339489Z [2024-06-28T02:51:00.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:50:00+00:00 exited with status queued for try_number 1 2024-06-28T02:51:00.635963415Z [2024-06-28T02:51:00.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23dff6cb-597e-49eb-9b3f-69268e72aa9c 2024-06-28T02:51:00.636213747Z [2024-06-28T02:51:00.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90953282-48d5-4d8f-95cb-8174e8c6e8d1 2024-06-28T02:51:00.636484712Z [2024-06-28T02:51:00.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5cfa2401-00f5-4ea1-b8bf-e60cac66a391 2024-06-28T02:51:02.922037111Z [2024-06-28T02:51:02.921+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:51:02.922503022Z [2024-06-28T02:51:02.922+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:50:00+00:00, run_id=scheduled__2024-06-28T02:50:00+00:00, run_start_date=2024-06-28 02:51:00.298835+00:00, run_end_date=2024-06-28 02:51:02.921890+00:00, run_duration=2.623055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:50:00+00:00, data_interval_end=2024-06-28 02:51:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:51:02.933239010Z [2024-06-28T02:51:02.932+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:51:00+00:00, run_after=2024-06-28T02:52:00+00:00 2024-06-28T02:51:02.994068905Z [2024-06-28T02:51:02.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:50:00+00:00 exited with status success for try_number 1 2024-06-28T02:51:03.003795046Z [2024-06-28T02:51:03.003+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:50:00+00:00, map_index=-1, run_start_date=2024-06-28 02:51:01.404357+00:00, run_end_date=2024-06-28 02:51:01.861685+00:00, run_duration=0.457328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:51:00.367360+00:00, queued_by_job_id=2, pid=16672 2024-06-28T02:51:04.174604275Z [2024-06-28T02:51:04.174+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:51:04.174967277Z [2024-06-28T02:51:04.174+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:50:00+00:00, run_id=scheduled__2024-06-28T02:50:00+00:00, run_start_date=2024-06-28 02:51:00.301555+00:00, run_end_date=2024-06-28 02:51:04.174617+00:00, run_duration=3.873062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:50:00+00:00, data_interval_end=2024-06-28 02:51:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:51:04.184924390Z [2024-06-28T02:51:04.184+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:51:00+00:00, run_after=2024-06-28T02:52:00+00:00 2024-06-28T02:51:04.193876032Z [2024-06-28T02:51:04.193+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:51:04.194183599Z [2024-06-28T02:51:04.193+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:50:00+00:00, run_id=scheduled__2024-06-28T02:50:00+00:00, run_start_date=2024-06-28 02:51:00.303832+00:00, run_end_date=2024-06-28 02:51:04.193786+00:00, run_duration=3.889954, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:50:00+00:00, data_interval_end=2024-06-28 02:51:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:51:04.204801703Z [2024-06-28T02:51:04.204+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:51:00+00:00, run_after=2024-06-28T02:52:00+00:00 2024-06-28T02:51:04.237724798Z [2024-06-28T02:51:04.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:50:00+00:00 exited with status success for try_number 1 2024-06-28T02:51:04.237784928Z [2024-06-28T02:51:04.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:50:00+00:00 exited with status success for try_number 1 2024-06-28T02:51:04.245308479Z [2024-06-28T02:51:04.244+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:50:00+00:00, map_index=-1, run_start_date=2024-06-28 02:51:02.462914+00:00, run_end_date=2024-06-28 02:51:03.739309+00:00, run_duration=1.276395, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:51:00.367360+00:00, queued_by_job_id=2, pid=16690 2024-06-28T02:51:04.245366129Z [2024-06-28T02:51:04.245+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:50:00+00:00, map_index=-1, run_start_date=2024-06-28 02:51:02.315307+00:00, run_end_date=2024-06-28 02:51:03.941867+00:00, run_duration=1.62656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:51:00.367360+00:00, queued_by_job_id=2, pid=16689 2024-06-28T02:51:47.832323842Z [2024-06-28T02:51:47.830+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T02:52:00.750596355Z [2024-06-28T02:52:00.750+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:52:00+00:00, run_after=2024-06-28T02:53:00+00:00 2024-06-28T02:52:00.763832183Z [2024-06-28T02:52:00.763+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:52:00.773105720Z [2024-06-28T02:52:00.772+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:52:00.788624701Z [2024-06-28T02:52:00.788+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:52:00+00:00, run_after=2024-06-28T02:53:00+00:00 2024-06-28T02:52:00.891005205Z [2024-06-28T02:52:00.890+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:52:00.891034997Z 2024-06-28T02:52:00.891040265Z 2024-06-28T02:52:00.891044617Z 2024-06-28T02:52:00.891049073Z 2024-06-28T02:52:00.891427128Z [2024-06-28T02:52:00.890+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:52:00.891859001Z [2024-06-28T02:52:00.891+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:52:00.892150351Z [2024-06-28T02:52:00.891+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:52:00.892442981Z [2024-06-28T02:52:00.892+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:52:00.893332044Z [2024-06-28T02:52:00.893+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:52:00.893346827Z 2024-06-28T02:52:00.893351537Z 2024-06-28T02:52:00.893355750Z 2024-06-28T02:52:00.893359856Z 2024-06-28T02:52:00.898278929Z [2024-06-28T02:52:00.897+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:52:00.898599668Z [2024-06-28T02:52:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:52:00.899034365Z [2024-06-28T02:52:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:52:00.899265494Z [2024-06-28T02:52:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:52:00.899720766Z [2024-06-28T02:52:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:52:00.899952099Z [2024-06-28T02:52:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:52:00.900305678Z [2024-06-28T02:52:00.900+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:52:00.900524865Z [2024-06-28T02:52:00.900+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:52:01.343832010Z [2024-06-28T02:52:01.343+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:50:00+00:00 exited with status queued for try_number 1 2024-06-28T02:52:01.345520309Z [2024-06-28T02:52:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:51:00+00:00 exited with status queued for try_number 1 2024-06-28T02:52:01.345627763Z [2024-06-28T02:52:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:51:00+00:00 exited with status queued for try_number 1 2024-06-28T02:52:01.345734524Z [2024-06-28T02:52:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:51:00+00:00 exited with status queued for try_number 1 2024-06-28T02:52:01.372182845Z [2024-06-28T02:52:01.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to c28baaad-083a-41ba-a032-7c8f8ac8a0fd 2024-06-28T02:52:01.372371671Z [2024-06-28T02:52:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6a0a820-bfca-4162-aa2c-179287bb8f3b 2024-06-28T02:52:01.372515759Z [2024-06-28T02:52:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2b7c030-0f11-4a61-a87b-4d5f8a635bf9 2024-06-28T02:52:01.372657612Z [2024-06-28T02:52:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c556703-6c0a-4caf-906a-4ee247285591 2024-06-28T02:52:02.698534832Z [2024-06-28T02:52:02.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:52:02.699597063Z [2024-06-28T02:52:02.699+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:50:00+00:00, run_id=scheduled__2024-06-28T02:50:00+00:00, run_start_date=2024-06-28 02:52:00.804129+00:00, run_end_date=2024-06-28 02:52:02.698465+00:00, run_duration=1.894336, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:50:00+00:00, data_interval_end=2024-06-28 02:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:52:02.709106363Z [2024-06-28T02:52:02.708+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:52:00+00:00, run_after=2024-06-28T02:54:00+00:00 2024-06-28T02:52:02.717320825Z [2024-06-28T02:52:02.716+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:52:02.717503644Z [2024-06-28T02:52:02.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:51:00+00:00, run_id=scheduled__2024-06-28T02:51:00+00:00, run_start_date=2024-06-28 02:52:00.805499+00:00, run_end_date=2024-06-28 02:52:02.717235+00:00, run_duration=1.911736, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:51:00+00:00, data_interval_end=2024-06-28 02:52:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:52:02.735290372Z [2024-06-28T02:52:02.734+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:52:00+00:00, run_after=2024-06-28T02:53:00+00:00 2024-06-28T02:52:02.784799650Z [2024-06-28T02:52:02.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:50:00+00:00 exited with status success for try_number 1 2024-06-28T02:52:02.785094299Z [2024-06-28T02:52:02.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:51:00+00:00 exited with status success for try_number 1 2024-06-28T02:52:02.792537408Z [2024-06-28T02:52:02.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:50:00+00:00, map_index=-1, run_start_date=2024-06-28 02:52:01.862669+00:00, run_end_date=2024-06-28 02:52:02.222455+00:00, run_duration=0.359786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:52:00.894471+00:00, queued_by_job_id=2, pid=16723 2024-06-28T02:52:02.792814831Z [2024-06-28T02:52:02.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:51:00+00:00, map_index=-1, run_start_date=2024-06-28 02:52:01.871240+00:00, run_end_date=2024-06-28 02:52:02.330462+00:00, run_duration=0.459222, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:52:00.894471+00:00, queued_by_job_id=2, pid=16724 2024-06-28T02:52:05.745517634Z [2024-06-28T02:52:05.745+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:52:05.745677873Z [2024-06-28T02:52:05.745+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:51:00+00:00, run_id=scheduled__2024-06-28T02:51:00+00:00, run_start_date=2024-06-28 02:52:00.807815+00:00, run_end_date=2024-06-28 02:52:05.745427+00:00, run_duration=4.937612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:51:00+00:00, data_interval_end=2024-06-28 02:52:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:52:05.759510211Z [2024-06-28T02:52:05.759+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:52:00+00:00, run_after=2024-06-28T02:53:00+00:00 2024-06-28T02:52:05.825975591Z [2024-06-28T02:52:05.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:51:00+00:00 exited with status success for try_number 1 2024-06-28T02:52:05.847540762Z [2024-06-28T02:52:05.845+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:51:00+00:00, map_index=-1, run_start_date=2024-06-28 02:52:02.914923+00:00, run_end_date=2024-06-28 02:52:05.152799+00:00, run_duration=2.237876, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:52:00.894471+00:00, queued_by_job_id=2, pid=16747 2024-06-28T02:52:06.899614160Z [2024-06-28T02:52:06.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:52:06.899704760Z [2024-06-28T02:52:06.899+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:51:00+00:00, run_id=scheduled__2024-06-28T02:51:00+00:00, run_start_date=2024-06-28 02:52:00.806651+00:00, run_end_date=2024-06-28 02:52:06.899417+00:00, run_duration=6.092766, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:51:00+00:00, data_interval_end=2024-06-28 02:52:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:52:06.908379937Z [2024-06-28T02:52:06.908+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:52:00+00:00, run_after=2024-06-28T02:53:00+00:00 2024-06-28T02:52:06.943264211Z [2024-06-28T02:52:06.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:51:00+00:00 exited with status success for try_number 1 2024-06-28T02:52:06.950817287Z [2024-06-28T02:52:06.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:51:00+00:00, map_index=-1, run_start_date=2024-06-28 02:52:02.939729+00:00, run_end_date=2024-06-28 02:52:05.800431+00:00, run_duration=2.860702, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1152, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:52:00.894471+00:00, queued_by_job_id=2, pid=16748 2024-06-28T02:53:00.535763523Z [2024-06-28T02:53:00.535+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:53:00+00:00, run_after=2024-06-28T02:54:00+00:00 2024-06-28T02:53:00.555850235Z [2024-06-28T02:53:00.555+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:53:00+00:00, run_after=2024-06-28T02:54:00+00:00 2024-06-28T02:53:00.563025412Z [2024-06-28T02:53:00.562+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:53:00.643852394Z [2024-06-28T02:53:00.643+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:53:00.643905108Z 2024-06-28T02:53:00.643915068Z 2024-06-28T02:53:00.643923710Z 2024-06-28T02:53:00.643948400Z [2024-06-28T02:53:00.643+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:53:00.644088026Z [2024-06-28T02:53:00.643+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:53:00.644383857Z [2024-06-28T02:53:00.644+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:53:00.644936482Z [2024-06-28T02:53:00.644+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:53:00.644950661Z 2024-06-28T02:53:00.644959931Z 2024-06-28T02:53:00.644968266Z 2024-06-28T02:53:00.648257765Z [2024-06-28T02:53:00.647+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:53:00.648368617Z [2024-06-28T02:53:00.648+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:53:00.648693653Z [2024-06-28T02:53:00.648+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:53:00.648840296Z [2024-06-28T02:53:00.648+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:53:00.649051857Z [2024-06-28T02:53:00.648+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:53:00.649183901Z [2024-06-28T02:53:00.649+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:53:00.877345179Z [2024-06-28T02:53:00.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:52:00+00:00 exited with status queued for try_number 1 2024-06-28T02:53:00.877445575Z [2024-06-28T02:53:00.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:52:00+00:00 exited with status queued for try_number 1 2024-06-28T02:53:00.877585137Z [2024-06-28T02:53:00.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:52:00+00:00 exited with status queued for try_number 1 2024-06-28T02:53:00.886202787Z [2024-06-28T02:53:00.885+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5612ab66-c908-49a3-b574-9e98fe7ec675 2024-06-28T02:53:00.886556421Z [2024-06-28T02:53:00.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9052649-48d0-4d26-b5b4-0e170cd57609 2024-06-28T02:53:00.886564328Z [2024-06-28T02:53:00.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d9c2a21-b0df-4210-b498-34f29a4c0b36 2024-06-28T02:53:02.136529698Z [2024-06-28T02:53:02.136+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:53:02.136904234Z [2024-06-28T02:53:02.136+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:52:00+00:00, run_id=scheduled__2024-06-28T02:52:00+00:00, run_start_date=2024-06-28 02:53:00.573890+00:00, run_end_date=2024-06-28 02:53:02.136515+00:00, run_duration=1.562625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:52:00+00:00, data_interval_end=2024-06-28 02:53:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:53:02.147214417Z [2024-06-28T02:53:02.146+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:53:00+00:00, run_after=2024-06-28T02:54:00+00:00 2024-06-28T02:53:02.207700887Z [2024-06-28T02:53:02.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:52:00+00:00 exited with status success for try_number 1 2024-06-28T02:53:02.217263821Z [2024-06-28T02:53:02.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:52:00+00:00, map_index=-1, run_start_date=2024-06-28 02:53:01.544517+00:00, run_end_date=2024-06-28 02:53:01.915782+00:00, run_duration=0.371265, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:53:00.645522+00:00, queued_by_job_id=2, pid=16780 2024-06-28T02:53:04.397398269Z [2024-06-28T02:53:04.397+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:53:04.397635596Z [2024-06-28T02:53:04.397+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:52:00+00:00, run_id=scheduled__2024-06-28T02:52:00+00:00, run_start_date=2024-06-28 02:53:00.575181+00:00, run_end_date=2024-06-28 02:53:04.397303+00:00, run_duration=3.822122, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:52:00+00:00, data_interval_end=2024-06-28 02:53:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:53:04.407658240Z [2024-06-28T02:53:04.407+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:53:00+00:00, run_after=2024-06-28T02:54:00+00:00 2024-06-28T02:53:04.415214604Z [2024-06-28T02:53:04.414+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:53:04.415739853Z [2024-06-28T02:53:04.415+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:52:00+00:00, run_id=scheduled__2024-06-28T02:52:00+00:00, run_start_date=2024-06-28 02:53:00.576812+00:00, run_end_date=2024-06-28 02:53:04.415154+00:00, run_duration=3.838342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:52:00+00:00, data_interval_end=2024-06-28 02:53:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:53:04.443051521Z [2024-06-28T02:53:04.442+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:53:00+00:00, run_after=2024-06-28T02:54:00+00:00 2024-06-28T02:53:04.480700855Z [2024-06-28T02:53:04.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:52:00+00:00 exited with status success for try_number 1 2024-06-28T02:53:04.480801084Z [2024-06-28T02:53:04.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:52:00+00:00 exited with status success for try_number 1 2024-06-28T02:53:04.492965467Z [2024-06-28T02:53:04.491+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:52:00+00:00, map_index=-1, run_start_date=2024-06-28 02:53:02.418675+00:00, run_end_date=2024-06-28 02:53:03.740913+00:00, run_duration=1.322238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1154, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:53:00.645522+00:00, queued_by_job_id=2, pid=16798 2024-06-28T02:53:04.493266219Z [2024-06-28T02:53:04.493+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:52:00+00:00, map_index=-1, run_start_date=2024-06-28 02:53:02.476838+00:00, run_end_date=2024-06-28 02:53:04.029148+00:00, run_duration=1.55231, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1155, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:53:00.645522+00:00, queued_by_job_id=2, pid=16799 2024-06-28T02:54:00.396551939Z [2024-06-28T02:54:00.396+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:54:00+00:00, run_after=2024-06-28T02:55:00+00:00 2024-06-28T02:54:00.405837545Z [2024-06-28T02:54:00.405+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:54:00.414082431Z [2024-06-28T02:54:00.413+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:54:00.427629357Z [2024-06-28T02:54:00.427+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:54:00+00:00, run_after=2024-06-28T02:55:00+00:00 2024-06-28T02:54:00.515940052Z [2024-06-28T02:54:00.515+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:54:00.515978841Z 2024-06-28T02:54:00.515986617Z 2024-06-28T02:54:00.516011135Z 2024-06-28T02:54:00.516016523Z 2024-06-28T02:54:00.516080185Z [2024-06-28T02:54:00.515+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:54:00.516263280Z [2024-06-28T02:54:00.516+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:54:00.516422222Z [2024-06-28T02:54:00.516+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:54:00.516580618Z [2024-06-28T02:54:00.516+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:54:00.517329660Z [2024-06-28T02:54:00.517+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:54:00.517342144Z 2024-06-28T02:54:00.517352233Z 2024-06-28T02:54:00.517356392Z 2024-06-28T02:54:00.517360171Z 2024-06-28T02:54:00.522043532Z [2024-06-28T02:54:00.521+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:54:00.522295063Z [2024-06-28T02:54:00.522+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:54:00.522720437Z [2024-06-28T02:54:00.522+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:54:00.522978734Z [2024-06-28T02:54:00.522+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:54:00.523274071Z [2024-06-28T02:54:00.523+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:54:00.523468992Z [2024-06-28T02:54:00.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:54:00.523919314Z [2024-06-28T02:54:00.523+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:54:00.524067791Z [2024-06-28T02:54:00.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:54:01.051317109Z [2024-06-28T02:54:01.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:52:00+00:00 exited with status queued for try_number 1 2024-06-28T02:54:01.051345967Z [2024-06-28T02:54:01.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:53:00+00:00 exited with status queued for try_number 1 2024-06-28T02:54:01.051406592Z [2024-06-28T02:54:01.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:53:00+00:00 exited with status queued for try_number 1 2024-06-28T02:54:01.051473345Z [2024-06-28T02:54:01.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:53:00+00:00 exited with status queued for try_number 1 2024-06-28T02:54:01.072020703Z [2024-06-28T02:54:01.071+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c5caa39-4c51-445b-b150-0838b1fcfd21 2024-06-28T02:54:01.072048232Z [2024-06-28T02:54:01.071+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa64eb16-c023-4ff2-b98e-06c094dfd9b2 2024-06-28T02:54:01.072158103Z [2024-06-28T02:54:01.072+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f9b111e-c644-4d42-9e06-45cd81f560ed 2024-06-28T02:54:01.072248373Z [2024-06-28T02:54:01.072+0000] {scheduler_job.py:635} INFO - Setting external_id for to 863ec9bc-014a-4b29-a99a-da5d4ab50cfd 2024-06-28T02:54:02.285185837Z [2024-06-28T02:54:02.284+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:54:02.285423569Z [2024-06-28T02:54:02.285+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:52:00+00:00, run_id=scheduled__2024-06-28T02:52:00+00:00, run_start_date=2024-06-28 02:54:00.440335+00:00, run_end_date=2024-06-28 02:54:02.285118+00:00, run_duration=1.844783, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:52:00+00:00, data_interval_end=2024-06-28 02:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:54:02.292604027Z [2024-06-28T02:54:02.292+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:54:00+00:00, run_after=2024-06-28T02:56:00+00:00 2024-06-28T02:54:02.299142670Z [2024-06-28T02:54:02.298+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:54:02.299302956Z [2024-06-28T02:54:02.299+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:53:00+00:00, run_id=scheduled__2024-06-28T02:53:00+00:00, run_start_date=2024-06-28 02:54:00.441607+00:00, run_end_date=2024-06-28 02:54:02.299048+00:00, run_duration=1.857441, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:53:00+00:00, data_interval_end=2024-06-28 02:54:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:54:02.309552815Z [2024-06-28T02:54:02.309+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:54:00+00:00, run_after=2024-06-28T02:55:00+00:00 2024-06-28T02:54:02.357352881Z [2024-06-28T02:54:02.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:52:00+00:00 exited with status success for try_number 1 2024-06-28T02:54:02.357381713Z [2024-06-28T02:54:02.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:53:00+00:00 exited with status success for try_number 1 2024-06-28T02:54:02.363934886Z [2024-06-28T02:54:02.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:52:00+00:00, map_index=-1, run_start_date=2024-06-28 02:54:01.244846+00:00, run_end_date=2024-06-28 02:54:01.627208+00:00, run_duration=0.382362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1156, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:54:00.518526+00:00, queued_by_job_id=2, pid=16833 2024-06-28T02:54:02.364040698Z [2024-06-28T02:54:02.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:53:00+00:00, map_index=-1, run_start_date=2024-06-28 02:54:01.410806+00:00, run_end_date=2024-06-28 02:54:01.819870+00:00, run_duration=0.409064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1157, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:54:00.518526+00:00, queued_by_job_id=2, pid=16834 2024-06-28T02:54:04.512041353Z [2024-06-28T02:54:04.511+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:54:04.512416634Z [2024-06-28T02:54:04.511+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:53:00+00:00, run_id=scheduled__2024-06-28T02:53:00+00:00, run_start_date=2024-06-28 02:54:00.442669+00:00, run_end_date=2024-06-28 02:54:04.511869+00:00, run_duration=4.0692, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:53:00+00:00, data_interval_end=2024-06-28 02:54:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:54:04.522525391Z [2024-06-28T02:54:04.522+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:54:00+00:00, run_after=2024-06-28T02:55:00+00:00 2024-06-28T02:54:04.536534176Z [2024-06-28T02:54:04.535+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:54:04.537502674Z [2024-06-28T02:54:04.536+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:53:00+00:00, run_id=scheduled__2024-06-28T02:53:00+00:00, run_start_date=2024-06-28 02:54:00.443694+00:00, run_end_date=2024-06-28 02:54:04.536726+00:00, run_duration=4.093032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:53:00+00:00, data_interval_end=2024-06-28 02:54:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:54:04.560674221Z [2024-06-28T02:54:04.560+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:54:00+00:00, run_after=2024-06-28T02:55:00+00:00 2024-06-28T02:54:04.609521017Z [2024-06-28T02:54:04.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:53:00+00:00 exited with status success for try_number 1 2024-06-28T02:54:04.610758884Z [2024-06-28T02:54:04.610+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:53:00+00:00 exited with status success for try_number 1 2024-06-28T02:54:04.618937928Z [2024-06-28T02:54:04.618+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:53:00+00:00, map_index=-1, run_start_date=2024-06-28 02:54:02.435959+00:00, run_end_date=2024-06-28 02:54:03.666556+00:00, run_duration=1.230597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1159, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:54:00.518526+00:00, queued_by_job_id=2, pid=16858 2024-06-28T02:54:04.619656281Z [2024-06-28T02:54:04.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:53:00+00:00, map_index=-1, run_start_date=2024-06-28 02:54:02.297927+00:00, run_end_date=2024-06-28 02:54:04.043632+00:00, run_duration=1.745705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:54:00.518526+00:00, queued_by_job_id=2, pid=16857 2024-06-28T02:55:00.920266143Z [2024-06-28T02:55:00.919+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:55:00.936295097Z [2024-06-28T02:55:00.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:55:00+00:00, run_after=2024-06-28T03:00:00+00:00 2024-06-28T02:55:00.948741007Z [2024-06-28T02:55:00.948+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:55:00+00:00, run_after=2024-06-28T02:56:00+00:00 2024-06-28T02:55:00.962276797Z [2024-06-28T02:55:00.961+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:55:00+00:00, run_after=2024-06-28T02:56:00+00:00 2024-06-28T02:55:01.066916493Z [2024-06-28T02:55:01.066+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:55:01.066973410Z 2024-06-28T02:55:01.067052313Z 2024-06-28T02:55:01.067063570Z 2024-06-28T02:55:01.067072873Z 2024-06-28T02:55:01.067113042Z [2024-06-28T02:55:01.066+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:55:01.067183514Z [2024-06-28T02:55:01.066+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:55:01.067631798Z [2024-06-28T02:55:01.067+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:55:01.068005133Z [2024-06-28T02:55:01.067+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:55:01.069112343Z [2024-06-28T02:55:01.068+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:55:01.069161897Z 2024-06-28T02:55:01.069175692Z 2024-06-28T02:55:01.069185825Z 2024-06-28T02:55:01.069195854Z 2024-06-28T02:55:01.075645854Z [2024-06-28T02:55:01.075+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T02:55:01.076039835Z [2024-06-28T02:55:01.075+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:55:01.076465921Z [2024-06-28T02:55:01.076+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:55:01.076847604Z [2024-06-28T02:55:01.076+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:55:01.077297507Z [2024-06-28T02:55:01.077+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:55:01.077533207Z [2024-06-28T02:55:01.077+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:55:01.077995240Z [2024-06-28T02:55:01.077+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:55:01.078240880Z [2024-06-28T02:55:01.077+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:55:01.356493541Z [2024-06-28T02:55:01.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:50:00+00:00 exited with status queued for try_number 1 2024-06-28T02:55:01.356535301Z [2024-06-28T02:55:01.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:54:00+00:00 exited with status queued for try_number 1 2024-06-28T02:55:01.356698217Z [2024-06-28T02:55:01.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:54:00+00:00 exited with status queued for try_number 1 2024-06-28T02:55:01.356971923Z [2024-06-28T02:55:01.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:54:00+00:00 exited with status queued for try_number 1 2024-06-28T02:55:01.372228808Z [2024-06-28T02:55:01.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd6df9b7-f0a4-4915-9234-fa609656a17b 2024-06-28T02:55:01.372577396Z [2024-06-28T02:55:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5e1f07c-4995-4b49-ade3-d044e0e93a35 2024-06-28T02:55:01.372832509Z [2024-06-28T02:55:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68c7bc48-36d6-4f37-a952-a141f64e4954 2024-06-28T02:55:01.373080689Z [2024-06-28T02:55:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66a9bfba-b9cd-4a83-99b8-59391eb7c73e 2024-06-28T02:55:03.412710025Z [2024-06-28T02:55:03.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:55:03.414101830Z [2024-06-28T02:55:03.413+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:54:00+00:00, run_id=scheduled__2024-06-28T02:54:00+00:00, run_start_date=2024-06-28 02:55:00.973064+00:00, run_end_date=2024-06-28 02:55:03.413646+00:00, run_duration=2.440582, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:54:00+00:00, data_interval_end=2024-06-28 02:55:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:55:03.436278795Z [2024-06-28T02:55:03.435+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:55:00+00:00, run_after=2024-06-28T02:56:00+00:00 2024-06-28T02:55:03.518089602Z [2024-06-28T02:55:03.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:54:00+00:00 exited with status success for try_number 1 2024-06-28T02:55:03.527508129Z [2024-06-28T02:55:03.527+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:54:00+00:00, map_index=-1, run_start_date=2024-06-28 02:55:02.207684+00:00, run_end_date=2024-06-28 02:55:02.726470+00:00, run_duration=0.518786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1160, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:55:01.070730+00:00, queued_by_job_id=2, pid=16892 2024-06-28T02:55:04.617433823Z [2024-06-28T02:55:04.617+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:55:04.617463922Z 2024-06-28T02:55:04.617498495Z [2024-06-28T02:55:04.617+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:55:04.618434339Z [2024-06-28T02:55:04.618+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:55:04.618451161Z 2024-06-28T02:55:04.621612066Z [2024-06-28T02:55:04.621+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T02:55:04.621746007Z [2024-06-28T02:55:04.621+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:55:04.700033580Z [2024-06-28T02:55:04.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:50:00+00:00 exited with status queued for try_number 1 2024-06-28T02:55:04.700082365Z [2024-06-28T02:55:04.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:50:00+00:00 exited with status success for try_number 1 2024-06-28T02:55:04.721549433Z [2024-06-28T02:55:04.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to 212caea7-6892-43a5-ab7b-e62698e728b1 2024-06-28T02:55:04.721662936Z [2024-06-28T02:55:04.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T02:50:00+00:00, map_index=-1, run_start_date=2024-06-28 02:55:03.251642+00:00, run_end_date=2024-06-28 02:55:03.733647+00:00, run_duration=0.482005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1161, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:55:01.070730+00:00, queued_by_job_id=2, pid=16911 2024-06-28T02:55:06.017690134Z [2024-06-28T02:55:06.017+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:55:06.018168899Z [2024-06-28T02:55:06.017+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:54:00+00:00, run_id=scheduled__2024-06-28T02:54:00+00:00, run_start_date=2024-06-28 02:55:00.974054+00:00, run_end_date=2024-06-28 02:55:06.017589+00:00, run_duration=5.043535, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:54:00+00:00, data_interval_end=2024-06-28 02:55:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:55:06.034281039Z [2024-06-28T02:55:06.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:55:00+00:00, run_after=2024-06-28T02:56:00+00:00 2024-06-28T02:55:06.043409316Z [2024-06-28T02:55:06.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:55:06.043634926Z [2024-06-28T02:55:06.043+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:54:00+00:00, run_id=scheduled__2024-06-28T02:54:00+00:00, run_start_date=2024-06-28 02:55:00.975092+00:00, run_end_date=2024-06-28 02:55:06.043322+00:00, run_duration=5.06823, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:54:00+00:00, data_interval_end=2024-06-28 02:55:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:55:06.054658845Z [2024-06-28T02:55:06.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:55:00+00:00, run_after=2024-06-28T02:56:00+00:00 2024-06-28T02:55:06.098277555Z [2024-06-28T02:55:06.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:54:00+00:00 exited with status success for try_number 1 2024-06-28T02:55:06.098338828Z [2024-06-28T02:55:06.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:54:00+00:00 exited with status success for try_number 1 2024-06-28T02:55:06.104623531Z [2024-06-28T02:55:06.104+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:54:00+00:00, map_index=-1, run_start_date=2024-06-28 02:55:03.373216+00:00, run_end_date=2024-06-28 02:55:05.416105+00:00, run_duration=2.042889, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:55:01.070730+00:00, queued_by_job_id=2, pid=16917 2024-06-28T02:55:06.104858397Z [2024-06-28T02:55:06.104+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:54:00+00:00, map_index=-1, run_start_date=2024-06-28 02:55:03.644322+00:00, run_end_date=2024-06-28 02:55:05.089143+00:00, run_duration=1.444821, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1163, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:55:01.070730+00:00, queued_by_job_id=2, pid=16925 2024-06-28T02:55:07.167065099Z [2024-06-28T02:55:07.166+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:55:07.167103267Z 2024-06-28T02:55:07.167171989Z [2024-06-28T02:55:07.166+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:55:07.167985070Z [2024-06-28T02:55:07.167+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:55:07.167999125Z 2024-06-28T02:55:07.170543424Z [2024-06-28T02:55:07.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T02:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T02:55:07.170959786Z [2024-06-28T02:55:07.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T02:55:07.216783231Z [2024-06-28T02:55:07.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:50:00+00:00 exited with status queued for try_number 1 2024-06-28T02:55:07.217089632Z [2024-06-28T02:55:07.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:50:00+00:00 exited with status success for try_number 1 2024-06-28T02:55:07.222413687Z [2024-06-28T02:55:07.222+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35210274-3459-4c50-9f06-736a95898da9 2024-06-28T02:55:07.222785773Z [2024-06-28T02:55:07.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T02:50:00+00:00, map_index=-1, run_start_date=2024-06-28 02:55:06.527129+00:00, run_end_date=2024-06-28 02:55:06.919335+00:00, run_duration=0.392206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1164, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:55:04.618889+00:00, queued_by_job_id=2, pid=16941 2024-06-28T02:55:09.979500990Z [2024-06-28T02:55:09.978+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T02:55:09.979550806Z 2024-06-28T02:55:09.980099790Z [2024-06-28T02:55:09.979+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:55:09.981439077Z [2024-06-28T02:55:09.981+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:55:09.981491745Z 2024-06-28T02:55:09.986175887Z [2024-06-28T02:55:09.985+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:55:09.986378292Z [2024-06-28T02:55:09.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T02:55:10.058468055Z [2024-06-28T02:55:10.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:50:00+00:00 exited with status queued for try_number 1 2024-06-28T02:55:10.058793106Z [2024-06-28T02:55:10.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:50:00+00:00 exited with status success for try_number 1 2024-06-28T02:55:10.068750877Z [2024-06-28T02:55:10.068+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b9984a2-374a-4070-aab3-560a29a04da9 2024-06-28T02:55:10.069150477Z [2024-06-28T02:55:10.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T02:50:00+00:00, map_index=0, run_start_date=2024-06-28 02:55:09.035046+00:00, run_end_date=2024-06-28 02:55:09.524773+00:00, run_duration=0.489727, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1165, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:55:07.168386+00:00, queued_by_job_id=2, pid=16949 2024-06-28T02:55:12.352318515Z [2024-06-28T02:55:12.351+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:55:12.352582613Z [2024-06-28T02:55:12.352+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:50:00+00:00, run_id=scheduled__2024-06-28T02:50:00+00:00, run_start_date=2024-06-28 02:55:00.971935+00:00, run_end_date=2024-06-28 02:55:12.352182+00:00, run_duration=11.380247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:50:00+00:00, data_interval_end=2024-06-28 02:55:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T02:55:12.358355828Z [2024-06-28T02:55:12.358+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:55:00+00:00, run_after=2024-06-28T03:00:00+00:00 2024-06-28T02:55:12.404269618Z [2024-06-28T02:55:12.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:50:00+00:00 exited with status success for try_number 1 2024-06-28T02:55:12.413379823Z [2024-06-28T02:55:12.412+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T02:50:00+00:00, map_index=-1, run_start_date=2024-06-28 02:55:11.590562+00:00, run_end_date=2024-06-28 02:55:12.000102+00:00, run_duration=0.40954, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:55:09.982239+00:00, queued_by_job_id=2, pid=16957 2024-06-28T02:56:00.230176253Z [2024-06-28T02:56:00.229+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:56:00+00:00, run_after=2024-06-28T02:57:00+00:00 2024-06-28T02:56:00.250642045Z [2024-06-28T02:56:00.250+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:56:00+00:00, run_after=2024-06-28T02:57:00+00:00 2024-06-28T02:56:00.262377837Z [2024-06-28T02:56:00.261+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:56:00.285302672Z [2024-06-28T02:56:00.284+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:56:00.439604953Z [2024-06-28T02:56:00.439+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:56:00.439661254Z 2024-06-28T02:56:00.439676020Z 2024-06-28T02:56:00.439691937Z 2024-06-28T02:56:00.439762429Z 2024-06-28T02:56:00.439797730Z [2024-06-28T02:56:00.439+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:56:00.440225971Z [2024-06-28T02:56:00.439+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:56:00.440606617Z [2024-06-28T02:56:00.440+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:56:00.440934267Z [2024-06-28T02:56:00.440+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:56:00.442009665Z [2024-06-28T02:56:00.441+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:56:00.442031562Z 2024-06-28T02:56:00.442037976Z 2024-06-28T02:56:00.442063823Z 2024-06-28T02:56:00.442069529Z 2024-06-28T02:56:00.447494754Z [2024-06-28T02:56:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:56:00.447842336Z [2024-06-28T02:56:00.447+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:56:00.448218639Z [2024-06-28T02:56:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:56:00.448530895Z [2024-06-28T02:56:00.448+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:56:00.448871137Z [2024-06-28T02:56:00.448+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:56:00.449133403Z [2024-06-28T02:56:00.448+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:56:00.449524064Z [2024-06-28T02:56:00.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:56:00.449769938Z [2024-06-28T02:56:00.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:56:00.867992488Z [2024-06-28T02:56:00.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:54:00+00:00 exited with status queued for try_number 1 2024-06-28T02:56:00.868268360Z [2024-06-28T02:56:00.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:55:00+00:00 exited with status queued for try_number 1 2024-06-28T02:56:00.868464032Z [2024-06-28T02:56:00.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:55:00+00:00 exited with status queued for try_number 1 2024-06-28T02:56:00.868630313Z [2024-06-28T02:56:00.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:55:00+00:00 exited with status queued for try_number 1 2024-06-28T02:56:00.881590240Z [2024-06-28T02:56:00.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to d577e054-2fba-4a69-b421-4e196175b064 2024-06-28T02:56:00.881887214Z [2024-06-28T02:56:00.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08db4dd1-6858-4aca-9b45-3a3d8cae3e23 2024-06-28T02:56:00.882122427Z [2024-06-28T02:56:00.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a5acf38-31ed-4f43-915a-17c36f1c41db 2024-06-28T02:56:00.882361765Z [2024-06-28T02:56:00.882+0000] {scheduler_job.py:635} INFO - Setting external_id for to f271233e-6e62-4ca1-bc59-cd854339920e 2024-06-28T02:56:02.112484192Z [2024-06-28T02:56:02.112+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:56:02.113102959Z [2024-06-28T02:56:02.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:54:00+00:00, run_id=scheduled__2024-06-28T02:54:00+00:00, run_start_date=2024-06-28 02:56:00.309817+00:00, run_end_date=2024-06-28 02:56:02.112733+00:00, run_duration=1.802916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:54:00+00:00, data_interval_end=2024-06-28 02:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:56:02.120415879Z [2024-06-28T02:56:02.120+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:56:00+00:00, run_after=2024-06-28T02:58:00+00:00 2024-06-28T02:56:02.126952716Z [2024-06-28T02:56:02.126+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:56:02.127391792Z [2024-06-28T02:56:02.127+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:55:00+00:00, run_id=scheduled__2024-06-28T02:55:00+00:00, run_start_date=2024-06-28 02:56:00.312036+00:00, run_end_date=2024-06-28 02:56:02.127096+00:00, run_duration=1.81506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:55:00+00:00, data_interval_end=2024-06-28 02:56:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:56:02.136699318Z [2024-06-28T02:56:02.136+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:56:00+00:00, run_after=2024-06-28T02:57:00+00:00 2024-06-28T02:56:02.185095464Z [2024-06-28T02:56:02.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:54:00+00:00 exited with status success for try_number 1 2024-06-28T02:56:02.185434987Z [2024-06-28T02:56:02.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:55:00+00:00 exited with status success for try_number 1 2024-06-28T02:56:02.192703791Z [2024-06-28T02:56:02.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:54:00+00:00, map_index=-1, run_start_date=2024-06-28 02:56:01.497656+00:00, run_end_date=2024-06-28 02:56:01.869898+00:00, run_duration=0.372242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:56:00.443413+00:00, queued_by_job_id=2, pid=16981 2024-06-28T02:56:02.193081886Z [2024-06-28T02:56:02.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:55:00+00:00, map_index=-1, run_start_date=2024-06-28 02:56:01.332165+00:00, run_end_date=2024-06-28 02:56:01.764850+00:00, run_duration=0.432685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:56:00.443413+00:00, queued_by_job_id=2, pid=16980 2024-06-28T02:56:04.289502859Z [2024-06-28T02:56:04.289+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:56:04.290196548Z [2024-06-28T02:56:04.289+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:55:00+00:00, run_id=scheduled__2024-06-28T02:55:00+00:00, run_start_date=2024-06-28 02:56:00.313854+00:00, run_end_date=2024-06-28 02:56:04.289448+00:00, run_duration=3.975594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:55:00+00:00, data_interval_end=2024-06-28 02:56:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:56:04.306431856Z [2024-06-28T02:56:04.306+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:56:00+00:00, run_after=2024-06-28T02:57:00+00:00 2024-06-28T02:56:04.364243233Z [2024-06-28T02:56:04.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:55:00+00:00 exited with status success for try_number 1 2024-06-28T02:56:04.382795712Z [2024-06-28T02:56:04.382+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:55:00+00:00, map_index=-1, run_start_date=2024-06-28 02:56:02.609767+00:00, run_end_date=2024-06-28 02:56:04.139557+00:00, run_duration=1.52979, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1170, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:56:00.443413+00:00, queued_by_job_id=2, pid=17005 2024-06-28T02:56:05.018837388Z [2024-06-28T02:56:05.018+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:56:05.019099662Z [2024-06-28T02:56:05.018+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:55:00+00:00, run_id=scheduled__2024-06-28T02:55:00+00:00, run_start_date=2024-06-28 02:56:00.315531+00:00, run_end_date=2024-06-28 02:56:05.018755+00:00, run_duration=4.703224, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:55:00+00:00, data_interval_end=2024-06-28 02:56:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:56:05.028094645Z [2024-06-28T02:56:05.027+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:56:00+00:00, run_after=2024-06-28T02:57:00+00:00 2024-06-28T02:56:05.078638487Z [2024-06-28T02:56:05.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:55:00+00:00 exited with status success for try_number 1 2024-06-28T02:56:05.086947240Z [2024-06-28T02:56:05.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:55:00+00:00, map_index=-1, run_start_date=2024-06-28 02:56:02.355058+00:00, run_end_date=2024-06-28 02:56:04.402968+00:00, run_duration=2.04791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:56:00.443413+00:00, queued_by_job_id=2, pid=16999 2024-06-28T02:56:47.911256303Z [2024-06-28T02:56:47.910+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T02:57:00.129141493Z [2024-06-28T02:57:00.128+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:57:00.144103958Z [2024-06-28T02:57:00.143+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:57:00+00:00, run_after=2024-06-28T02:58:00+00:00 2024-06-28T02:57:00.155460159Z [2024-06-28T02:57:00.155+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:57:00+00:00, run_after=2024-06-28T02:58:00+00:00 2024-06-28T02:57:00.235273781Z [2024-06-28T02:57:00.234+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:57:00.235324967Z 2024-06-28T02:57:00.235330086Z 2024-06-28T02:57:00.235334106Z 2024-06-28T02:57:00.235790824Z [2024-06-28T02:57:00.235+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:57:00.236099198Z [2024-06-28T02:57:00.235+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:57:00.236377345Z [2024-06-28T02:57:00.236+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:57:00.237227470Z [2024-06-28T02:57:00.236+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:57:00.237242462Z 2024-06-28T02:57:00.237272855Z 2024-06-28T02:57:00.237278925Z 2024-06-28T02:57:00.240865670Z [2024-06-28T02:57:00.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:57:00.241208647Z [2024-06-28T02:57:00.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:57:00.241667913Z [2024-06-28T02:57:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:57:00.241971053Z [2024-06-28T02:57:00.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:57:00.242297759Z [2024-06-28T02:57:00.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:57:00.242515130Z [2024-06-28T02:57:00.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:57:00.592297203Z [2024-06-28T02:57:00.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:56:00+00:00 exited with status queued for try_number 1 2024-06-28T02:57:00.592704706Z [2024-06-28T02:57:00.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:56:00+00:00 exited with status queued for try_number 1 2024-06-28T02:57:00.592938826Z [2024-06-28T02:57:00.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:56:00+00:00 exited with status queued for try_number 1 2024-06-28T02:57:00.604282696Z [2024-06-28T02:57:00.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2bb0aa62-1090-41a5-bb5b-c7667e6bab9b 2024-06-28T02:57:00.604557739Z [2024-06-28T02:57:00.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30985ee7-fe3f-4025-a78d-a6b492d87b31 2024-06-28T02:57:00.604804601Z [2024-06-28T02:57:00.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24a5acf9-a4f5-4f24-8c0a-b3de6e1c0f3f 2024-06-28T02:57:02.435088888Z [2024-06-28T02:57:02.434+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:57:02.436302202Z [2024-06-28T02:57:02.435+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:56:00+00:00, run_id=scheduled__2024-06-28T02:56:00+00:00, run_start_date=2024-06-28 02:57:00.164679+00:00, run_end_date=2024-06-28 02:57:02.435316+00:00, run_duration=2.270637, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:56:00+00:00, data_interval_end=2024-06-28 02:57:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:57:02.454608490Z [2024-06-28T02:57:02.453+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:57:00+00:00, run_after=2024-06-28T02:58:00+00:00 2024-06-28T02:57:02.506582002Z [2024-06-28T02:57:02.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:56:00+00:00 exited with status success for try_number 1 2024-06-28T02:57:02.512799704Z [2024-06-28T02:57:02.512+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:56:00+00:00, map_index=-1, run_start_date=2024-06-28 02:57:01.173989+00:00, run_end_date=2024-06-28 02:57:01.545503+00:00, run_duration=0.371514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1171, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:57:00.238170+00:00, queued_by_job_id=2, pid=17037 2024-06-28T02:57:03.560716292Z [2024-06-28T02:57:03.560+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:57:03.560991847Z [2024-06-28T02:57:03.560+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:56:00+00:00, run_id=scheduled__2024-06-28T02:56:00+00:00, run_start_date=2024-06-28 02:57:00.165796+00:00, run_end_date=2024-06-28 02:57:03.560552+00:00, run_duration=3.394756, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:56:00+00:00, data_interval_end=2024-06-28 02:57:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:57:03.571255575Z [2024-06-28T02:57:03.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:57:00+00:00, run_after=2024-06-28T02:58:00+00:00 2024-06-28T02:57:04.142237519Z [2024-06-28T02:57:04.141+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:57:04.142610287Z [2024-06-28T02:57:04.142+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:56:00+00:00, run_id=scheduled__2024-06-28T02:56:00+00:00, run_start_date=2024-06-28 02:57:00.166764+00:00, run_end_date=2024-06-28 02:57:04.142141+00:00, run_duration=3.975377, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:56:00+00:00, data_interval_end=2024-06-28 02:57:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:57:04.154447067Z [2024-06-28T02:57:04.154+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:57:00+00:00, run_after=2024-06-28T02:58:00+00:00 2024-06-28T02:57:04.206155483Z [2024-06-28T02:57:04.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:56:00+00:00 exited with status success for try_number 1 2024-06-28T02:57:04.206179988Z [2024-06-28T02:57:04.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:56:00+00:00 exited with status success for try_number 1 2024-06-28T02:57:04.212673302Z [2024-06-28T02:57:04.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:56:00+00:00, map_index=-1, run_start_date=2024-06-28 02:57:02.037153+00:00, run_end_date=2024-06-28 02:57:03.504063+00:00, run_duration=1.46691, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1172, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:57:00.238170+00:00, queued_by_job_id=2, pid=17055 2024-06-28T02:57:04.212788074Z [2024-06-28T02:57:04.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:56:00+00:00, map_index=-1, run_start_date=2024-06-28 02:57:02.124904+00:00, run_end_date=2024-06-28 02:57:03.762487+00:00, run_duration=1.637583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1173, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:57:00.238170+00:00, queued_by_job_id=2, pid=17056 2024-06-28T02:58:00.049706471Z [2024-06-28T02:58:00.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:58:00+00:00, run_after=2024-06-28T02:59:00+00:00 2024-06-28T02:58:00.056696211Z [2024-06-28T02:58:00.056+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:58:00.063201927Z [2024-06-28T02:58:00.062+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:58:00.074545831Z [2024-06-28T02:58:00.074+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:58:00+00:00, run_after=2024-06-28T02:59:00+00:00 2024-06-28T02:58:00.160486986Z [2024-06-28T02:58:00.160+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T02:58:00.160513278Z 2024-06-28T02:58:00.160518727Z 2024-06-28T02:58:00.160523050Z 2024-06-28T02:58:00.160527336Z 2024-06-28T02:58:00.160710381Z [2024-06-28T02:58:00.160+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T02:58:00.160941846Z [2024-06-28T02:58:00.160+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:58:00.161204617Z [2024-06-28T02:58:00.161+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:58:00.161435218Z [2024-06-28T02:58:00.161+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:58:00.162165325Z [2024-06-28T02:58:00.161+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:58:00.162181285Z 2024-06-28T02:58:00.162186142Z 2024-06-28T02:58:00.162190039Z 2024-06-28T02:58:00.162213828Z 2024-06-28T02:58:00.165951155Z [2024-06-28T02:58:00.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:58:00.166286241Z [2024-06-28T02:58:00.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T02:58:00.166649004Z [2024-06-28T02:58:00.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:58:00.166915369Z [2024-06-28T02:58:00.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:58:00.167274911Z [2024-06-28T02:58:00.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:58:00.167516771Z [2024-06-28T02:58:00.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:58:00.167884577Z [2024-06-28T02:58:00.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:58:00.168131565Z [2024-06-28T02:58:00.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:58:00.679910683Z [2024-06-28T02:58:00.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:56:00+00:00 exited with status queued for try_number 1 2024-06-28T02:58:00.680170312Z [2024-06-28T02:58:00.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:57:00+00:00 exited with status queued for try_number 1 2024-06-28T02:58:00.680440271Z [2024-06-28T02:58:00.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:57:00+00:00 exited with status queued for try_number 1 2024-06-28T02:58:00.680663472Z [2024-06-28T02:58:00.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:57:00+00:00 exited with status queued for try_number 1 2024-06-28T02:58:00.704153290Z [2024-06-28T02:58:00.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7e7edcc-5121-40c1-a5a3-5005dca272de 2024-06-28T02:58:00.704393765Z [2024-06-28T02:58:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to db243f19-72c9-43cf-b49f-e894782e9968 2024-06-28T02:58:00.704581016Z [2024-06-28T02:58:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6581d31-d592-4f14-a5a6-3993bd952865 2024-06-28T02:58:00.704756199Z [2024-06-28T02:58:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53d930e8-db2c-47d0-917b-ceecf4baf605 2024-06-28T02:58:01.795808425Z [2024-06-28T02:58:01.795+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:58:01.796291067Z [2024-06-28T02:58:01.796+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:56:00+00:00, run_id=scheduled__2024-06-28T02:56:00+00:00, run_start_date=2024-06-28 02:58:00.085133+00:00, run_end_date=2024-06-28 02:58:01.795714+00:00, run_duration=1.710581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:56:00+00:00, data_interval_end=2024-06-28 02:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T02:58:01.805984902Z [2024-06-28T02:58:01.805+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T02:58:00+00:00, run_after=2024-06-28T03:00:00+00:00 2024-06-28T02:58:01.813231654Z [2024-06-28T02:58:01.812+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:58:01.813574917Z [2024-06-28T02:58:01.813+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:57:00+00:00, run_id=scheduled__2024-06-28T02:57:00+00:00, run_start_date=2024-06-28 02:58:00.086489+00:00, run_end_date=2024-06-28 02:58:01.813145+00:00, run_duration=1.726656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:57:00+00:00, data_interval_end=2024-06-28 02:58:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:58:01.825112922Z [2024-06-28T02:58:01.824+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:58:00+00:00, run_after=2024-06-28T02:59:00+00:00 2024-06-28T02:58:01.875407439Z [2024-06-28T02:58:01.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:56:00+00:00 exited with status success for try_number 1 2024-06-28T02:58:01.875507470Z [2024-06-28T02:58:01.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:57:00+00:00 exited with status success for try_number 1 2024-06-28T02:58:01.882509083Z [2024-06-28T02:58:01.882+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:56:00+00:00, map_index=-1, run_start_date=2024-06-28 02:58:01.107636+00:00, run_end_date=2024-06-28 02:58:01.476121+00:00, run_duration=0.368485, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1175, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:58:00.163190+00:00, queued_by_job_id=2, pid=17090 2024-06-28T02:58:01.882761389Z [2024-06-28T02:58:01.882+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:57:00+00:00, map_index=-1, run_start_date=2024-06-28 02:58:01.109706+00:00, run_end_date=2024-06-28 02:58:01.507926+00:00, run_duration=0.39822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1174, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:58:00.163190+00:00, queued_by_job_id=2, pid=17089 2024-06-28T02:58:04.078892553Z [2024-06-28T02:58:04.078+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:58:04.078984968Z [2024-06-28T02:58:04.078+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:57:00+00:00, run_id=scheduled__2024-06-28T02:57:00+00:00, run_start_date=2024-06-28 02:58:00.087590+00:00, run_end_date=2024-06-28 02:58:04.078528+00:00, run_duration=3.990938, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:57:00+00:00, data_interval_end=2024-06-28 02:58:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:58:04.095990774Z [2024-06-28T02:58:04.089+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:58:00+00:00, run_after=2024-06-28T02:59:00+00:00 2024-06-28T02:58:04.098988450Z [2024-06-28T02:58:04.098+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:58:04.099003811Z [2024-06-28T02:58:04.098+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:57:00+00:00, run_id=scheduled__2024-06-28T02:57:00+00:00, run_start_date=2024-06-28 02:58:00.088731+00:00, run_end_date=2024-06-28 02:58:04.098515+00:00, run_duration=4.009784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:57:00+00:00, data_interval_end=2024-06-28 02:58:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:58:04.110845828Z [2024-06-28T02:58:04.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:58:00+00:00, run_after=2024-06-28T02:59:00+00:00 2024-06-28T02:58:04.160138592Z [2024-06-28T02:58:04.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:57:00+00:00 exited with status success for try_number 1 2024-06-28T02:58:04.168172961Z [2024-06-28T02:58:04.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:57:00+00:00, map_index=-1, run_start_date=2024-06-28 02:58:02.140560+00:00, run_end_date=2024-06-28 02:58:03.643777+00:00, run_duration=1.503217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1176, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:58:00.163190+00:00, queued_by_job_id=2, pid=17113 2024-06-28T02:58:05.250641394Z [2024-06-28T02:58:05.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:57:00+00:00 exited with status success for try_number 1 2024-06-28T02:58:05.263188896Z [2024-06-28T02:58:05.262+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:57:00+00:00, map_index=-1, run_start_date=2024-06-28 02:58:02.295883+00:00, run_end_date=2024-06-28 02:58:04.052778+00:00, run_duration=1.756895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1177, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:58:00.163190+00:00, queued_by_job_id=2, pid=17114 2024-06-28T02:59:00.960107289Z [2024-06-28T02:59:00.959+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:59:00+00:00, run_after=2024-06-28T03:00:00+00:00 2024-06-28T02:59:00.976235268Z [2024-06-28T02:59:00.975+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T02:59:01.004804469Z [2024-06-28T02:59:01.004+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:59:00+00:00, run_after=2024-06-28T03:00:00+00:00 2024-06-28T02:59:01.110842226Z [2024-06-28T02:59:01.110+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T02:59:01.110873180Z 2024-06-28T02:59:01.110877891Z 2024-06-28T02:59:01.110882099Z 2024-06-28T02:59:01.111049678Z [2024-06-28T02:59:01.110+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T02:59:01.111345894Z [2024-06-28T02:59:01.111+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:59:01.111568483Z [2024-06-28T02:59:01.111+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T02:59:01.112227944Z [2024-06-28T02:59:01.112+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T02:59:01.112236490Z 2024-06-28T02:59:01.112240992Z 2024-06-28T02:59:01.112245261Z 2024-06-28T02:59:01.116664131Z [2024-06-28T02:59:01.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:59:01.116942941Z [2024-06-28T02:59:01.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T02:59:01.117224113Z [2024-06-28T02:59:01.117+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:59:01.117383534Z [2024-06-28T02:59:01.117+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T02:59:01.117623044Z [2024-06-28T02:59:01.117+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T02:59:01.117762695Z [2024-06-28T02:59:01.117+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T02:59:01.347533406Z [2024-06-28T02:59:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:58:00+00:00 exited with status queued for try_number 1 2024-06-28T02:59:01.347858032Z [2024-06-28T02:59:01.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:58:00+00:00 exited with status queued for try_number 1 2024-06-28T02:59:01.348060126Z [2024-06-28T02:59:01.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:58:00+00:00 exited with status queued for try_number 1 2024-06-28T02:59:01.357289171Z [2024-06-28T02:59:01.356+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d09f1c6-c94d-4d40-9194-feac489ac8e7 2024-06-28T02:59:01.357494792Z [2024-06-28T02:59:01.357+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee56bdc4-d2e4-4f98-8838-4a326e7fcf3f 2024-06-28T02:59:01.357668638Z [2024-06-28T02:59:01.357+0000] {scheduler_job.py:635} INFO - Setting external_id for to 584869ff-c8fc-42f0-9b69-3b01657652e3 2024-06-28T02:59:03.444705507Z [2024-06-28T02:59:03.444+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:59:03.445351559Z [2024-06-28T02:59:03.445+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:58:00+00:00, run_id=scheduled__2024-06-28T02:58:00+00:00, run_start_date=2024-06-28 02:59:01.020157+00:00, run_end_date=2024-06-28 02:59:03.444824+00:00, run_duration=2.424667, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:58:00+00:00, data_interval_end=2024-06-28 02:59:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T02:59:03.460316129Z [2024-06-28T02:59:03.459+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T02:59:00+00:00, run_after=2024-06-28T03:00:00+00:00 2024-06-28T02:59:03.536583618Z [2024-06-28T02:59:03.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:58:00+00:00 exited with status success for try_number 1 2024-06-28T02:59:03.543244387Z [2024-06-28T02:59:03.542+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:58:00+00:00, map_index=-1, run_start_date=2024-06-28 02:59:01.972929+00:00, run_end_date=2024-06-28 02:59:02.315449+00:00, run_duration=0.34252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1178, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:59:01.112955+00:00, queued_by_job_id=2, pid=17146 2024-06-28T02:59:05.362444977Z [2024-06-28T02:59:05.361+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:59:05.363054003Z [2024-06-28T02:59:05.362+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:58:00+00:00, run_id=scheduled__2024-06-28T02:58:00+00:00, run_start_date=2024-06-28 02:59:01.022794+00:00, run_end_date=2024-06-28 02:59:05.362366+00:00, run_duration=4.339572, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:58:00+00:00, data_interval_end=2024-06-28 02:59:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T02:59:05.379957706Z [2024-06-28T02:59:05.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:59:00+00:00, run_after=2024-06-28T03:00:00+00:00 2024-06-28T02:59:05.423222076Z [2024-06-28T02:59:05.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:58:00+00:00 exited with status success for try_number 1 2024-06-28T02:59:05.423688732Z [2024-06-28T02:59:05.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:58:00+00:00 exited with status success for try_number 1 2024-06-28T02:59:05.433401040Z [2024-06-28T02:59:05.432+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:58:00+00:00, map_index=-1, run_start_date=2024-06-28 02:59:02.838572+00:00, run_end_date=2024-06-28 02:59:04.786612+00:00, run_duration=1.94804, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:59:01.112955+00:00, queued_by_job_id=2, pid=17164 2024-06-28T02:59:05.433904884Z [2024-06-28T02:59:05.433+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:58:00+00:00, map_index=-1, run_start_date=2024-06-28 02:59:02.904940+00:00, run_end_date=2024-06-28 02:59:05.253858+00:00, run_duration=2.348918, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 02:59:01.112955+00:00, queued_by_job_id=2, pid=17165 2024-06-28T02:59:06.491520888Z [2024-06-28T02:59:06.490+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T02:59:06.491662641Z [2024-06-28T02:59:06.491+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:58:00+00:00, run_id=scheduled__2024-06-28T02:58:00+00:00, run_start_date=2024-06-28 02:59:01.025298+00:00, run_end_date=2024-06-28 02:59:06.491354+00:00, run_duration=5.466056, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:58:00+00:00, data_interval_end=2024-06-28 02:59:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T02:59:06.501391872Z [2024-06-28T02:59:06.500+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T02:59:00+00:00, run_after=2024-06-28T03:00:00+00:00 2024-06-28T03:00:00.750014393Z [2024-06-28T03:00:00.749+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T03:00:00+00:00, run_after=2024-06-28T03:05:00+00:00 2024-06-28T03:00:00.763534887Z [2024-06-28T03:00:00.763+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T03:00:00.782426760Z [2024-06-28T03:00:00.782+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T03:00:00+00:00, run_after=2024-06-28T03:01:00+00:00 2024-06-28T03:00:00.789621887Z [2024-06-28T03:00:00.789+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T03:00:00.801154013Z [2024-06-28T03:00:00.800+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T03:00:00+00:00, run_after=2024-06-28T03:01:00+00:00 2024-06-28T03:00:00.946403825Z [2024-06-28T03:00:00.945+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-06-28T03:00:00.946441632Z 2024-06-28T03:00:00.946447837Z 2024-06-28T03:00:00.946453935Z 2024-06-28T03:00:00.946459900Z 2024-06-28T03:00:00.946465402Z 2024-06-28T03:00:00.946816588Z [2024-06-28T03:00:00.946+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T03:00:00.947117487Z [2024-06-28T03:00:00.946+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T03:00:00.947405689Z [2024-06-28T03:00:00.947+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T03:00:00.947701427Z [2024-06-28T03:00:00.947+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T03:00:00.947990932Z [2024-06-28T03:00:00.947+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T03:00:00.948936077Z [2024-06-28T03:00:00.948+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T03:00:00.948970953Z 2024-06-28T03:00:00.948982186Z 2024-06-28T03:00:00.948991918Z 2024-06-28T03:00:00.949000349Z 2024-06-28T03:00:00.949009020Z 2024-06-28T03:00:00.956634136Z [2024-06-28T03:00:00.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-06-28T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-06-28T03:00:00.956686992Z [2024-06-28T03:00:00.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T03:00:00.957054603Z [2024-06-28T03:00:00.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:00:00.957370815Z [2024-06-28T03:00:00.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T03:00:00.957736420Z [2024-06-28T03:00:00.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:00:00.958045485Z [2024-06-28T03:00:00.957+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T03:00:00.958544926Z [2024-06-28T03:00:00.958+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:00:00.958616313Z [2024-06-28T03:00:00.958+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T03:00:00.959108837Z [2024-06-28T03:00:00.958+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:00:00.959169056Z [2024-06-28T03:00:00.958+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T03:00:01.468762014Z [2024-06-28T03:00:01.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:55:00+00:00 exited with status queued for try_number 1 2024-06-28T03:00:01.470935330Z [2024-06-28T03:00:01.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:58:00+00:00 exited with status queued for try_number 1 2024-06-28T03:00:01.471100372Z [2024-06-28T03:00:01.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:59:00+00:00 exited with status queued for try_number 1 2024-06-28T03:00:01.471278025Z [2024-06-28T03:00:01.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:59:00+00:00 exited with status queued for try_number 1 2024-06-28T03:00:01.471359935Z [2024-06-28T03:00:01.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:59:00+00:00 exited with status queued for try_number 1 2024-06-28T03:00:01.481489337Z [2024-06-28T03:00:01.481+0000] {scheduler_job.py:635} INFO - Setting external_id for to 637dfc69-7d3b-43a3-915d-7265dd0b67f8 2024-06-28T03:00:01.481632570Z [2024-06-28T03:00:01.481+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b07f7e3-3cc1-4738-85bf-2ead17acf529 2024-06-28T03:00:01.481840859Z [2024-06-28T03:00:01.481+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49746c33-d6eb-4020-b464-eea1e6a7db67 2024-06-28T03:00:01.482012212Z [2024-06-28T03:00:01.481+0000] {scheduler_job.py:635} INFO - Setting external_id for to c299f605-e0a8-4a66-901b-dd19caf1a48f 2024-06-28T03:00:01.482195191Z [2024-06-28T03:00:01.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ec0f264-bffe-44f7-9b62-aa04c3736999 2024-06-28T03:00:02.699734065Z [2024-06-28T03:00:02.699+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:00:02.700226171Z [2024-06-28T03:00:02.699+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 02:58:00+00:00, run_id=scheduled__2024-06-28T02:58:00+00:00, run_start_date=2024-06-28 03:00:00.819309+00:00, run_end_date=2024-06-28 03:00:02.699657+00:00, run_duration=1.880348, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:58:00+00:00, data_interval_end=2024-06-28 03:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T03:00:02.708760755Z [2024-06-28T03:00:02.708+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T03:00:00+00:00, run_after=2024-06-28T03:02:00+00:00 2024-06-28T03:00:02.826064829Z [2024-06-28T03:00:02.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T02:58:00+00:00 exited with status success for try_number 1 2024-06-28T03:00:02.840159190Z [2024-06-28T03:00:02.839+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T02:58:00+00:00, map_index=-1, run_start_date=2024-06-28 03:00:01.867607+00:00, run_end_date=2024-06-28 03:00:02.575111+00:00, run_duration=0.707504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:00:00.950286+00:00, queued_by_job_id=2, pid=17199 2024-06-28T03:00:03.991541755Z [2024-06-28T03:00:03.991+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:00:03.991781635Z [2024-06-28T03:00:03.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 02:59:00+00:00, run_id=scheduled__2024-06-28T02:59:00+00:00, run_start_date=2024-06-28 03:00:00.821836+00:00, run_end_date=2024-06-28 03:00:03.991519+00:00, run_duration=3.169683, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:59:00+00:00, data_interval_end=2024-06-28 03:00:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T03:00:04.013163204Z [2024-06-28T03:00:04.012+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T03:00:00+00:00, run_after=2024-06-28T03:01:00+00:00 2024-06-28T03:00:04.150515572Z [2024-06-28T03:00:04.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:59:00+00:00 exited with status success for try_number 1 2024-06-28T03:00:04.157716344Z [2024-06-28T03:00:04.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:59:00+00:00, map_index=-1, run_start_date=2024-06-28 03:00:02.130037+00:00, run_end_date=2024-06-28 03:00:02.866331+00:00, run_duration=0.736294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1182, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:00:00.950286+00:00, queued_by_job_id=2, pid=17200 2024-06-28T03:00:05.222309287Z [2024-06-28T03:00:05.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:00:05.222651997Z [2024-06-28T03:00:05.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:59:00+00:00, run_id=scheduled__2024-06-28T02:59:00+00:00, run_start_date=2024-06-28 03:00:00.825108+00:00, run_end_date=2024-06-28 03:00:05.222281+00:00, run_duration=4.397173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:59:00+00:00, data_interval_end=2024-06-28 03:00:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T03:00:05.237788146Z [2024-06-28T03:00:05.237+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T03:00:00+00:00, run_after=2024-06-28T03:01:00+00:00 2024-06-28T03:00:05.268475747Z [2024-06-28T03:00:05.268+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T03:00:05.268521224Z 2024-06-28T03:00:05.268624647Z [2024-06-28T03:00:05.268+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T03:00:05.269214543Z [2024-06-28T03:00:05.269+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T03:00:05.269234175Z 2024-06-28T03:00:05.271857336Z [2024-06-28T03:00:05.271+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='split_metrics', run_id='scheduled__2024-06-28T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-06-28T03:00:05.271968617Z [2024-06-28T03:00:05.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'split_metrics', 'scheduled__2024-06-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T03:00:05.332202025Z [2024-06-28T03:00:05.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:55:00+00:00 exited with status queued for try_number 1 2024-06-28T03:00:05.332232264Z [2024-06-28T03:00:05.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.extract_metrics_from_vnfrs run_id=scheduled__2024-06-28T02:55:00+00:00 exited with status success for try_number 1 2024-06-28T03:00:05.332383585Z [2024-06-28T03:00:05.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:59:00+00:00 exited with status success for try_number 1 2024-06-28T03:00:05.341033437Z [2024-06-28T03:00:05.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:59:00+00:00, map_index=-1, run_start_date=2024-06-28 03:00:03.596757+00:00, run_end_date=2024-06-28 03:00:05.080711+00:00, run_duration=1.483954, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1183, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:00:00.950286+00:00, queued_by_job_id=2, pid=17229 2024-06-28T03:00:05.341282614Z [2024-06-28T03:00:05.341+0000] {scheduler_job.py:635} INFO - Setting external_id for to db16333a-be9b-4936-8c8d-81410baeebf1 2024-06-28T03:00:05.341805316Z [2024-06-28T03:00:05.341+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-06-28T02:55:00+00:00, map_index=-1, run_start_date=2024-06-28 03:00:03.766278+00:00, run_end_date=2024-06-28 03:00:04.319630+00:00, run_duration=0.553352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1185, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:00:00.950286+00:00, queued_by_job_id=2, pid=17230 2024-06-28T03:00:06.660211130Z [2024-06-28T03:00:06.659+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:00:06.660470766Z [2024-06-28T03:00:06.660+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:59:00+00:00, run_id=scheduled__2024-06-28T02:59:00+00:00, run_start_date=2024-06-28 03:00:00.826902+00:00, run_end_date=2024-06-28 03:00:06.660112+00:00, run_duration=5.83321, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:59:00+00:00, data_interval_end=2024-06-28 03:00:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T03:00:06.669354469Z [2024-06-28T03:00:06.669+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T03:00:00+00:00, run_after=2024-06-28T03:01:00+00:00 2024-06-28T03:00:06.718001131Z [2024-06-28T03:00:06.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T02:59:00+00:00 exited with status success for try_number 1 2024-06-28T03:00:06.728954639Z [2024-06-28T03:00:06.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T02:59:00+00:00, map_index=-1, run_start_date=2024-06-28 03:00:03.871396+00:00, run_end_date=2024-06-28 03:00:05.964485+00:00, run_duration=2.093089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:00:00.950286+00:00, queued_by_job_id=2, pid=17231 2024-06-28T03:00:07.775458145Z [2024-06-28T03:00:07.775+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T03:00:07.775505642Z 2024-06-28T03:00:07.775736038Z [2024-06-28T03:00:07.775+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T03:00:07.776390697Z [2024-06-28T03:00:07.776+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T03:00:07.776402990Z 2024-06-28T03:00:07.778895055Z [2024-06-28T03:00:07.778+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='collect_metrics', run_id='scheduled__2024-06-28T02:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-06-28T03:00:07.779282122Z [2024-06-28T03:00:07.779+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'collect_metrics', 'scheduled__2024-06-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-28T03:00:07.833553265Z [2024-06-28T03:00:07.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:55:00+00:00 exited with status queued for try_number 1 2024-06-28T03:00:07.841871349Z [2024-06-28T03:00:07.840+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2d97cd0-9bcf-4cde-a70a-878c4539494d 2024-06-28T03:00:07.940410178Z [2024-06-28T03:00:07.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.split_metrics run_id=scheduled__2024-06-28T02:55:00+00:00 exited with status success for try_number 1 2024-06-28T03:00:07.945170633Z [2024-06-28T03:00:07.944+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=split_metrics, run_id=scheduled__2024-06-28T02:55:00+00:00, map_index=-1, run_start_date=2024-06-28 03:00:07.160940+00:00, run_end_date=2024-06-28 03:00:07.553691+00:00, run_duration=0.392751, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1186, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:00:05.269564+00:00, queued_by_job_id=2, pid=17254 2024-06-28T03:00:10.495404357Z [2024-06-28T03:00:10.494+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-06-28T03:00:10.495442729Z 2024-06-28T03:00:10.495829129Z [2024-06-28T03:00:10.495+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T03:00:10.497071441Z [2024-06-28T03:00:10.496+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T03:00:10.497093319Z 2024-06-28T03:00:10.501310174Z [2024-06-28T03:00:10.500+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='send_prometheus', run_id='scheduled__2024-06-28T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:00:10.501803940Z [2024-06-28T03:00:10.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'send_prometheus', 'scheduled__2024-06-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-28T03:00:10.560505691Z [2024-06-28T03:00:10.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:55:00+00:00 exited with status queued for try_number 1 2024-06-28T03:00:10.560777682Z [2024-06-28T03:00:10.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.collect_metrics run_id=scheduled__2024-06-28T02:55:00+00:00 exited with status success for try_number 1 2024-06-28T03:00:10.567889796Z [2024-06-28T03:00:10.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c978ba8-169e-44bc-a0b3-6074b7031d63 2024-06-28T03:00:10.568269332Z [2024-06-28T03:00:10.567+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=collect_metrics, run_id=scheduled__2024-06-28T02:55:00+00:00, map_index=0, run_start_date=2024-06-28 03:00:09.338548+00:00, run_end_date=2024-06-28 03:00:09.688617+00:00, run_duration=0.350069, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1187, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:00:07.776799+00:00, queued_by_job_id=2, pid=17262 2024-06-28T03:00:12.857645639Z [2024-06-28T03:00:12.857+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:00:12.858810093Z [2024-06-28T03:00:12.857+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 02:55:00+00:00, run_id=scheduled__2024-06-28T02:55:00+00:00, run_start_date=2024-06-28 03:00:00.816899+00:00, run_end_date=2024-06-28 03:00:12.857660+00:00, run_duration=12.040761, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 02:55:00+00:00, data_interval_end=2024-06-28 03:00:00+00:00, dag_hash=47050a64e336303e82aaf3ff2656ed06 2024-06-28T03:00:12.868780137Z [2024-06-28T03:00:12.868+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T03:00:00+00:00, run_after=2024-06-28T03:05:00+00:00 2024-06-28T03:00:12.905243481Z [2024-06-28T03:00:12.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52.send_prometheus run_id=scheduled__2024-06-28T02:55:00+00:00 exited with status success for try_number 1 2024-06-28T03:00:12.910664295Z [2024-06-28T03:00:12.910+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=send_prometheus, run_id=scheduled__2024-06-28T02:55:00+00:00, map_index=-1, run_start_date=2024-06-28 03:00:12.107107+00:00, run_end_date=2024-06-28 03:00:12.533743+00:00, run_duration=0.426636, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1188, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:00:10.497835+00:00, queued_by_job_id=2, pid=17270 2024-06-28T03:01:00.891571566Z [2024-06-28T03:01:00.891+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T03:01:00+00:00, run_after=2024-06-28T03:02:00+00:00 2024-06-28T03:01:00.918035646Z [2024-06-28T03:01:00.917+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T03:01:00+00:00, run_after=2024-06-28T03:02:00+00:00 2024-06-28T03:01:00.928518248Z [2024-06-28T03:01:00.928+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T03:01:01.012741523Z [2024-06-28T03:01:01.012+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T03:01:01.012789018Z 2024-06-28T03:01:01.012794792Z 2024-06-28T03:01:01.012799827Z 2024-06-28T03:01:01.013169770Z [2024-06-28T03:01:01.012+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T03:01:01.013510284Z [2024-06-28T03:01:01.013+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T03:01:01.013810922Z [2024-06-28T03:01:01.013+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T03:01:01.014707979Z [2024-06-28T03:01:01.014+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T03:01:01.014722619Z 2024-06-28T03:01:01.014727892Z 2024-06-28T03:01:01.014732664Z 2024-06-28T03:01:01.019373833Z [2024-06-28T03:01:01.019+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:01:01.019568547Z [2024-06-28T03:01:01.019+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T03:01:01.019889649Z [2024-06-28T03:01:01.019+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:01:01.020518901Z [2024-06-28T03:01:01.020+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T03:01:01.020853762Z [2024-06-28T03:01:01.020+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:01:01.021080635Z [2024-06-28T03:01:01.020+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T03:01:01.347039247Z [2024-06-28T03:01:01.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:00:00+00:00 exited with status queued for try_number 1 2024-06-28T03:01:01.347176017Z [2024-06-28T03:01:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:00:00+00:00 exited with status queued for try_number 1 2024-06-28T03:01:01.347305466Z [2024-06-28T03:01:01.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:00:00+00:00 exited with status queued for try_number 1 2024-06-28T03:01:01.367556221Z [2024-06-28T03:01:01.367+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08d61895-1e7b-40ff-b12e-8ccf9f186e80 2024-06-28T03:01:01.367696150Z [2024-06-28T03:01:01.367+0000] {scheduler_job.py:635} INFO - Setting external_id for to a721144c-4497-41c8-81d9-08781b53cca5 2024-06-28T03:01:01.367872893Z [2024-06-28T03:01:01.367+0000] {scheduler_job.py:635} INFO - Setting external_id for to ecbfeb62-7880-42db-85f0-0d3dc33e1ca6 2024-06-28T03:01:02.678261320Z [2024-06-28T03:01:02.677+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:01:02.678792248Z [2024-06-28T03:01:02.678+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 03:00:00+00:00, run_id=scheduled__2024-06-28T03:00:00+00:00, run_start_date=2024-06-28 03:01:00.940165+00:00, run_end_date=2024-06-28 03:01:02.678405+00:00, run_duration=1.73824, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 03:00:00+00:00, data_interval_end=2024-06-28 03:01:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T03:01:02.689312774Z [2024-06-28T03:01:02.689+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T03:01:00+00:00, run_after=2024-06-28T03:02:00+00:00 2024-06-28T03:01:02.735750010Z [2024-06-28T03:01:02.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:00:00+00:00 exited with status success for try_number 1 2024-06-28T03:01:02.749168723Z [2024-06-28T03:01:02.748+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T03:00:00+00:00, map_index=-1, run_start_date=2024-06-28 03:01:01.983324+00:00, run_end_date=2024-06-28 03:01:02.361140+00:00, run_duration=0.377816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:01:01.015615+00:00, queued_by_job_id=2, pid=17292 2024-06-28T03:01:05.657745140Z [2024-06-28T03:01:05.655+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:01:05.657775907Z [2024-06-28T03:01:05.656+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 03:00:00+00:00, run_id=scheduled__2024-06-28T03:00:00+00:00, run_start_date=2024-06-28 03:01:00.941523+00:00, run_end_date=2024-06-28 03:01:05.655992+00:00, run_duration=4.714469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 03:00:00+00:00, data_interval_end=2024-06-28 03:01:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T03:01:05.671385345Z [2024-06-28T03:01:05.669+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T03:01:00+00:00, run_after=2024-06-28T03:02:00+00:00 2024-06-28T03:01:05.724487371Z [2024-06-28T03:01:05.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:00:00+00:00 exited with status success for try_number 1 2024-06-28T03:01:05.735432464Z [2024-06-28T03:01:05.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T03:00:00+00:00, map_index=-1, run_start_date=2024-06-28 03:01:03.056254+00:00, run_end_date=2024-06-28 03:01:05.175461+00:00, run_duration=2.119207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1190, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:01:01.015615+00:00, queued_by_job_id=2, pid=17310 2024-06-28T03:01:06.831061601Z [2024-06-28T03:01:06.830+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:01:06.831238221Z [2024-06-28T03:01:06.830+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 03:00:00+00:00, run_id=scheduled__2024-06-28T03:00:00+00:00, run_start_date=2024-06-28 03:01:00.942615+00:00, run_end_date=2024-06-28 03:01:06.830848+00:00, run_duration=5.888233, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 03:00:00+00:00, data_interval_end=2024-06-28 03:01:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T03:01:06.842393791Z [2024-06-28T03:01:06.842+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T03:01:00+00:00, run_after=2024-06-28T03:02:00+00:00 2024-06-28T03:01:06.901193411Z [2024-06-28T03:01:06.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:00:00+00:00 exited with status success for try_number 1 2024-06-28T03:01:06.909732111Z [2024-06-28T03:01:06.909+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T03:00:00+00:00, map_index=-1, run_start_date=2024-06-28 03:01:03.216880+00:00, run_end_date=2024-06-28 03:01:06.031577+00:00, run_duration=2.814697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1191, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:01:01.015615+00:00, queued_by_job_id=2, pid=17311 2024-06-28T03:01:47.998667356Z [2024-06-28T03:01:47.995+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-06-28T03:02:00.935726464Z [2024-06-28T03:02:00.935+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T03:02:00.957248856Z [2024-06-28T03:02:00.956+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T03:02:00+00:00, run_after=2024-06-28T03:03:00+00:00 2024-06-28T03:02:00.968959472Z [2024-06-28T03:02:00.968+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T03:02:00.984473387Z [2024-06-28T03:02:00.984+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T03:02:00+00:00, run_after=2024-06-28T03:03:00+00:00 2024-06-28T03:02:01.130452083Z [2024-06-28T03:02:01.129+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T03:02:01.130502098Z 2024-06-28T03:02:01.130512312Z 2024-06-28T03:02:01.130520310Z 2024-06-28T03:02:01.130527665Z 2024-06-28T03:02:01.130540118Z [2024-06-28T03:02:01.130+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T03:02:01.130960105Z [2024-06-28T03:02:01.130+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T03:02:01.131442805Z [2024-06-28T03:02:01.130+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T03:02:01.131488487Z [2024-06-28T03:02:01.131+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T03:02:01.132584785Z [2024-06-28T03:02:01.132+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T03:02:01.132611937Z 2024-06-28T03:02:01.132624113Z 2024-06-28T03:02:01.132633015Z 2024-06-28T03:02:01.132641494Z 2024-06-28T03:02:01.140237310Z [2024-06-28T03:02:01.139+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:02:01.140281552Z [2024-06-28T03:02:01.139+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T03:02:01.140671294Z [2024-06-28T03:02:01.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:02:01.140827340Z [2024-06-28T03:02:01.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T03:02:01.141204521Z [2024-06-28T03:02:01.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:02:01.141421993Z [2024-06-28T03:02:01.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T03:02:01.141820463Z [2024-06-28T03:02:01.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:02:01.142016854Z [2024-06-28T03:02:01.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T03:02:01.685420701Z [2024-06-28T03:02:01.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T03:00:00+00:00 exited with status queued for try_number 1 2024-06-28T03:02:01.685465495Z [2024-06-28T03:02:01.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:01:00+00:00 exited with status queued for try_number 1 2024-06-28T03:02:01.685747009Z [2024-06-28T03:02:01.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:01:00+00:00 exited with status queued for try_number 1 2024-06-28T03:02:01.685957624Z [2024-06-28T03:02:01.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:01:00+00:00 exited with status queued for try_number 1 2024-06-28T03:02:01.704186649Z [2024-06-28T03:02:01.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to 919a6709-9a09-4a06-97fb-0e0295e8ab47 2024-06-28T03:02:01.704474534Z [2024-06-28T03:02:01.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d55b60d-4a58-4e97-bf30-9dfc24eb42ef 2024-06-28T03:02:01.704710920Z [2024-06-28T03:02:01.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to 532c7461-8afc-4be0-b243-0d87066a39ac 2024-06-28T03:02:01.705028194Z [2024-06-28T03:02:01.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5af10ff-40cd-4bdc-b24c-a5d2a2c08521 2024-06-28T03:02:02.978389591Z [2024-06-28T03:02:02.977+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:02:02.978966217Z [2024-06-28T03:02:02.978+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 03:00:00+00:00, run_id=scheduled__2024-06-28T03:00:00+00:00, run_start_date=2024-06-28 03:02:01.020405+00:00, run_end_date=2024-06-28 03:02:02.978260+00:00, run_duration=1.957855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 03:00:00+00:00, data_interval_end=2024-06-28 03:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T03:02:02.989203581Z [2024-06-28T03:02:02.988+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T03:02:00+00:00, run_after=2024-06-28T03:04:00+00:00 2024-06-28T03:02:02.999079911Z [2024-06-28T03:02:02.998+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:02:02.999213130Z [2024-06-28T03:02:02.999+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 03:01:00+00:00, run_id=scheduled__2024-06-28T03:01:00+00:00, run_start_date=2024-06-28 03:02:01.023191+00:00, run_end_date=2024-06-28 03:02:02.998970+00:00, run_duration=1.975779, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 03:01:00+00:00, data_interval_end=2024-06-28 03:02:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T03:02:03.011039407Z [2024-06-28T03:02:03.010+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T03:02:00+00:00, run_after=2024-06-28T03:03:00+00:00 2024-06-28T03:02:03.077716570Z [2024-06-28T03:02:03.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T03:00:00+00:00 exited with status success for try_number 1 2024-06-28T03:02:03.077911780Z [2024-06-28T03:02:03.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:01:00+00:00 exited with status success for try_number 1 2024-06-28T03:02:03.087309684Z [2024-06-28T03:02:03.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T03:01:00+00:00, map_index=-1, run_start_date=2024-06-28 03:02:02.083350+00:00, run_end_date=2024-06-28 03:02:02.490543+00:00, run_duration=0.407193, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1193, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:02:01.134005+00:00, queued_by_job_id=2, pid=17345 2024-06-28T03:02:03.087809453Z [2024-06-28T03:02:03.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T03:00:00+00:00, map_index=-1, run_start_date=2024-06-28 03:02:01.989525+00:00, run_end_date=2024-06-28 03:02:02.451298+00:00, run_duration=0.461773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1192, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:02:01.134005+00:00, queued_by_job_id=2, pid=17344 2024-06-28T03:02:05.818264953Z [2024-06-28T03:02:05.817+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:02:05.818652673Z [2024-06-28T03:02:05.818+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 03:01:00+00:00, run_id=scheduled__2024-06-28T03:01:00+00:00, run_start_date=2024-06-28 03:02:01.025571+00:00, run_end_date=2024-06-28 03:02:05.818275+00:00, run_duration=4.792704, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 03:01:00+00:00, data_interval_end=2024-06-28 03:02:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T03:02:05.830952481Z [2024-06-28T03:02:05.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T03:02:00+00:00, run_after=2024-06-28T03:03:00+00:00 2024-06-28T03:02:05.837608491Z [2024-06-28T03:02:05.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:02:05.837849008Z [2024-06-28T03:02:05.837+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 03:01:00+00:00, run_id=scheduled__2024-06-28T03:01:00+00:00, run_start_date=2024-06-28 03:02:01.027483+00:00, run_end_date=2024-06-28 03:02:05.837572+00:00, run_duration=4.810089, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 03:01:00+00:00, data_interval_end=2024-06-28 03:02:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T03:02:05.851607058Z [2024-06-28T03:02:05.851+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T03:02:00+00:00, run_after=2024-06-28T03:03:00+00:00 2024-06-28T03:02:05.882270154Z [2024-06-28T03:02:05.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:01:00+00:00 exited with status success for try_number 1 2024-06-28T03:02:05.882428727Z [2024-06-28T03:02:05.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:01:00+00:00 exited with status success for try_number 1 2024-06-28T03:02:05.888585652Z [2024-06-28T03:02:05.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T03:01:00+00:00, map_index=-1, run_start_date=2024-06-28 03:02:03.283251+00:00, run_end_date=2024-06-28 03:02:05.599482+00:00, run_duration=2.316231, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:02:01.134005+00:00, queued_by_job_id=2, pid=17368 2024-06-28T03:02:05.888962069Z [2024-06-28T03:02:05.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T03:01:00+00:00, map_index=-1, run_start_date=2024-06-28 03:02:03.284226+00:00, run_end_date=2024-06-28 03:02:05.260265+00:00, run_duration=1.976039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1195, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:02:01.134005+00:00, queued_by_job_id=2, pid=17369 2024-06-28T03:03:00.137224810Z [2024-06-28T03:03:00.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T03:03:00+00:00, run_after=2024-06-28T03:04:00+00:00 2024-06-28T03:03:00.148345363Z [2024-06-28T03:03:00.147+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T03:03:00.163332828Z [2024-06-28T03:03:00.163+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T03:03:00+00:00, run_after=2024-06-28T03:04:00+00:00 2024-06-28T03:03:00.255166656Z [2024-06-28T03:03:00.254+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-06-28T03:03:00.255211579Z 2024-06-28T03:03:00.255220114Z 2024-06-28T03:03:00.255227429Z 2024-06-28T03:03:00.255451799Z [2024-06-28T03:03:00.255+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T03:03:00.255776287Z [2024-06-28T03:03:00.255+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T03:03:00.256278726Z [2024-06-28T03:03:00.255+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T03:03:00.257131983Z [2024-06-28T03:03:00.256+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T03:03:00.257160683Z 2024-06-28T03:03:00.257165887Z 2024-06-28T03:03:00.257170347Z 2024-06-28T03:03:00.261454423Z [2024-06-28T03:03:00.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:03:00.261824557Z [2024-06-28T03:03:00.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T03:03:00.262196071Z [2024-06-28T03:03:00.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:03:00.262395504Z [2024-06-28T03:03:00.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T03:03:00.262804290Z [2024-06-28T03:03:00.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:03:00.263026434Z [2024-06-28T03:03:00.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T03:03:00.565462129Z [2024-06-28T03:03:00.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:02:00+00:00 exited with status queued for try_number 1 2024-06-28T03:03:00.565752577Z [2024-06-28T03:03:00.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:02:00+00:00 exited with status queued for try_number 1 2024-06-28T03:03:00.565943732Z [2024-06-28T03:03:00.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:02:00+00:00 exited with status queued for try_number 1 2024-06-28T03:03:00.577824504Z [2024-06-28T03:03:00.577+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1dfbe14-9e87-4a96-9cb6-3bbde75f3b97 2024-06-28T03:03:00.578023084Z [2024-06-28T03:03:00.577+0000] {scheduler_job.py:635} INFO - Setting external_id for to a17e793d-5183-4934-b54e-ede263190757 2024-06-28T03:03:00.578182748Z [2024-06-28T03:03:00.578+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac8c0301-562c-47fc-8cab-0a1347285657 2024-06-28T03:03:02.131727578Z [2024-06-28T03:03:02.130+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:03:02.132392466Z [2024-06-28T03:03:02.132+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 03:02:00+00:00, run_id=scheduled__2024-06-28T03:02:00+00:00, run_start_date=2024-06-28 03:03:00.177964+00:00, run_end_date=2024-06-28 03:03:02.131731+00:00, run_duration=1.953767, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 03:02:00+00:00, data_interval_end=2024-06-28 03:03:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T03:03:02.151306982Z [2024-06-28T03:03:02.150+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T03:03:00+00:00, run_after=2024-06-28T03:04:00+00:00 2024-06-28T03:03:02.239460919Z [2024-06-28T03:03:02.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:02:00+00:00 exited with status success for try_number 1 2024-06-28T03:03:02.250762264Z [2024-06-28T03:03:02.250+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T03:02:00+00:00, map_index=-1, run_start_date=2024-06-28 03:03:01.024706+00:00, run_end_date=2024-06-28 03:03:01.401953+00:00, run_duration=0.377247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1196, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:03:00.258095+00:00, queued_by_job_id=2, pid=17401 2024-06-28T03:03:04.316771184Z [2024-06-28T03:03:04.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:03:04.317141361Z [2024-06-28T03:03:04.316+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 03:02:00+00:00, run_id=scheduled__2024-06-28T03:02:00+00:00, run_start_date=2024-06-28 03:03:00.179331+00:00, run_end_date=2024-06-28 03:03:04.316776+00:00, run_duration=4.137445, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 03:02:00+00:00, data_interval_end=2024-06-28 03:03:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T03:03:04.325173031Z [2024-06-28T03:03:04.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T03:03:00+00:00, run_after=2024-06-28T03:04:00+00:00 2024-06-28T03:03:04.332084129Z [2024-06-28T03:03:04.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:03:04.332419979Z [2024-06-28T03:03:04.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 03:02:00+00:00, run_id=scheduled__2024-06-28T03:02:00+00:00, run_start_date=2024-06-28 03:03:00.180445+00:00, run_end_date=2024-06-28 03:03:04.332095+00:00, run_duration=4.15165, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 03:02:00+00:00, data_interval_end=2024-06-28 03:03:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T03:03:04.342385263Z [2024-06-28T03:03:04.342+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T03:03:00+00:00, run_after=2024-06-28T03:04:00+00:00 2024-06-28T03:03:04.385936538Z [2024-06-28T03:03:04.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:02:00+00:00 exited with status success for try_number 1 2024-06-28T03:03:04.386094868Z [2024-06-28T03:03:04.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:02:00+00:00 exited with status success for try_number 1 2024-06-28T03:03:04.392979592Z [2024-06-28T03:03:04.392+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T03:02:00+00:00, map_index=-1, run_start_date=2024-06-28 03:03:02.160909+00:00, run_end_date=2024-06-28 03:03:03.392361+00:00, run_duration=1.231452, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:03:00.258095+00:00, queued_by_job_id=2, pid=17419 2024-06-28T03:03:04.393209366Z [2024-06-28T03:03:04.393+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T03:02:00+00:00, map_index=-1, run_start_date=2024-06-28 03:03:02.192969+00:00, run_end_date=2024-06-28 03:03:03.903240+00:00, run_duration=1.710271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1198, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:03:00.258095+00:00, queued_by_job_id=2, pid=17420 2024-06-28T03:04:00.117776212Z [2024-06-28T03:04:00.117+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T03:04:00.134961764Z [2024-06-28T03:04:00.134+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T03:04:00+00:00, run_after=2024-06-28T03:05:00+00:00 2024-06-28T03:04:00.146828008Z [2024-06-28T03:04:00.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T03:04:00+00:00, run_after=2024-06-28T03:05:00+00:00 2024-06-28T03:04:00.154097456Z [2024-06-28T03:04:00.153+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-06-28T03:04:00.242066206Z [2024-06-28T03:04:00.241+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-06-28T03:04:00.242093308Z 2024-06-28T03:04:00.242098167Z 2024-06-28T03:04:00.242102026Z 2024-06-28T03:04:00.242105774Z 2024-06-28T03:04:00.242110327Z [2024-06-28T03:04:00.241+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-06-28T03:04:00.242464613Z [2024-06-28T03:04:00.242+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T03:04:00.242646345Z [2024-06-28T03:04:00.242+0000] {scheduler_job.py:425} INFO - DAG vim_status_f2996707-08d4-490d-a390-004c47f0dc52 has 0/16 running and queued tasks 2024-06-28T03:04:00.242901018Z [2024-06-28T03:04:00.242+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 has 0/16 running and queued tasks 2024-06-28T03:04:00.243863858Z [2024-06-28T03:04:00.243+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-06-28T03:04:00.243941489Z 2024-06-28T03:04:00.243954287Z 2024-06-28T03:04:00.243962959Z 2024-06-28T03:04:00.243971411Z 2024-06-28T03:04:00.248253061Z [2024-06-28T03:04:00.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-06-28T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:04:00.248472816Z [2024-06-28T03:04:00.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-28T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-28T03:04:00.248932002Z [2024-06-28T03:04:00.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:04:00.249007410Z [2024-06-28T03:04:00.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-28T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-28T03:04:00.249233798Z [2024-06-28T03:04:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f2996707-08d4-490d-a390-004c47f0dc52', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:04:00.250941714Z [2024-06-28T03:04:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f2996707-08d4-490d-a390-004c47f0dc52', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-28T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-28T03:04:00.251291868Z [2024-06-28T03:04:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-06-28T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-06-28T03:04:00.251460815Z [2024-06-28T03:04:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_58a4249b-a408-4663-9b05-d751136639d8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-28T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-28T03:04:00.659850730Z [2024-06-28T03:04:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T03:02:00+00:00 exited with status queued for try_number 1 2024-06-28T03:04:00.659971317Z [2024-06-28T03:04:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:03:00+00:00 exited with status queued for try_number 1 2024-06-28T03:04:00.660042186Z [2024-06-28T03:04:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:03:00+00:00 exited with status queued for try_number 1 2024-06-28T03:04:00.660106028Z [2024-06-28T03:04:00.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:03:00+00:00 exited with status queued for try_number 1 2024-06-28T03:04:00.682398023Z [2024-06-28T03:04:00.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to 725e8934-b06e-4490-af94-25765a257665 2024-06-28T03:04:00.682625316Z [2024-06-28T03:04:00.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff991c22-ca31-43e2-b460-e1ec5f600c80 2024-06-28T03:04:00.682823125Z [2024-06-28T03:04:00.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0ddc7b8-3d37-4e6a-8015-7dd03d4feaf2 2024-06-28T03:04:00.682958840Z [2024-06-28T03:04:00.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d5bb859-a361-47d9-b76c-1b20dd58ffa7 2024-06-28T03:04:01.930404292Z [2024-06-28T03:04:01.929+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:04:01.930779711Z [2024-06-28T03:04:01.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-06-28 03:02:00+00:00, run_id=scheduled__2024-06-28T03:02:00+00:00, run_start_date=2024-06-28 03:04:00.164973+00:00, run_end_date=2024-06-28 03:04:01.930340+00:00, run_duration=1.765367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 03:02:00+00:00, data_interval_end=2024-06-28 03:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-06-28T03:04:01.941459432Z [2024-06-28T03:04:01.941+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-06-28T03:04:00+00:00, run_after=2024-06-28T03:06:00+00:00 2024-06-28T03:04:01.951077217Z [2024-06-28T03:04:01.950+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:04:01.951217235Z [2024-06-28T03:04:01.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, execution_date=2024-06-28 03:03:00+00:00, run_id=scheduled__2024-06-28T03:03:00+00:00, run_start_date=2024-06-28 03:04:00.166220+00:00, run_end_date=2024-06-28 03:04:01.950997+00:00, run_duration=1.784777, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 03:03:00+00:00, data_interval_end=2024-06-28 03:04:00+00:00, dag_hash=3da09d08dfeca6e39809e9927d8a276f 2024-06-28T03:04:01.961771009Z [2024-06-28T03:04:01.961+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_58a4249b-a408-4663-9b05-d751136639d8 to 2024-06-28T03:04:00+00:00, run_after=2024-06-28T03:05:00+00:00 2024-06-28T03:04:02.027529656Z [2024-06-28T03:04:02.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-06-28T03:02:00+00:00 exited with status success for try_number 1 2024-06-28T03:04:02.027579007Z [2024-06-28T03:04:02.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_58a4249b-a408-4663-9b05-d751136639d8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:03:00+00:00 exited with status success for try_number 1 2024-06-28T03:04:02.035150000Z [2024-06-28T03:04:02.034+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_58a4249b-a408-4663-9b05-d751136639d8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T03:03:00+00:00, map_index=-1, run_start_date=2024-06-28 03:04:01.265137+00:00, run_end_date=2024-06-28 03:04:01.712451+00:00, run_duration=0.447314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:04:00.244932+00:00, queued_by_job_id=2, pid=17455 2024-06-28T03:04:02.035304998Z [2024-06-28T03:04:02.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-06-28T03:02:00+00:00, map_index=-1, run_start_date=2024-06-28 03:04:01.143163+00:00, run_end_date=2024-06-28 03:04:01.615983+00:00, run_duration=0.47282, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1199, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:04:00.244932+00:00, queued_by_job_id=2, pid=17453 2024-06-28T03:04:04.222090497Z [2024-06-28T03:04:04.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:04:04.222324223Z [2024-06-28T03:04:04.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 03:03:00+00:00, run_id=scheduled__2024-06-28T03:03:00+00:00, run_start_date=2024-06-28 03:04:00.167338+00:00, run_end_date=2024-06-28 03:04:04.221995+00:00, run_duration=4.054657, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 03:03:00+00:00, data_interval_end=2024-06-28 03:04:00+00:00, dag_hash=fd1c63198df65b0df1f943c89a4b4748 2024-06-28T03:04:04.231977868Z [2024-06-28T03:04:04.231+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T03:04:00+00:00, run_after=2024-06-28T03:05:00+00:00 2024-06-28T03:04:04.239399290Z [2024-06-28T03:04:04.238+0000] {dagrun.py:607} INFO - Marking run successful 2024-06-28T03:04:04.239652060Z [2024-06-28T03:04:04.239+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, execution_date=2024-06-28 03:03:00+00:00, run_id=scheduled__2024-06-28T03:03:00+00:00, run_start_date=2024-06-28 03:04:00.168416+00:00, run_end_date=2024-06-28 03:04:04.239326+00:00, run_duration=4.07091, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-06-28 03:03:00+00:00, data_interval_end=2024-06-28 03:04:00+00:00, dag_hash=288135e6d2ba1da6f3cf34f083eb99be 2024-06-28T03:04:04.250449999Z [2024-06-28T03:04:04.250+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52 to 2024-06-28T03:04:00+00:00, run_after=2024-06-28T03:05:00+00:00 2024-06-28T03:04:04.288408325Z [2024-06-28T03:04:04.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:03:00+00:00 exited with status success for try_number 1 2024-06-28T03:04:04.288463981Z [2024-06-28T03:04:04.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f2996707-08d4-490d-a390-004c47f0dc52.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-06-28T03:03:00+00:00 exited with status success for try_number 1 2024-06-28T03:04:04.296594758Z [2024-06-28T03:04:04.296+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T03:03:00+00:00, map_index=-1, run_start_date=2024-06-28 03:04:02.316225+00:00, run_end_date=2024-06-28 03:04:03.893594+00:00, run_duration=1.577369, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1202, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:04:00.244932+00:00, queued_by_job_id=2, pid=17478 2024-06-28T03:04:04.297476506Z [2024-06-28T03:04:04.296+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f2996707-08d4-490d-a390-004c47f0dc52, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-06-28T03:03:00+00:00, map_index=-1, run_start_date=2024-06-28 03:04:02.254838+00:00, run_end_date=2024-06-28 03:04:03.574023+00:00, run_duration=1.319185, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-06-28 03:04:00.244932+00:00, queued_by_job_id=2, pid=17477 2024-06-27T22:31:31.219277367Z 2024-06-27T22:31:31.224500049Z Cleaning logs every 900 seconds 2024-06-27T22:31:31.224775822Z Trimming airflow logs to 15 days. 2024-06-27T22:45:00.273743105Z Trimming airflow logs to 15 days. 2024-06-27T22:45:01.293584949Z Trimming airflow logs to 15 days. 2024-06-27T23:00:00.365399819Z Trimming airflow logs to 15 days. 2024-06-27T23:00:01.394848737Z Trimming airflow logs to 15 days. 2024-06-27T23:15:00.439355686Z Trimming airflow logs to 15 days. 2024-06-27T23:15:01.471036404Z Trimming airflow logs to 15 days. 2024-06-27T23:30:00.504146099Z Trimming airflow logs to 15 days. 2024-06-27T23:30:01.523297896Z Trimming airflow logs to 15 days. 2024-06-27T23:45:00.562108759Z Trimming airflow logs to 15 days. 2024-06-27T23:45:01.602130127Z Trimming airflow logs to 15 days. 2024-06-28T00:00:00.652837164Z Trimming airflow logs to 15 days. 2024-06-28T00:00:01.675331658Z Trimming airflow logs to 15 days. 2024-06-28T00:15:00.726485645Z Trimming airflow logs to 15 days. 2024-06-28T00:15:01.774140191Z Trimming airflow logs to 15 days. 2024-06-28T00:30:00.807541424Z Trimming airflow logs to 15 days. 2024-06-28T00:30:01.843119650Z Trimming airflow logs to 15 days. 2024-06-28T00:45:00.895932612Z Trimming airflow logs to 15 days. 2024-06-28T00:45:01.966983963Z Trimming airflow logs to 15 days. 2024-06-28T01:00:01.021173826Z Trimming airflow logs to 15 days. 2024-06-28T01:15:00.063706949Z Trimming airflow logs to 15 days. 2024-06-28T01:15:01.092248381Z Trimming airflow logs to 15 days. 2024-06-28T01:30:00.141996920Z Trimming airflow logs to 15 days. 2024-06-28T01:30:01.174642713Z Trimming airflow logs to 15 days. 2024-06-28T01:45:00.225353297Z Trimming airflow logs to 15 days. 2024-06-28T01:45:01.261422833Z Trimming airflow logs to 15 days. 2024-06-28T02:00:00.300008589Z Trimming airflow logs to 15 days. 2024-06-28T02:00:01.325073154Z Trimming airflow logs to 15 days. 2024-06-28T02:15:00.364596742Z Trimming airflow logs to 15 days. 2024-06-28T02:15:01.398476797Z Trimming airflow logs to 15 days. 2024-06-28T02:30:00.449184031Z Trimming airflow logs to 15 days. 2024-06-28T02:30:01.479094905Z Trimming airflow logs to 15 days. 2024-06-28T02:45:00.542574285Z Trimming airflow logs to 15 days. 2024-06-28T02:45:01.571423725Z Trimming airflow logs to 15 days. 2024-06-28T03:00:00.625499975Z Trimming airflow logs to 15 days. 2024-06-28T03:00:01.650308346Z Trimming airflow logs to 15 days.